Unverified50% confidenceFactExact time
The test questions are divided into 40 easy-to-verify questions and 40 hard-to-verify questions, and all standard answers of the math, code, and date types are validated in Python.
1
Sources
50%
Confidence
Long-term
Relevance
10/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedThis test used a legacy codebase benchmark provided by community members, consisting of 34 functional questions divided into four difficulty tiers: easy, medium, hard, and finale.72% similarUnverifiedThe benchmark uses a unified set of 100 questions, with only one search issued per question and the same answering model used across all configurations to process the returned content.70% similarUnverifiedEach question in the benchmark has a single correct answer derived by Python computation; the scorer requires models to end with ANSWER:<value>, EMI allows a rounding tolerance of ±₹2, and the formatting group requires exact string matching.66% similarUnverifiedMost traditional LLM benchmarks focus on relatively closed tasks such as single-turn question answering, code generation, and reasoning problems.66% similarVerifiedIndustry-standard test cases contain fields including case ID, module, title, preconditions, test steps, expected results, priority (P0/P1/P2), and test type.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/996773API
curl https://kongchang.com/api/v1/knowledge/claims/996773MCP
get_claim(id=996773)