Unverified50% confidenceFactExact time
This test has limitations: only 14 groups, one 2-billion-parameter model, one run; three valid paraphrases were corrected before the run because they changed the legal meaning, and the corrections are in the same commit as the test set; the test set has not yet been run on larger models.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/16/2026
First Seen
Valid until: 1/14/2027
Sources
Related Entities
Related Claims
Unverified该测试样本规模相对有限（5个模型、13个代码库），结论有待更大规模验证79% similarUnverifiedThe sample size of this comparison experiment is limited: each question was asked twice, so the actual number of distinct questions covered is only about 14, and a single correct or incorrect answer greatly perturbs the conclusion.75% similarUnverifiedThis benchmark uses 10 original short documents of 200 to 250 words each, with 18 planted anomalies, 37 scoring entries in total (18 dirty and 19 clean), testing 13 models with 74 prompts per model.74% similarUnverifiedIn the benchmark's 60 runs, the early termination conditions were triggered 27 times, including 21 detections of lack of progress and 6 cases of model provider unavailability.74% similarUnverifiedThe current dataset contains 770 recorded attempts across 29 model/configuration entries, but the unified test suite includes only 16 distinct tasks.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1045700API
curl https://kongchang.com/api/v1/knowledge/claims/1045700MCP
get_claim(id=1045700)