Unverified50% confidenceBenchmarkExact time
In 20 public targeted test cases of "omitted inverse-square correction," the three best-performing models caught the error in every worksheet, while the three weaker models accepted 16 to 18 of the 20 worksheets with implanted errors.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
11/4/2026
First Seen
Valid until: 2/2/2027
Sources
Related Entities
Related Claims
UnverifiedThe criteria are divided into four families—foundational, premature disclosure, goal deviation, and information omission—with 19 failure modes in total, of which 18 were triggered in actual testing.80% similarUnverifiedOn four models and three benchmarks, the best-performing skeleton specification reduced average test error by 48.4% compared with the best end-to-end behavioral specification.79% similarUnverifiedIn the error-correction task, five models detect at least 96.7% of implanted errors, with a false-positive rate of no more than 4%.79% similarUnverifiedAmong 19 studies that reported which direction the evaluator's errors lean, 12 lean toward passing work that should have failed, 3 lean in the opposite direction, and 4 are mixed.77% similarUnverifiedThe evaluation results contained a total of 41 failure cases, of which 3 were genuine AI agent faults, 28 were bugs in the grader or test cases, 9 were reply checks that were too strict, and 1 was an email masking defect.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1134264API
curl https://kongchang.com/api/v1/knowledge/claims/1134264MCP
get_claim(id=1134264)