Unverified50% confidenceBenchmarkExact time
In the TRACES test, every model had a failure rate above 71% on the 'agentic' probes; 22 of the 30 models had failure rates above 90%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/18/2026
First Seen
Valid until: 1/16/2027
Sources
Related Entities
Related Claims
UnverifiedIn tasks with propositional constraints, the proportion of models integrating candidates already verified as invalid is as high as 93%–100%.75% similarUnverifiedOn a test set of 100 tickets, SupportOps-AI had an escalation error rate of 18%, a hallucination rate of 6%, an infinite-loop rate of 3%, and a complete failure/unresolved rate of 4%.75% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.74% similarUnverifiedIn 11 of the 12 models, between 87.5% and 100% of capitulation cases stopped at the exact wrong number provided by the user, meaning capitulation typically involves switching sides entirely.71% similarUnverifiedDuring testing, cases emerged where a model claimed 95% confidence in a move but scored 0 points according to the evaluation criteria.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1057387API
curl https://kongchang.com/api/v1/knowledge/claims/1057387MCP
get_claim(id=1057387)