Unverified50% confidenceBenchmarkExact time
In the τ-bench retail probe, the action model predicted the environment's rejections with precision and recall of 1.000 on 11,763 held-out transitions, abstaining in only 0.26% of cases.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/12/2026
First Seen
Valid until: 10/26/2026
Sources
Related Entities
Related Claims
UnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.71% similarUnverifiedAs the model scales from 8B to 70B, the predictive power of fixed output vector similarity for behavior actually worsens, with a paired mean correlation change of -0.080 (95% confidence interval [-0.127, -0.035]).70% similarUnverifiedIn the Soai reaction, even if the initial chiral imbalance is less than 0.00005%, the enantiomeric excess (ee value) of the product can exceed 99.5% after multiple cycles.68% similarUnverifiedOf the 12 hosted models measured, 7 maintained a false-confidence rate of 0.00 or 0.10 across every format.68% similarUnverifiedAnthropic's research shows that excessive alignment may cause a model's refusal rate on harmless questions to rise from under 1% to over 10%.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1006097API
curl https://kongchang.com/api/v1/knowledge/claims/1006097MCP
get_claim(id=1006097)