Unverified50% confidenceFactExact time
When the model claims at least 90% confidence, its actual accuracy is only 56%, making it an extremely poorly calibrated model; therefore ReachNT hides the confidence percentage from tenants, and 42% of dangerous reports are routed to human handling before any decision is made.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/16/2026
First Seen
Valid until: 1/14/2027
Sources
Related Entities
Related Claims
UnverifiedThe model has an 89% probability of finding the correct evidence, but only a 20% probability of turning it into a verifiable product assertion; 71% of features ultimately had no verified capability description, and the workflow recovery rate was only 18%.76% similarUnverifiedThe confidence reported by the model is severely disconnected from actual accuracy: the 95% confidence tier had an actual accuracy of 0%, while the 90% and 70% tiers both had an actual accuracy of 100%.75% similarUnverifiedThe probability reported by a model (e.g., 90%) refers to the model's confidence in its own classification judgment and has nothing to do with business urgency.72% similarUnverifiedA gating accuracy of 58% reported in the paper was mistakenly treated as end-to-end quality, whereas the true end-to-end quality is 98%.72% similarUnverifiedRanked by question difficulty, persistence rate was 91.4% on the 60 questions that all models answered correctly, but only 73.5% on the 52 questions that at least one model got wrong, indicating that sycophancy tracks uncertainty.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1044780API
curl https://kongchang.com/api/v1/knowledge/claims/1044780MCP
get_claim(id=1044780)