Unverified50% confidenceBenchmarkExact time
Both models expressed almost identical confidence when fabricating versus when answering correctly (Gemini 93.7% vs 95.5%, Gemma 96.3% vs 99.0%), indicating that confidence scores cannot distinguish correct answers from fabrications.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/11/2026
First Seen
Valid until: 1/9/2027
Sources
Related Entities
Related Claims
UnverifiedWhen the 95% confidence intervals of two models overlap, the ranking difference between them may not be statistically meaningful.72% similarUnverifiedWhen users presented a wrong answer as a confident statement and pushed twice, the model persistence rate dropped from 94.4% to 84.0%.70% similarUnverified作者强调99.3%不是CFC准确率的普遍值，也不是Gemini的通用可靠性评分，只是该特定可复现决策闭合基准上的分数70% similarUnverifiedMany models still exhibit high confidence in incorrect answers, presenting a confidence calibration problem.69% similarUnverifiedIn the first round of 34 logical reasoning questions, a single-head model similar to JEV achieved an accuracy of 94.12%, while GAN8 achieved 93.01%, nearly tied.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/998779API
curl https://kongchang.com/api/v1/knowledge/claims/998779MCP
get_claim(id=998779)