Unverified50% confidenceFactExact time
An ECE between 3.7 and 5.5 means that when the model gives 80% confidence, the actual accuracy is roughly between 74.5% and 76.3%.
1
Sources
50%
Confidence
Long-term
Relevance
11/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedAt the mention level, the model achieved an overall precision of 74.1% and a recall of 70.5%.74% similarUnverifiedECE (Expected Calibration Error) measures the consistency between a model's confidence and its true accuracy; a lower ECE indicates more trustworthy probability outputs.73% similarUnverifiedWhen large models answer directly, their pass rate on implicit scoring criteria is only 67%, while their pass rate on explicit criteria reaches 81%.72% similarVerifiedExpected Calibration Error (ECE) bins prediction samples by confidence level, computes the weighted average of the difference between predicted confidence and actual accuracy within each bin, and ideally approaches 0.72% similarUnverifiedAt τ=0.6 the confidence distribution is concentrated around a median of 0.6294, and 851 of the 2000 decisions (42.6%) fall below 0.6, which by case count is 90.8%.72% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1159069API
curl https://kongchang.com/api/v1/knowledge/claims/1159069MCP
get_claim(id=1159069)