Unverified50% confidenceFactExact time
期望校准误差(ECE)通过将预测样本按置信度分桶,计算每桶内预测置信度与实际准确率之差的加权平均值,理想情况下趋近于0
1
Sources
50%
Confidence
Long-term
Relevance
7/8/2026
First Seen
Sources
元认知反馈:用强化学习让大模型准确表达不确定性
hackernewshackernews7/7/2026
Related Claims
Unverified研究者通常使用期望校准误差(ECE)来量化模型的校准程度82% similarUnverifiedBrier评分通过计算预测概率与实际结果之差的平方来评估校准质量,分数越低代表预测越准确69% similarUnverified在样本严重不均衡时,精度(Accuracy)会产生误导,模型把所有人都预测为健康精度照样能达到99%以上67% similarUnverified在Elo系统中,若模型A评分为Ra、模型B评分为Rb,A获胜的期望概率为1/(1+10^((Rb-Ra)/400))65% similarUnverified测试的准确率数据在n=100样本量下误差约为±8-10个百分点(基于95%置信水平的二项分布置信区间)65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/279893API
curl https://kongchang.com/api/v1/knowledge/claims/279893MCP
get_claim(id=279893)