Unverified50% confidenceDecision RuleExact time
人工评估常用标注者间一致性（IAA）指标如Cohen's Kappa和Krippendorff's Alpha来确保评估质量可靠性，一般Kappa大于0.7为可接受水平
1
Sources
50%
Confidence
Long-term
Relevance
8/20/2026
First Seen
Sources
Related Claims
UnverifiedCommonly used calibration evaluation metrics include Expected Calibration Error (ECE) and Reliability Diagrams.68% similarUnverifiedAlphaEvolve的效果高度依赖于可自动评估的前提，评估器质量直接决定系统上限67% similarUnverified目标检测任务中常用IoU（Intersection over Union）衡量不同标注员标注框的一致性，通常以0.5或0.75作为阈值66% similarUnverified校准性（Calibration）指模型表达的置信度与实际准确率之间的一致程度，是评估AI模型质量的核心指标之一64% similarUnverified董事会汇报AI质量应使用三个核心指标：发布前拦截的回归数、用户侧信号、结果验证（趋势）64% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/779014API
curl https://kongchang.com/api/v1/knowledge/claims/779014MCP
get_claim(id=779014)