Unverified50% confidenceOpinionExact time
A model that scores higher on safety evaluations may also be less readable.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/24/2026
First Seen
Valid until: 1/22/2027
Sources
Related Entities
Related Claims
UnverifiedA psychometric audit study of the HELM Safety benchmark points out that similar total scores between models may mask entirely different attribute profiles.77% similarUnverifiedRecording negative samples where 'a recommended solution did not apply' is just as important as recording successes; otherwise the model will fall into statistical bias, mistaking high-frequency solutions for high-accuracy ones73% similarUnverifiedIn high-risk AI system deployments, a low sampling rate (such as 0.3%) makes confidence intervals too wide to support claims of systematically good quality, and sampling coverage itself should serve as an auditable regulatory metric.73% similarUnverified在事实性评估任务上模型评判者准确率仍显著低于人类专家，但在风格、连贯性等主观维度已接近人类评审员间一致性水平71% similarUnverifiedThe same model may rank very differently across different evaluation platforms.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1094415API
curl https://kongchang.com/api/v1/knowledge/claims/1094415MCP
get_claim(id=1094415)