Unverified50% confidenceOpinionExact time
When a metric becomes a target, it ceases to be a good metric (Goodhart's Law); when the industry races around benchmarks such as MMLU, HumanEval, and MATH, these tests become over-optimized.
1
Sources
50%
Confidence
Long-term
Relevance
8/9/2026
First Seen
Sources
AI落地的真正瓶颈不是智能：数据、工程与可靠性才是关键
Related Claims
UnverifiedGoodhart定律指出当一个度量成为目标时，它就不再是好的度量，该定律适用于AI评测军备竞赛问题78% similarUnverifiedGoodhart's Law states that when a quality metric becomes an optimization target, it is no longer a good measure of quality, as the model may learn to game the score rather than genuinely improve.77% similarVerified基准过拟合是Goodhart定律在AI评估领域的体现，即衡量指标成为优化目标时便失去衡量有效性77% similarVerified古德哈特定律描述：当一个度量指标变成目标时，它就不再是好的度量指标了76% similarUnverifiedGoodhart's Law states that when a metric becomes a target in itself it is no longer a good metric, and introducing test sets into training data causes a model's exam scores to decouple from its true capabilities76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/717077API
curl https://kongchang.com/api/v1/knowledge/claims/717077MCP
get_claim(id=717077)