Unverified50% confidenceFactExact time
基准饱和是指当顶尖模型在某基准上的得分逼近或超越人类水平时，该基准失去区分度，无法有效衡量模型之间的真实差距
1
Sources
50%
Confidence
Long-term
Relevance
7/8/2026
First Seen
Sources
基准测试即数据激活：让领域数据找到攀登方向
hackernewshackernews7/3/2026
Related Claims
UnverifiedGoodhart's Law states that when a quality metric becomes an optimization target, it is no longer a good measure of quality, as the model may learn to game the score rather than genuinely improve.72% similarVerified古德哈特定律描述：当一个度量指标变成目标时，它就不再是好的度量指标了71% similarUnverifiedGoodhart's Law states that when a metric becomes a target in itself it is no longer a good metric, and introducing test sets into training data causes a model's exam scores to decouple from its true capabilities68% similarVerified跑分榜单衡量的是模型考试能力而非解决真实问题的能力67% similarUnverifiedThe core dilemma of the alignment problem is the 'value specification problem,' whereby humanity's vague, context-dependent, and even contradictory values are difficult to encode precisely as machine-optimizable objective functions.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/223338API
curl https://kongchang.com/api/v1/knowledge/claims/223338MCP
get_claim(id=223338)