Unverified50% confidenceFactExact time
The inherent flaw of proxy metrics is that once optimization targets the metric itself, its correlation with the true variable weakens.
1
Sources
50%
Confidence
Long-term
Relevance
9/27/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedManual evaluation is close to the user's actual experience, but has two shortcomings: instability (subjectivity) and low efficiency.75% similarUnverifiedThe false negative problem systematically underestimates retrieval quality, rendering comparisons between different methods meaningless.73% similarUnverifiedThe behavioral predictability of self-modifying agents will decrease significantly; a single erroneous self-modification may cause the agent to deviate from its intended goals or enter an unrecoverable failure state.72% similarUnverifiedOptimizing for benchmarks carries risks, as high scores may only reflect a model's adaptation to specific question types rather than a genuine improvement in general capabilities.71% similarUnverifiedThe validity of surrogate indicators rests on a causal relationship between outputs and competence and on scarcity—producing the output itself requires genuine competence as a prerequisite.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/953451API
curl https://kongchang.com/api/v1/knowledge/claims/953451MCP
get_claim(id=953451)