Unverified50% confidenceOpinionExact time
On a benchmark that is sensitive to prompt wording, leaderboard rankings may more often reflect how well each model happens to match the evaluator's preferences rather than true capability.
1
Sources
50%
Confidence
Long-term
Relevance
10/6/2026
First Seen
Sources
Related Entities
Related Claims
Unverified人类标注者在评估答案时存在信息越丰富越好的认知偏差，导致奖励模型将篇幅与质量隐性挂钩，是模型冗余的成因之一77% similarUnverifiedEvaluations tailored to one's own use case often reflect the actual value of a model to users better than general leaderboards.76% similarUnverifiedMulti-agent feedback is not equivalent to real user testing, and human oversight is still required for highly contextual judgment scenarios such as brand tone and cultural sensitivity.75% similarUnverifiedBecause human raters prefer text that is confident in tone and clear in structure, models are reinforced through iteration toward sounding authoritative rather than simply being more accurate74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/979864API
curl https://kongchang.com/api/v1/knowledge/claims/979864MCP
get_claim(id=979864)