Unverified50% confidenceOpinionExact time
When the entire industry uses a handful of public leaderboards as the measuring standard, labs have an incentive to make their models look good on those leaderboards.
1
Sources
50%
Confidence
Long-term
Relevance
9/12/2026
First Seen
Sources
Related Claims
Unverified真正被业界认可的模型排名必须经得起他人用相同方法复现，厂商内部评测因缺乏透明度易出现测试集污染或挑题展示问题72% similarUnverifiedWhen evaluators know that a model comes from a well-known institution such as OpenAI, Google, or Anthropic, they tend to interpret its output with higher expectations and more lenient standards.68% similarUnverifiedWhen faced with performance claims published by platform vendors, the pragmatic approach is to conduct small-scale validation in real business scenarios before deciding whether to scale up investment.68% similarUnverifiedResearch by Harvard Business School professor Michael Norton shows that simple assembly actions can significantly increase people's valuation of objects, known as the IKEA effect.65% similarUnverifiedTop-tier models have approached the level of human judges on many evaluation tasks, but exhibit biases such as a tendency to give higher scores to longer responses65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/914264API
curl https://kongchang.com/api/v1/knowledge/claims/914264MCP
get_claim(id=914264)