Unverified50% confidenceOpinionExact time
Mainstream evaluation organizations are migrating to private test sets to counter data contamination and targeted optimization, but while this improves resistance to leaderboard gaming, it weakens the space for external oversight.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/28/2026
First Seen
Valid until: 1/26/2027
Sources
Related Entities
Related Claims
VerifiedThere is a gap between benchmark scores and real user experience, and some vendors engage in targeted optimization for specific benchmarks (score gaming) as well as training data contamination that inflates scores.72% similarUnverifiedMainstream platforms generally adopt a vague moderation strategy, for reasons including: avoiding users probing moderation boundaries to evade the rules, reducing the risk of moderators being harassed or retaliated against, and reducing legal self-exposure.71% similarUnverifiedBy incorporating private or semi-private data from real workflows, specialized benchmarks can mitigate benchmark overfitting and test-set contamination to a certain extent.69% similarUnverified真正被业界认可的模型排名必须经得起他人用相同方法复现，厂商内部评测因缺乏透明度易出现测试集污染或挑题展示问题68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1106402API
curl https://kongchang.com/api/v1/knowledge/claims/1106402MCP
get_claim(id=1106402)