Unverified50% confidenceBenchmarkExact time
Approximately 23% of papers could not be fully reproduced as claimed, and at least 496 papers had at least one claim that was falsified or disputed.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
8/12/2026
First Seen
Valid until: 11/10/2026
Sources
AI智能体复现ICML 2026论文：34%被验证，23%存在问题
Related Claims
UnverifiedAmong the approximately 2,000 papers examined, more than 1,100 had at least one key claim independently verified, of which 266 were fully reproduced, 632 were partially reproduced through small-scale experiments, and approximately 4,000 individual claims were confirmed.65% similarUnverifiedResearch shows that approximately 15–25% of papers experience score changes after rebuttal, with positive changes slightly outnumbering negative ones61% similarUnverified机器学习领域约有30%-50%的论文没有公开可用的代码61% similarUnverified美国政府问责局（GAO）2021年报告指出，超过40%的已记录违规情况在后续审查中未获跟进处理59% similarUnverifiedA survey at ACL 2023 showed that approximately 30% of datasets claimed to be publicly available in NLP papers became inaccessible two years after publication.59% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/737192API
curl https://kongchang.com/api/v1/knowledge/claims/737192MCP
get_claim(id=737192)