Unverified60% confidenceBenchmarkExact time
Standardized code benchmark tests such as HumanEval show that top models have already exceeded a pass@1 score of 90%.
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
7/23/2026
First Seen
Valid until: 10/21/2026
Sources
Related Claims
UnverifiedThe pass rate of top models in 2025 on the HumanEval benchmark has exceeded 90%.80% similarUnverified顶尖大语言模型在HumanEval基准测试上的Pass@1准确率已超过85%77% similarUnverifiedBenchmark overfitting is a core problem in current large model evaluation; some models achieve pass rates above 90% on HumanEval but perform far below expectations in real codebases.73% similarUnverifiedResearch targeting HumanEval indicates that when a model has seen different code implementations of a problem, its pass@1 metric may be overestimated by 10–15%.72% similarUnverifiedWhen multiple models all achieve accuracy rates above 90% on benchmarks such as MMLU and HumanEval, user attention shifts to practical metrics such as inference latency, service availability, and total cost of ownership.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/600429API
curl https://kongchang.com/api/v1/knowledge/claims/600429MCP
get_claim(id=600429)