Verified80% confidenceFactTime unknown
Pass rates of code generation models on benchmarks such as HumanEval jumped from 60% to over 90% between 2024 and 2025
6
Sources
80%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Vibe Coding与Agentic Engineering边界模糊：Simon Willison的深度反思
rss
Related Entities
Related Claims
UnverifiedThe pass rate of top models in 2025 on the HumanEval benchmark has exceeded 90%.76% similarUnverified斯坦福HAI研究所2023年报告显示，最新LLM在HumanEval等代码基准测试中正确率已超过85%，远超2021年的不足50%74% similarUnverified自2023年GPT-4发布以来，AI在HumanEval等主流编程基准测试上的通过率从不足50%跃升至90%以上74% similarUnverified在HumanEval等专业代码基准测试中，顶尖模型的表现已接近甚至超越人类平均水平69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/32594API
curl https://kongchang.com/api/v1/knowledge/claims/32594MCP
get_claim(id=32594)