Verified70% confidenceFactExact time
The HumanEval benchmark contains 164 programming problems and is the mainstream standard for measuring code generation capability.
4
Sources
70%
Confidence
Long-term
Relevance
7/20/2026
First Seen
Sources
Related Claims
VerifiedHumanEval focuses on code generation capability, testing models' logical reasoning and code correctness with 164 programming problems.83% similarUnverified从3万行代码中精准找出有问题的300行，需要人类专家完全理解代码并快速定位，这是人类价值的核心71% similarVerifiedModel evaluations in the code generation field, such as HumanEval and SWE-bench, place special emphasis on functional correctness rather than fluency.70% similarVerifiedHumanEval是由OpenAI于2021年发布的代码生成基准测试，包含164个手写的Python编程问题69% similarUnverifiedHumanEval等传统代码评测基准通常只要求模型根据函数签名和文档字符串生成独立函数，本质上是受限的代码补全任务68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/575607API
curl https://kongchang.com/api/v1/knowledge/claims/575607MCP
get_claim(id=575607)