Unverified50% confidenceFactExact time
The HumanEval test set contains only 164 Python programming problems and tests only function-level code completion.
1
Sources
50%
Confidence
Long-term
Relevance
9/10/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedHumanEval由164道Python编程题组成69% similarVerifiedHumanEval was released by OpenAI and contains 164 hand-crafted Python programming problems, with pass@k as its core metric.62% similarUnverifiedThe MBPP code generation benchmark contains approximately 500 Python programming problems targeting entry-level programmers.57% similarUnverifiedPython has become the preferred programming language for test development due to its concise syntax and rich testing ecosystem.57% similarUnverified测试 Python 的 alpha/beta/rc 预发布版本时，官方预编译包往往不可用，源码编译是唯一选择56% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/888678API
curl https://kongchang.com/api/v1/knowledge/claims/888678MCP
get_claim(id=888678)