Unverified50% confidenceFactExact time
The HumanEval series focuses on tracking code capabilities, while BIG-Bench is an academic evaluation project.
1
Sources
50%
Confidence
Long-term
Relevance
9/21/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedHumanEval、SWE-bench等代码评测基准的排名是评估执行型Agent底层模型选型的重要参考维度72% similarUnverifiedHumanEval, MBPP, and SWE-bench are standard benchmark datasets specifically targeting code generation.71% similarVerifiedMainstream benchmarks for evaluating programming large models include HumanEval, MBPP, SWE-bench, and LiveCodeBench70% similarUnverified业界普遍依赖 HumanEval、SWE-bench 等基准测试评估LLM编程能力70% similarVerifiedHumanEval, MBPP, and SWE-bench are industry-standard benchmarks in the field of AI programming evaluation.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/939557API
curl https://kongchang.com/api/v1/knowledge/claims/939557MCP
get_claim(id=939557)