Verified80% confidenceFactExact time
MMLU covers over 57,000 multiple-choice questions across 57 subject areas, while HumanEval focuses on function-level correctness verification for code generation.
4
Sources
80%
Confidence
Long-term
Relevance
7/12/2026
First Seen
Sources
Related Claims
VerifiedMMLU evaluates a model's breadth of knowledge across 57 subject areas, HumanEval measures code generation accuracy, GSM8K tests mathematical reasoning, and HELM constructs a comprehensive multi-dimensional evaluation framework.80% similarUnverifiedMMLU (Massive Multitask Language Understanding) and HumanEval are representative general benchmarks, used for commonsense reasoning and code generation evaluation respectively.76% similarVerifiedStandard AI benchmarks include MMLU (a comprehensive knowledge test covering 57 subjects), GPQA (graduate-level professional question answering), SWE-bench (real-world software engineering tasks), HumanEval and MBPP (programming ability), and MATH and GSM8K (mathematical reasoning)74% similarVerifiedMMLU, HumanEval, and MT-Bench are standardized benchmark test sets widely recognized by the AI community.70% similarUnverified标准化基准(如MMLU、HumanEval、GSM8K)任务边界清晰、上下文适中,与真实工程调试场景存在分布偏移66% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/491952API
curl https://kongchang.com/api/v1/knowledge/claims/491952MCP
get_claim(id=491952)