Verified90% confidenceFactExact time
MMLU evaluates a model's breadth of knowledge across 57 subject areas, HumanEval measures code generation accuracy, GSM8K tests mathematical reasoning, and HELM constructs a comprehensive multi-dimensional evaluation framework.
7
Sources
90%
Confidence
Long-term
Relevance
7/15/2026
First Seen
Sources
Gemini集成Google Docs：付费争议、功能短板与信任危机
Related Claims
VerifiedMMLU covers over 57,000 multiple-choice questions across 57 subject areas, while HumanEval focuses on function-level correctness verification for code generation.80% similarUnverifiedMMLU (Massive Multitask Language Understanding) and HumanEval are representative general benchmarks, used for commonsense reasoning and code generation evaluation respectively.79% similarVerifiedMainstream large model evaluation benchmarks include MMLU, HumanEval/SWE-bench, MATH, and GPQA79% similarVerifiedAI model benchmarking typically evaluates a model's reasoning, coding, and mathematical capabilities on standard datasets such as MMLU, HumanEval, and GSM8K.78% similarUnverifiedMainstream benchmarks such as MMLU, HumanEval, and GSM8K were originally designed primarily for academic comparison, focusing on measuring model accuracy on closed-form questions.78% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/515969API
curl https://kongchang.com/api/v1/knowledge/claims/515969MCP
get_claim(id=515969)