Verified90% confidenceFactExact time
MMLU (Massive Multitask Language Understanding) covers multiple-choice questions across 57 subjects, testing the breadth and depth of a model's knowledge from humanities and social sciences to STEM.
10
Sources
90%
Confidence
Long-term
Relevance
8/31/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedMMLU contains approximately 15,000 multiple-choice questions across 57 subjects, covering knowledge from high school to graduate level78% similarUnverifiedMMLU covers 57 subjects and nearly 16,000 multiple-choice questions; HumanEval was developed by OpenAI and contains 164 programming problems; GSM8K contains 8,500 elementary school math word problems.73% similarUnverifiedMMLU和HellaSwag等早期基准主要考察模型的知识储备与语言理解能力71% similarUnverifiedMMLU was proposed in 2020 by Dan Hendrycks and others at the University of California, Berkeley, covering 57 subject areas and approximately 15,000 multiple-choice questions.64% similarUnverifiedML理论知识通常以斯坦福CS229、Andrew Ng的Machine Learning专项课程为参考体系61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/832330API
curl https://kongchang.com/api/v1/knowledge/claims/832330MCP
get_claim(id=832330)