Unverified50% confidenceFactExact time
MMLU-Pro was introduced by TIGER-Lab in 2024, changing the four-choice format to ten-choice, with about 12,000 reasoning-intensive questions in total, and is one of the knowledge benchmarks commonly cited for current open-source models.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedMMLU was released by the University of California, Berkeley in 2020 and contains approximately 15,000 multiple-choice questions spanning 57 subjects.73% similarUnverifiedMMLU于2021年由Dan Hendrycks等人发布，涵盖57个学科共14,000余道题目70% similarUnverifiedMMLU于2021年由Hendrycks等人提出，题目来源于真实人类专业考试，覆盖57个学科领域68% similarUnverifiedMMLU由Dan Hendrycks等人于2020年提出，覆盖57个学科，测试模型在零样本和少样本条件下的泛化能力68% similarUnverifiedMMLU was introduced in 2021 by UC Berkeley and other institutions as a large-scale multitask language understanding benchmark67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1067100API
curl https://kongchang.com/api/v1/knowledge/claims/1067100MCP
get_claim(id=1067100)