Verified80% confidenceFactExact time
MMLU (Massive Multitask Language Understanding) contains multiple-choice questions across 57 subjects and is used to test the breadth of a model's knowledge.
4
Sources
80%
Confidence
Long-term
Relevance
9/11/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedMMLU的生物医学部分主要来源于教材和标准化考试题库，主要考察概念性知识记忆而非数据分析推理能力71% similarUnverifiedMMLU was once the gold standard for measuring the knowledge level of large language models, and was an almost mandatory metric in every model release report in the era when ChatGPT first appeared.70% similarUnverifiedCommonly used community benchmarks for evaluating quantization include MMLU, HumanEval, and GSM8K, and perplexity is a general metric for measuring the fluency of language models.61% similarUnverifiedWhen handling long contexts, multi-turn dialogues, and complex reasoning chains in inference scenarios, models need to frequently read and write large amounts of intermediate states (such as KV Cache), placing extremely high demands on memory capacity and bandwidth.61% similarVerifiedThe context window of a large language model determines the upper limit of information the model can process in a single inference.60% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/895389API
curl https://kongchang.com/api/v1/knowledge/claims/895389MCP
get_claim(id=895389)