Unverified50% confidenceFactExact time
标准化基准（如MMLU、HumanEval、GSM8K）任务边界清晰、上下文适中，与真实工程调试场景存在分布偏移
1
Sources
50%
Confidence
Long-term
Relevance
7/11/2026
First Seen
Sources
Real-World Test: GPT-4.1 mini Solved a Crash Bug That Stumped Every Chinese LLM
bilibili库洛米大人的大人6/25/2026
Related Claims
Unverified主流 LLM 能力评测体系包括 MMLU、HumanEval、GSM8K 等标准化基准73% similarVerifiedMMLU evaluates a model's breadth of knowledge across 57 subject areas, HumanEval measures code generation accuracy, GSM8K tests mathematical reasoning, and HELM constructs a comprehensive multi-dimensional evaluation framework.71% similarUnverifiedStandard AI benchmarks include MMLU (a comprehensive knowledge test covering 57 subjects), GPQA (graduate-level professional question answering), SWE-bench (real-world software engineering tasks), HumanEval and MBPP (programming ability), and MATH and GSM8K (mathematical reasoning)70% similarVerifiedMainstream benchmarks for evaluating programming large models include HumanEval, MBPP, SWE-bench, and LiveCodeBench69% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/486397API
curl https://kongchang.com/api/v1/knowledge/claims/486397MCP
get_claim(id=486397)