Unverified50% confidenceBenchmarkExact time
斯坦福大学HAI研究所2024年度AI指数报告显示，顶级闭源模型在MMLU基准上的最高分与第五名之间的差距，已从2022年的约8个百分点收窄至不足2个百分点
1
Sources
50%
Confidence
Long-term
Relevance
7/21/2026
First Seen
Sources
Related Claims
UnverifiedOn mainstream evaluations such as MMLU, HumanEval, and GSM8K, the score gaps among leading large models are often only a few percentage points.72% similarUnverifiedStanford University's 2023 "Lost in the Middle" study (Liu et al.) showed that when key information is located in the middle section of the context, the model's retrieval accuracy drops approximately 20–30 percentage points compared to the head and tail, and this is especially significant when the context exceeds 32K tokens.71% similarUnverifiedScale AI在2024年的分析显示，部分模型在MMLU上的分数膨胀可能高达5-10个百分点，因测试集已泄露到训练数据中70% similarUnverifiedSince the second half of 2024, the score improvements of mainstream large models on standard benchmarks such as MMLU and HumanEval have narrowed noticeably.70% similarUnverifiedA 2023 Stanford University study found that even the most advanced models at the time experienced a 30% to 50% drop in information-retrieval accuracy for middle segments when processing contexts exceeding 32K tokens.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/584919API
curl https://kongchang.com/api/v1/knowledge/claims/584919MCP
get_claim(id=584919)