Unverified50% confidenceFactExact time
Traditional benchmarks such as GLUE, SuperGLUE, and MMLU were scored above human average levels by models within just a few years.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/5/2026
First Seen
Valid until: 12/4/2026
Sources
Related Entities
Related Claims
UnverifiedSince the second half of 2024, the score improvements of mainstream large models on standard benchmarks such as MMLU and HumanEval have narrowed noticeably.75% similarUnverifiedOn professional code benchmarks such as HumanEval, the performance of top models has approached or even surpassed average human-level performance.68% similarUnverifiedMultiple studies in 2023, including experiments by the University of Oxford, found that LLMs equipped with Retrieval-Augmented Generation (RAG) technology achieved Brier scores in structured forecasting competitions approaching the level of human superforecasters66% similarUnverifiedMultiple independent studies in 2023 showed that some top models scored extremely high on standard mathematical reasoning tests but performed significantly worse on equivalent rephrased versions, indicating that the models learned test patterns rather than genuine reasoning ability.65% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/860576API
curl https://kongchang.com/api/v1/knowledge/claims/860576MCP
get_claim(id=860576)