Unverified80% confidenceFactTime unknown
在PlanBench的神秘方块世界测试中，2023年的模型几乎完全失败，但O1等推理模型的出现带来了显著改善
1
Sources
80%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
李宏毅2026课程笔记：AI Agent三大核心能力深度解析
bilibili李宏毅agent
Related Entities
Related Claims
UnverifiedMultiple independent studies in 2023 showed that some top models scored extremely high on standard mathematical reasoning tests but performed significantly worse on equivalent rephrased versions, indicating that the models learned test patterns rather than genuine reasoning ability.69% similarUnverified2024 年初最先进的模型在 OS World Verified 测试上通常连 20% 都拿不到65% similarUnverifiedWei等人在2022年系统记录了大模型涌现能力现象，发现某些能力在小模型上几乎为零而在大模型上急剧提升，呈现非连续的相变特征64% similarUnverifiedMeituan's technical team has released the General 365 inference evaluation benchmark, testing 26 mainstream large models, with the majority failing to reach the passing score of 60.63% similarUnverifiedOpenAI's chart shows that at lower test-time compute levels, the model's success rate on this problem is close to zero, with occasional success only under extremely long reasoning chains.61% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/26237API
curl https://kongchang.com/api/v1/knowledge/claims/26237MCP
get_claim(id=26237)