Unverified50% confidenceFactExact time
The researchers tested nine frontier (multimodal) large language models, and the strongest system scored only 52.12 on a 100-point scale.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/20/2026
First Seen
Valid until: 1/18/2027
Sources
Related Entities
Related Claims
UnverifiedIn a test covering 8 local models and more than 5000 calls, the wording style of the prompt (plain/normal/florid) had almost no effect on accuracy on non-math tasks, with differences of no more than 4 percentage points for models of 8B and above.74% similarUnverifiedThe user pointed out that these models achieve high scores on benchmarks yet frequently fail at the simplest tasks.72% similarUnverified参数量仅10亿至70亿的小语言模型在特定任务上可以逼近参数量百倍于它的大模型70% similarUnverifiedFor structured tasks such as code completion and syntax checking, small models with 7B–13B parameters can achieve over 90% accuracy, with inference costs as low as 1/50 or less of those of top-tier models.68% similarUnverifiedAn evaluation suite with 1,800 test cases has long maintained a stable aggregate pass rate of 97%, but the 64-case multilingual slice within it has a pass rate of only 61%68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1073311API
curl https://kongchang.com/api/v1/knowledge/claims/1073311MCP
get_claim(id=1073311)