Unverified50% confidenceBenchmarkExact time
The performance of base LLMs on ARC 1 has to date remained at approximately 10%–15%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/6/2026
First Seen
Valid until: 1/4/2027
Sources
Related Entities
Related Claims
UnverifiedScaling the model size by approximately one hundred thousand times improved the base LLM's score on ARC from only 0% to approximately 10%.68% similarUnverifiedIntel Arc A770M的实测LLM推理吞吐有时仅相当于同级NVIDIA独显的60%~70%63% similarUnverifiedLRMs of comparable or even smaller scale have already saturated the ARC 1 benchmark, achieving accuracy close to 100%.62% similarUnverifiedAt the mention level, the model achieved an overall precision of 74.1% and a recall of 70.5%.57% similarUnverifiedModels' standard accuracy on the passage-level ranking task was only 0% to 13%.57% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/980202API
curl https://kongchang.com/api/v1/knowledge/claims/980202MCP
get_claim(id=980202)