Unverified50% confidenceFactExact time
Matching BenchLM's top ten open-weight rows against Artificial Analysis by model name, nine models corresponded successfully (dots3-note Preview is missing from the latter's data); ranking these nine models separately gives a Kendall's tau of 0.61, with 29 concordant pairs and 7 discordant pairs.
1
Sources
50%
Confidence
Short-term (~14 days)
Relevance
10/19/2026
First Seen
Valid until: 11/2/2026
Sources
Related Entities
Related Claims
UnverifiedAmong the top nine models in BenchLM's open-weight ranking, all models' conditional intervals overlap each other, with none of the 36 pairs as an exception; after adding the tenth row, all 45 pairs also overlap.69% similarUnverifiedThe generator LLM, probe model, and prompt verbosity together contribute less than 10% of the variance.69% similarUnverifiedWhen the open-source small model gemma2:2b was used as the checker, it accepted 8 of the 28 wrong answers (6 wrong party and 2 wrong action), while rejecting 10 of the 14 correct answers.68% similarUnverifiedGraphite counted 12,877 distinct tics across nine models, of which 65% appear in only a single model series.68% similarUnverifiedAcross all 12 paired experiments consisting of four datasets and three models, tree traversal lost to zero-shot prompting without exception.67% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1069253API
curl https://kongchang.com/api/v1/knowledge/claims/1069253MCP
get_claim(id=1069253)