Unverified50% confidenceBenchmarkExact time
Larger, newer models do not necessarily perform better: gpt-oss-120b (0.740) scored lower than gpt-oss-20b (0.761); DeepSeek-R1, costing $1.94, scored lower than Gemma 4 31B, which cost only 13 cents.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/11/2026
First Seen
Valid until: 1/9/2027
Sources
Related Entities
Related Claims
UnverifiedSWE-2's benchmark score differs from that of competitor Fable 5.1 by less than one percentage point, but its cost is 64% lower.70% similarUnverifiedgpt-oss-120b scored 0.991 on memory read but only 0.740 on write, ranking last in write; DeepSeek-R1 scored 0.997 on read and 0.863 on write.68% similarUnverifiedCompared to GPT-6 Astra, SWE-2's score trails by a few percentage points, but its cost is only one-quarter of the latter's.66% similarUnverifiedThe best-performing Edu-QuRater achieved an average accuracy of 0.917 in reproducing GPT-4.1-mini pairwise judgments on the held-out set.64% similarUnverifiedTEMPEST outperforms the best classical model by 17.9 percentage points and the strongest triplet-loss baseline by 58.4 percentage points.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/997254API
curl https://kongchang.com/api/v1/knowledge/claims/997254MCP
get_claim(id=997254)