Unverified50% confidenceBenchmarkExact time
Claude Opus 4.6 produced 30 times more errors than GPT-5.4, averaging 2.5 errors per trajectory vs. 0.08, with the difference being statistically significant (p < 0.0001, Cliff's δ = 0.613).
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
9/11/2026
First Seen
Valid until: 12/10/2026
Sources
Related Entities
Related Claims
UnverifiedThe median output token count per problem-solving attempt for Opus 4.7 is 60,000, while GPT 5.5 requires only 16,000.76% similarUnverifiedEarly GPT-4 had a pass rate of only 1.7% on SWE-bench, Claude 3 Opus approximately 4.8%, and it was not until mid-2024 that the 20% mark was surpassed.69% similarUnverifiedClaude Opus 4.8's false reporting rate dropped to 0.00, down from 0.40 for Opus 4.5 and 0.25 for Opus 4.768% similarPartially VerifiedClaude Opus 4.8 scored 69.2% on the SWE-bench benchmark, compared to 58.6% for GPT 5.5 and 54.2% for Google Gemini.68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/907730API
curl https://kongchang.com/api/v1/knowledge/claims/907730MCP
get_claim(id=907730)