Expired50% confidenceFactExact time
The gap in resolution rate on SWE-Bench Verified between Claude Sonnet 4.6 and GPT-5.1 Codex is only 3.3 percentage points.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/2/2026
First Seen
Valid until: 9/30/2026(expired)
Sources
Related Claims
UnverifiedIn SWE-bench testing, the early GPT-4 resolution rate was below 2%, while Claude 3.5 Sonnet broke through 49%.83% similarUnverifiedClaude 3.5 Sonnet surpassed a 49% solve rate on the SWE-bench software engineering benchmark.74% similarVerifiedClaude Sonnet 5 scores 63.22% on SWE-bench Verified (Agentic Coding), approximately 6 percentage points behind Opus 4.8.73% similarUnverifiedClaude Sonnet 4.5 scored 77.2 on SWE-Bench.73% similarUnverifiedClaude 3.5 Sonnet在HumanEval基准测试上的得分超过90%，而2021年最初的Codex模型得分仅为28.8%71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/48554API
curl https://kongchang.com/api/v1/knowledge/claims/48554MCP
get_claim(id=48554)