Expired70% confidenceBenchmarkExact time
In 2024, models such as Claude 3.5 Sonnet have already exceeded 50% on the SWE-bench Verified subset.
4
Sources
70%
Confidence
Medium-term (~90 days)
Relevance
7/12/2026
First Seen
Valid until: 10/10/2026(expired)
Sources
GPT-5.6 Sol in Action: A 3D Interactive London Website Generated in 5 Minutes
redditr/OpenAI7/11/2026
Related Claims
VerifiedClaude 3.5 Sonnet surpassed a 49% solve rate on the SWE-bench software engineering benchmark.75% similarUnverified2024-2025年间，Claude 3.5 Sonnet、GPT-4o、Gemini 2.0等模型在HumanEval、SWE-bench等编程基准测试的通过率从不足50%提升至90%以上75% similarUnverifiedClaude 3.5 Sonnet在HumanEval基准测试上的得分超过90%，而2021年最初的Codex模型得分仅为28.8%71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/491982API
curl https://kongchang.com/api/v1/knowledge/claims/491982MCP
get_claim(id=491982)