Expired50% confidenceBenchmarkExact time
When SWE-bench was first released, the pass rate of top models was below 2%; the pass rate of leading systems has now surpassed 50%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/12/2026
First Seen
Valid until: 10/10/2026(expired)
Sources
Grok 4.5 Hands-On: A Faster, Cheaper Coding Dark Horse — Can It Replace Opus and GPT?
youtubeForrestKnight7/10/2026
Related Claims
VerifiedCurrently, the resolution rate of top models on the SWE-bench Verified subset has exceeded 50%.80% similarUnverifiedThe resolution rate of the best-performing systems on the SWE-bench benchmark has risen from less than 5% initially to over 40%.78% similarUnverifiedOn SWE-bench, early models had a solve rate below 5%, while mainstream products in 2025 have surpassed 50%.78% similarUnverified新一代模型在SWE-bench等真实软件工程任务上的通过率首次突破50%大关75% similarUnverified在SWE-bench Full版本上，多数模型的通过率仍低于20%74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/490021API
curl https://kongchang.com/api/v1/knowledge/claims/490021MCP
get_claim(id=490021)