Expired50% confidenceBenchmarkExact time
The automatic code repair rate on the SWE-bench software engineering benchmark has risen from less than 5% initially to over 30%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/10/2026
First Seen
Valid until: 10/8/2026(expired)
Sources
Related Claims
UnverifiedSWE-bench requires models to locate and fix bugs in real GitHub repositories, with the pass rate gradually increasing from less than 2% initially to over 20%.72% similarUnverifiedIn the SWE-bench real GitHub Issue fix task, the fix success rates of models from different vendors can differ by 15 to 30 percentage points.71% similarUnverifiedAccording to GitClear's 2024 code quality report, AI-assisted coding caused the code churn rate to increase by 39% year-over-year.70% similarVerifiedSWE-bench (the real GitHub Issue fix rate) is regarded by the industry as the most valuable metric for measuring coding Agent capabilities.68% similarUnverifiedThe SWE-bench benchmark from Princeton University in 2023 showed that the most advanced AI programming tools at the time achieved a success rate of only about 13% on real GitHub issue fix tasks.63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/451101API
curl https://kongchang.com/api/v1/knowledge/claims/451101MCP
get_claim(id=451101)