Expired50% confidenceBenchmarkExact time
SWE-bench is a benchmark measuring models' ability to autonomously fix real GitHub Issues; early models had a resolution rate below 5%, and by 2025 mainstream products have surpassed 50%.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
7/11/2026
First Seen
Valid until: 10/9/2026(expired)
Sources
A Deep Dive into Cloud Coding Agents: How Users in China Can Choose Wisely
bilibili小行星AI观测站7/9/2026
Related Claims
UnverifiedOn SWE-bench, early models had a solve rate below 5%, while mainstream products in 2025 have surpassed 50%.78% similarUnverified新一代模型在SWE-bench等真实软件工程任务上的通过率首次突破50%大关71% similarUnverifiedWhen SWE-bench was first released, the pass rate of top models was below 2%; the pass rate of leading systems has now surpassed 50%.71% similarVerifiedCurrently, the resolution rate of top models on the SWE-bench Verified subset has exceeded 50%.71% similarUnverifiedThe resolution rate of the best-performing systems on the SWE-bench benchmark has risen from less than 5% initially to over 40%.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/474396API
curl https://kongchang.com/api/v1/knowledge/claims/474396MCP
get_claim(id=474396)