Expired60% confidenceBenchmarkExact time
On SWE-bench, early models had a solve rate below 5%, while mainstream products in 2025 have surpassed 50%.
2
Sources
60%
Confidence
Medium-term (~90 days)
Relevance
7/11/2026
First Seen
Valid until: 10/9/2026(expired)
Sources
A Deep Dive into Cloud Coding Agents: How Users in China Can Choose Wisely
bilibili小行星AI观测站7/9/2026
Related Claims
UnverifiedIn early 2023, mainstream models' SWE-bench scores were generally below 5%; by mid-2025, top models had surpassed 70%.80% similarUnverifiedSWE-bench is a benchmark measuring models' ability to autonomously fix real GitHub Issues; early models had a resolution rate below 5%, and by 2025 mainstream products have surpassed 50%.78% similarUnverifiedWhen SWE-bench was first released, the pass rate of top models was below 2%; the pass rate of leading systems has now surpassed 50%.78% similarUnverifiedIn 2024, some models' success rates on SWE-bench rose to the 30%–50% range.73% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/482795API
curl https://kongchang.com/api/v1/knowledge/claims/482795MCP
get_claim(id=482795)