Unverified50% confidenceFactExact time
2024 年初顶尖智能体在 SWE-bench 的通过率不到 30%，到 2025 年中已有多个系统突破 90%
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
8/17/2026
First Seen
Valid until: 11/15/2026
Sources
Related Claims
UnverifiedThe AI pass rate on SWE-bench Verified was below 40% one year ago and had exceeded 72% as of mid-2025.76% similarUnverifiedIn early 2023, mainstream models' SWE-bench scores were generally below 5%; by mid-2025, top models had surpassed 70%.74% similarVerifiedIn 2024, top models achieved a pass rate of approximately 50–70% on SWEbench-Verified.72% similarUnverifiedThe solve rate of top models on SWE-bench jumped from under 5% in 2023 to over 30% in 2025.70% similarUnverifiedIn 2024, some models' success rates on SWE-bench rose to the 30%–50% range.70% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/761981API
curl https://kongchang.com/api/v1/knowledge/claims/761981MCP
get_claim(id=761981)