Expired65% confidenceFactTime unknown
The solve rate of some AI Agent systems on SWE-bench has already surpassed 50%.
3
Sources
65%
Confidence
Medium-term (~90 days)
Relevance
6/1/2026
First Seen
Valid until: 8/30/2026(expired)
Sources
SWE-bench官方博客上线：AI编程评测标准进入新阶段
twitterSWEbench
Related Entities
Related Claims
UnverifiedCurrently, top AI Agents (such as Devin and SWE-agent) achieve a resolution rate of approximately 40–55% on SWE-bench.80% similarUnverifiedAI Agent同一个任务在不同上下文长度下，单次Token消耗能飘移5到50倍77% similarUnverified研究表明给 AI 提供足够的上下文约束能将输出代码的可用率提升 50% 以上73% similarUnverifiedAccording to Pragmatic Engineer survey data, 55% of code is now generated by AI Agents71% similarVerifiedThe compute consumption of an AI agent workflow can be more than 50 to 100 times that of a single-turn conversation.71% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/26926API
curl https://kongchang.com/api/v1/knowledge/claims/26926MCP
get_claim(id=26926)