Unverified50% confidenceBenchmarkExact time
Devin achieved a resolution rate of 13.86% on the SWE-bench evaluation (the highest at the time).
1
Sources
50%
Confidence
Long-term
Relevance
8/9/2026
First Seen
Sources
Coldtea.ai：AI代理驱动的软件交付自动化平台深度解析
Related Claims
VerifiedDevin resolved 13.86% of real GitHub Issues in the SWE-bench test, surpassing the performance of Claude 2.71% similarUnverified在SWE-bench最初公开结果中GPT-4的解决率仅约1.7%，Devin宣称达到13.86%，SWE-agent达到12.5%66% similarUnverifiedClaude achieved a task completion rate of 14.9% on the OSWorld benchmark, representing the highest level at the time.65% similarUnverifiedTongyi Qianwen 3.6 scored 78.8 on the SWE-Bench test, compared to Claude Opus's score of 80.9.61% similarUnverifiedOn the DeepSWE benchmark, GPT-5.6 scored 45 at Low, 61 at Medium, 69 at High, 71 at X-High, and 73 at Max across reasoning tiers.58% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/714451API
curl https://kongchang.com/api/v1/knowledge/claims/714451MCP
get_claim(id=714451)