Unverified50% confidenceBenchmarkExact time
根据SWE-RPG基准论文数据,当前顶级编程代理在真实GitHub问题上的平均解决率仅为31.5%
1
Sources
50%
Confidence
Long-term
Relevance
8/24/2026
First Seen
Sources
Related Entities
Related Claims
UnverifiedMultiple evaluations targeting SWE-bench in 2024 showed that state-of-the-art AI agents achieved a resolution rate of only 20%–50% on real GitHub Issues.77% similarUnverifiedSWE-bench requires models to resolve real GitHub issues, and the pass rate does not exceed 50% even for the strongest models.75% similarUnverifiedIn the SWE-bench real GitHub Issue fix task, the fix success rates of models from different vendors can differ by 15 to 30 percentage points.74% similarUnverifiedGitHub 在 Copilot 报告中披露开发者平均接受率约为 30%–40%74% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/794278API
curl https://kongchang.com/api/v1/knowledge/claims/794278MCP
get_claim(id=794278)