Unverified50% confidenceBenchmarkExact time
In the comparison table officially released by Qwen, Gemma 4 26b only fixed 17.4% of real GitHub issues on SWE-Bench Verified.
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
10/10/2026
First Seen
Valid until: 1/8/2027
Sources
Related Entities
Related Claims
UnverifiedSWE-bench Verified selects bug reports with clear solutions from GitHub Issues of real open-source projects, where the "Verified" suffix indicates that the problems have been manually validated.66% similarUnverifiedMuse continuously monitors Sentry's crash reports, and upon detecting a new error, locates the issue in the GitHub repository and drafts a fix proposal.65% similarUnverified根据SWE-RPG基准论文数据，当前顶级编程代理在真实GitHub问题上的平均解决率仅为31.5%63% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/994067API
curl https://kongchang.com/api/v1/knowledge/claims/994067MCP
get_claim(id=994067)