Verified80% confidenceOpinionTime unknown
SWE-bench (the real GitHub Issue fix rate) is regarded by the industry as the most valuable metric for measuring coding Agent capabilities.
6
Sources
80%
Confidence
Long-term
Relevance
5/31/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedSWE-bench requires models to resolve real software defects on GitHub and is the authoritative benchmark for evaluating agent-level programming capabilities.79% similarUnverifiedSWE-bench extracts tasks from real GitHub Issues, requiring models to fix real bugs in mainstream open-source projects, and is regarded as the gold standard for measuring the ability to actually solve engineering problems.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/13831API
curl https://kongchang.com/api/v1/knowledge/claims/13831MCP
get_claim(id=13831)