Unverified60% confidenceFactTime unknown
SWE-bench (Software Engineering Benchmark) is currently the core benchmark for measuring agent coding capability, requiring the model to start from real GitHub Issues, autonomously locate problems in the codebase, and submit fix patches.
2
Sources
60%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedSWE-bench requires models to resolve real software defects on GitHub and is the authoritative benchmark for evaluating agent-level programming capabilities.79% similarVerifiedSWE-bench directly extracts issues and corresponding pull requests from real GitHub open-source projects, requiring AI systems to understand problem descriptions, locate code defects, and generate correct fix patches77% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/24179API
curl https://kongchang.com/api/v1/knowledge/claims/24179MCP
get_claim(id=24179)