Verified90% confidenceFactTime unknown
SWE-bench directly extracts issues and corresponding pull requests from real GitHub open-source projects, requiring AI systems to understand problem descriptions, locate code defects, and generate correct fix patches
6
Sources
90%
Confidence
Long-term
Relevance
6/1/2026
First Seen
Sources
SWE-bench官方博客上线：AI编程评测标准进入新阶段
twitterSWEbench
Related Entities
Related Claims
UnverifiedSWE-bench extracts tasks from real GitHub Issues, requiring models to fix real bugs in mainstream open-source projects, and is regarded as the gold standard for measuring the ability to actually solve engineering problems.84% similarUnverifiedSWE-bench extracts real GitHub Issues from mainstream Python open-source projects and requires models to generate code patches that can pass official test suites.80% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/26919API
curl https://kongchang.com/api/v1/knowledge/claims/26919MCP
get_claim(id=26919)