Verified75% confidenceBenchmarkExact time
SWE-bench requires models to locate and fix actual issues in real GitHub repositories.
5
Sources
75%
Confidence
Long-term
Relevance
7/18/2026
First Seen
Sources
Related Claims
VerifiedSWE-bench was developed by a Princeton University team; the Pro version requires models to locate bugs and generate fix patches within real GitHub repositories.84% similarVerifiedSWE-bench requires models to fix issues in real GitHub repositories, while HumanEval/MBPP are function-level code generation benchmarks.80% similarUnverifiedSWE Bench requires models to resolve real issues in actual GitHub repositories, and SWE Bench Pro is a higher-difficulty upgraded version of it.80% similarUnverifiedSWE-bench要求模型修复GitHub上真实Issue，SWE-bench Verified版本于2024年兴起并成为衡量AI Agent编程能力的黄金标准78% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/556488API
curl https://kongchang.com/api/v1/knowledge/claims/556488MCP
get_claim(id=556488)