Unverified50% confidenceFactExact time
SWE-bench_Verified is a subset of 500 high-quality GitHub issues manually selected from the original SWE-bench, excluding samples with unclear descriptions or unreliable tests; SWE-bench_Pro, by contrast, targets more complex multi-file, long-chain engineering tasks and is noticeably harder.
1
Sources
50%
Confidence
Long-term
Relevance
10/19/2026
First Seen
Sources
Related Entities
Related Claims
VerifiedSWE-bench Verified selects bug reports with clear solutions from GitHub Issues of real open-source projects, where the "Verified" suffix indicates that the problems have been manually validated.79% similarVerifiedSWE-bench Verified was developed by a Princeton University research team and draws issues requiring fixes from real GitHub repositories.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/1069863API
curl https://kongchang.com/api/v1/knowledge/claims/1069863MCP
get_claim(id=1069863)