Expired80% confidenceFactTime unknown
Currently, the resolution rate of top models on the SWE-bench Verified subset has exceeded 50%.
7
Sources
80%
Confidence
Medium-term (~90 days)
Relevance
5/31/2026
First Seen
Valid until: 8/29/2026(expired)
Sources
Related Entities
Related Claims
Unverified新一代模型在SWE-bench等真实软件工程任务上的通过率首次突破50%大关81% similarUnverifiedWhen SWE-bench was first released, the pass rate of top models was below 2%; the pass rate of leading systems has now surpassed 50%.80% similarUnverifiedEven the strongest models on SWE-Bench can only solve approximately 50% of the problems.77% similarUnverifiedOn SWE-bench, early models had a solve rate below 5%, while mainstream products in 2025 have surpassed 50%.77% similarVerifiedIn 2024, top models achieved a pass rate of approximately 50–70% on SWEbench-Verified.76% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/8524API
curl https://kongchang.com/api/v1/knowledge/claims/8524MCP
get_claim(id=8524)