Unverified60% confidenceBenchmarkExact time

In 2024, some models' success rates on SWE-bench rose to the 30%–50% range.

2

Sources

60%

Confidence

Long-term

Relevance

7/22/2026

First Seen

Sources

Codex in Practice: AI-Powered Programming with Natural Language Instructions — No Coding Background Required

Related Claims

VerifiedIn 2024, top models achieved a pass rate of approximately 50–70% on SWEbench-Verified.76% similar UnverifiedIn early 2023, mainstream models' SWE-bench scores were generally below 5%; by mid-2025, top models had surpassed 70%.75% similar

Cite This Claim

Stable URI

https://kongchang.com/claim/594050

API

curl https://kongchang.com/api/v1/knowledge/claims/594050

MCP

get_claim(id=594050)