Unverified60% confidenceFactExact time

In early 2023, mainstream models' SWE-bench scores were generally below 5%; by mid-2025, top models had surpassed 70%.

2

Sources

60%

Confidence

Long-term

Relevance

7/23/2026

First Seen

Sources

Claude Sonnet 5 Deep Dive: Impressive Benchmarks, Questionable Value — Just Use Opus 4.8?

Related Claims

VerifiedIn 2024, top models achieved a pass rate of approximately 50–70% on SWEbench-Verified.82% similar UnverifiedIn 2024, some models' success rates on SWE-bench rose to the 30%–50% range.75% similar

Cite This Claim

Stable URI

https://kongchang.com/claim/598925

API

curl https://kongchang.com/api/v1/knowledge/claims/598925

MCP

get_claim(id=598925)