[KongchangAI]
BenchmarkDeepSuite V1.1

DeepSuite

A comprehensive AI capability evaluation benchmark officially released by DeepSeek, designed to measure the overall performance of models across a variety of task scenarios.

Core Facts

Timeline (last 90 days)

Oct 13

Argon leads on DeepSWE v1.1 with 77.9% versus Opus 5.5's 74.2%; on Terminal-Bench 4.0, Opus 5.5 leads with 66.4% versus 57.4%.

Unverified50%
Oct 13

On the DeepSuite benchmark, Muse Wonder topped the list with 79 points, the smaller version scored 78.8, Fable scored 67, Astra scored 71, and Opus 5.5 scored 74.

Unverified50%
Oct 12

Muse Wonder Full holds a leading position in long-horizon coding benchmarks such as DeepSuite.

Unverified50%
Sep 30

On DeepSuite, GPT-6.1 Sol leads Sonnet 5.5 by approximately 4.2 points, while Sonnet wins on AutomationBench by a margin of 8.7 points.

Unverified50%
Sep 30

In the DeepSWE 1.1 benchmark, GPT-6.1 Sol scored 75.2%, Astra scored 74.8%, Cloud Sonnet 5.5 scored 71.0%, and GPT-6 Sol scored a top of 68.8%.

Unverified50%
Sep 25

On the DeepSuite benchmark, Grok 4.7 scored 71%, GPT 5.6 Sol scored 72.7%, Fable 5.1 scored 70%, and Astra Max topped the leaderboard at 74.1%.

Verified65%
Sep 4

Grok 4.6 scored 65.9 points in the DeepSuite benchmark, ranking third, behind GPT-5.6 Sol Max (73 points) and Fable 5 (70%).

Expired50%
Sep 4

DeepSuite is considered the benchmark most closely resembling a real programming experience because it simulates a complete software engineering task workflow rather than pure code completion.

Unverified50%

All Facts (7)

Source Articles