Terminal-Bench 2.0
A benchmark specifically designed to evaluate the ability of terminal agents to execute tasks in real command-line environments. It covers typical terminal workflows such as file operations, software installation, script writing, and system configuration.
Timeline (last 90 days)
On Terminal-Bench 2.0, Qwen3.5-35B-A3B scores 37.1% with the previous method and 48.3% with EditAct.
ReTerm is built on Qwen3.5-9B, and the resulting ReTerm-9B achieves 34.8% Pass@1 on Terminal-Bench 2.0, an improvement of 14.6 percentage points over the base model.
TomasuLLM achieves a 1.35× speedup on 28 tasks from Terminal-Bench 2.0.
On Terminal-Bench 2.0, one team moved from outside the top 30 into the top 5 solely by changing the Harness without swapping the Model.
All Facts (4)
On Terminal-Bench 2.0, Qwen3.5-35B-A3B scores 37.1% with the previous method and 48.3% with EditAct.
50%UnverifiedReTerm is built on Qwen3.5-9B, and the resulting ReTerm-9B achieves 34.8% Pass@1 on Terminal-Bench 2.0, an improvement of 14.6 percentage points over the base model.
50%UnverifiedTomasuLLM achieves a 1.35× speedup on 28 tasks from Terminal-Bench 2.0.
50%UnverifiedOn Terminal-Bench 2.0, one team moved from outside the top 30 into the top 5 solely by changing the Harness without swapping the Model.
50%