[KongchangAI]
BenchmarkTerminal-Bench / Terminal-Bench 2.1

Terminal Bench 2.0

Terminal Bench 2.0 is a benchmark framework for evaluating AI models' programming and operational capabilities in terminal environments, representing the second major version iteration. The benchmark designs tasks involving command-line operations, script writing, and system interaction to measure models' code generation, debugging, and execution abilities in real terminal scenarios, providing a standardized basis for cross-system performance comparison.

Timeline (last 90 days)

Sep 15

The same DeepSeek v1.1 model scored between 69.8% and 74.2% on Terminal Bench 2.0 under different harnesses.

Unverified50%

All Facts (1)

Source Articles