AutomationBench
An evaluation benchmark designed to assess the ability of AI agents to execute automation tasks, measuring model performance across automated workflow scenarios.
Core Facts
Timeline (last 90 days)
GLM-5.3-Flash 在 AutomationBench 上得48.8分，领先 Claude Opus 4.8 的41.0分和 GPT-5.6 Terra 的37.2分，单任务成本约0.045美元。
Mistral Large 4 在 AutomationBench（657 个业务流程）上得分 59.9%，在 AA-Briefcase 上获得 1393 Elo。
OpenAI claims that GPT-6.1 Sol leads its predecessor by 4.8 points on the AutomationBench automated testing benchmark and scores 2.2 points higher than Anthropic's Opus 5.5.
On DeepSuite, GPT-6.1 Sol leads Sonnet 5.5 by approximately 4.2 points, while Sonnet wins on AutomationBench by a margin of 8.7 points.
Argon ranked first on Zapier's AutomationBench with a score of 51.3%.
The per-task cost of GPT-6 Sol High on Automation Bench is only one-tenth that of Opus 5.
V4.1 Flash took first place on the DeepSWE, CyberDream, and AutomationBench agent benchmarks.
All Facts (7)
The per-task cost of GPT-6 Sol High on Automation Bench is only one-tenth that of Opus 5.
65%UnverifiedGLM-5.3-Flash 在 AutomationBench 上得48.8分，领先 Claude Opus 4.8 的41.0分和 GPT-5.6 Terra 的37.2分，单任务成本约0.045美元。
50%UnverifiedMistral Large 4 在 AutomationBench（657 个业务流程）上得分 59.9%，在 AA-Briefcase 上获得 1393 Elo。
50%UnverifiedOpenAI claims that GPT-6.1 Sol leads its predecessor by 4.8 points on the AutomationBench automated testing benchmark and scores 2.2 points higher than Anthropic's Opus 5.5.
50%UnverifiedOn DeepSuite, GPT-6.1 Sol leads Sonnet 5.5 by approximately 4.2 points, while Sonnet wins on AutomationBench by a margin of 8.7 points.
50%UnverifiedArgon ranked first on Zapier's AutomationBench with a score of 51.3%.
50%UnverifiedV4.1 Flash took first place on the DeepSWE, CyberDream, and AutomationBench agent benchmarks.
50%