Benchmark profile
AutomationBench
An agent benchmark for completing automation workflows in reproducible task environments.
Data verifiedBenchmark score on AutomationBench — July 23, 2026
BenchLM mirrors the published score view for AutomationBench. Kimi K3 leads the public snapshot at 30.8%. BenchLM does not use these results to rank models overall.
Benchmark score table (1 model)
ScoreAbout AutomationBench
Year
2026
Tasks
600 public automation tasks
Format
Agent task-completion score
Difficulty
Long-horizon automation
Moonshot evaluates the 600-task public subset while following the official GitHub setup. BenchLM stores this provider-run result separately from Artificial Analysis AutomationBench-AA.
BenchLM freshness & provenance
Version
AutomationBench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does AutomationBench measure?
An agent benchmark for completing automation workflows in reproducible task environments.
Which model scores highest on AutomationBench?
Kimi K3 by Moonshot AI currently leads with a score of 30.8% on AutomationBench.
How many models are evaluated on AutomationBench?
1 AI models have been evaluated on AutomationBench on BenchLM.
Choose a model with this week’s evidence
Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.
One email each week. Unsubscribe anytime.