Skip to main content
BenchLM
Advertise

Benchmark profile

Artificial Analysis AutomationBench (AA AutomationBench)

An independently evaluated automation benchmark from Artificial Analysis.

Data verified

Benchmark score on AA AutomationBench — July 23, 2026

BenchLM mirrors the published score view for AA AutomationBench. Kimi K3 leads the public snapshot at 52.7% , followed by Grok 4.5 (51.4%) and GPT-5.6 Sol (51.2%). BenchLM does not use these results to rank models overall.

1Closed

Kimi K3

Moonshot AI

kimi-3

52.7%
Overall 80.96Context 1.05M
2Closed

Grok 4.5

xAI

grok-4-5

51.4%
Overall 76.72Context 500K
3Closed

GPT-5.6 Sol

OpenAI

gpt-5-6-sol

51.2%
Overall 81.96Context 1M
14 modelsAgenticCurrentDisplay onlyUpdated July 23, 2026

Benchmark score table (14 models)

Score
1
Kimi K3Moonshot AI · Closed
52.7%
2
Grok 4.5xAI · Closed
51.4%
3
GPT-5.6 SolOpenAI · Closed
51.2%
4
Claude Fable 5Anthropic · Closed
48.6%
5
Claude Opus 4.8Anthropic · Closed
48.5%
6
GPT-5.6 TerraOpenAI · Closed
45.6%
7
Muse Spark 1.1Meta · Closed
42.8%
8
Gemini 3.5 FlashGoogle · Closed
42.6%
9
GPT-5.6 LunaOpenAI · Closed
42.2%
10
GPT-5.5OpenAI · Closed
42.1%
11
Claude Sonnet 5Anthropic · Closed
39.2%
12
Gemini 3.1 ProGoogle · Closed
37.5%
13
GLM-5.2Z.AI · Open weight
27.8%
14
Qwen3.7 MaxAlibaba · Closed
25.6%

The published AA AutomationBench snapshot places Kimi K3 first at 52.7%. The third row is 1.5 points behind. The broader top-10 range is 10.6 points, so the table still separates the published systems.

14 models have been evaluated on AA AutomationBench. The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. AA AutomationBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About AA AutomationBench

Year

2026

Tasks

Business-process automation tasks

Format

Task success rate

Difficulty

Agentic automation

Stored as a display-only agentic row.

Artificial Analysis AutomationBench Benchmark Leaderboard

BenchLM freshness & provenance

Version

AA AutomationBench 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does AA AutomationBench measure?

An independently evaluated automation benchmark from Artificial Analysis.

Which model scores highest on AA AutomationBench?

Kimi K3 by Moonshot AI currently leads with a score of 52.7% on AA AutomationBench.

How many models are evaluated on AA AutomationBench?

14 AI models have been evaluated on AA AutomationBench on BenchLM.

Compare Top Models on AA AutomationBench

Kimi K3 vs Grok 4.5Grok 4.5 vs GPT-5.6 SolGPT-5.6 Sol vs Claude Fable 5Claude Fable 5 vs Claude Opus 4.8
Last updated: July 23, 2026 · BenchLM version AA AutomationBench 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.