Benchmark profile

Artificial Analysis ITBench-AA (AA ITBench)

An independently evaluated IT-operations benchmark from Artificial Analysis.

Data verified July 23, 2026

Benchmark score on AA ITBench — July 23, 2026

BenchLM mirrors the published score view for AA ITBench. GPT-5.6 Sol leads the public snapshot at 56.2% , followed by GPT-5.6 Terra (51.0%) and Kimi K3 (47.7%). BenchLM does not use these results to rank models overall.

1Closed

GPT-5.6 Sol

OpenAI

gpt-5-6-sol

56.2%

Overall 81.96Context 1M

2Closed

GPT-5.6 Terra

OpenAI

gpt-5-6-terra

51.0%

Overall 72.57Context 1M

3Closed

Kimi K3

Moonshot AI

kimi-3

47.7%

Overall 80.96Context 1.05M

14 modelsAgenticCurrentDisplay onlyUpdated July 23, 2026

Benchmark score table (14 models)

Score

GPT-5.6 SolOpenAI · Closed

56.2%

GPT-5.6 TerraOpenAI · Closed

51.0%

Kimi K3Moonshot AI · Closed

47.7%

Claude Opus 4.7 (Adaptive)Anthropic · Closed

46.7%

GPT-5.5OpenAI · Closed

45.8%

GLM-5.2Z.AI · Open weight

42.7%

Qwen3.7 MaxAlibaba · Closed

42.5%

GPT-5.6 LunaOpenAI · Closed

40.3%

DeepSeek V4 Pro (Max)DeepSeek · Open weight

38.3%

MiMo-V2.5-ProXiaomi · Closed

38.2%

Gemma 4 31BGoogle · Open weight

37.3%

DeepSeek V4 Flash (Max)DeepSeek · Open weight

31.5%

Gemini 3.1 ProGoogle · Closed

30.3%

GPT-OSS 120BOpenAI · Open weight

5.6%

The published AA ITBench snapshot places GPT-5.6 Sol first at 56.2%. The third row is 8.5 points behind. The broader top-10 range is 18.0 points, so the table still separates the published systems.

14 models have been evaluated on AA ITBench. The benchmark falls in the Agentic category. This category carries a 22% weight in BenchLM.ai's overall scoring system. AA ITBench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About AA ITBench

Year

2026

Tasks

IT incident-response tasks

Format

Task success rate

Difficulty

Enterprise IT operations

Stored as a display-only agentic row.

Artificial Analysis ITBench-AA Benchmark Leaderboard

BenchLM freshness & provenance

Version

AA ITBench 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does AA ITBench measure?

An independently evaluated IT-operations benchmark from Artificial Analysis.

Which model scores highest on AA ITBench?

GPT-5.6 Sol by OpenAI currently leads with a score of 56.2% on AA ITBench.

How many models are evaluated on AA ITBench?

14 AI models have been evaluated on AA ITBench on BenchLM.

Compare Top Models on AA ITBench

GPT-5.6 Sol vs GPT-5.6 Terra GPT-5.6 Terra vs Kimi K3 Kimi K3 vs Claude Opus 4.7 (Adaptive)Claude Opus 4.7 (Adaptive) vs GPT-5.5

Last updated: July 23, 2026 · BenchLM version AA ITBench 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.