Skip to main content

Benchmark profile

MMMU-Pro with Python (MMMU-Pro w/ Python)

Tool-augmented MMMU-Pro variant that allows Python assistance during multimodal reasoning.

Data verified

Benchmark score on MMMU-Pro w/ Python — July 23, 2026

BenchLM mirrors the published score view for MMMU-Pro w/ Python. GPT-5.6 Sol leads the public snapshot at 84.6% , followed by Kimi K3 (83.4%) and GPT-5.5 (83.2%). BenchLM does not use these results to rank models overall.

9 modelsMultimodal & GroundedCurrentDisplay onlyUpdated July 23, 2026

Benchmark score table (9 models)

Score
1
GPT-5.6 SolOpenAI · Closed
84.6%
2
Kimi K3Moonshot AI · Closed
83.4%
3
GPT-5.5OpenAI · Closed
83.2%
4
GPT-5.4OpenAI · Closed
82.1%
5
GPT-5.6 TerraOpenAI · Closed
82%
6
Kimi K2.6Moonshot AI · Open weight
80.1%
7
GPT-5.6 LunaOpenAI · Closed
79.5%
8
GPT-5.4 miniOpenAI · Closed
78%
9
GPT-5.4 nanoOpenAI · Closed
69.5%

The published MMMU-Pro w/ Python snapshot places GPT-5.6 Sol first at 84.6%. The third row is 1.4 points behind. The broader top-10 range is 15.1 points, so the table still separates the published systems.

9 models have been evaluated on MMMU-Pro w/ Python. The benchmark falls in the Multimodal & Grounded category. This category carries a 12% weight in BenchLM.ai's overall scoring system. MMMU-Pro w/ Python is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About MMMU-Pro w/ Python

Year

2026

Tasks

Multimodal academic reasoning

Format

Image + text question answering with Python

Difficulty

Frontier multimodal

Useful for measuring multimodal reasoning when the model can combine visual understanding with computation.

BenchLM freshness & provenance

Version

MMMU-Pro w/ Python 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does MMMU-Pro w/ Python measure?

Tool-augmented MMMU-Pro variant that allows Python assistance during multimodal reasoning.

Which model scores highest on MMMU-Pro w/ Python?

GPT-5.6 Sol by OpenAI currently leads with a score of 84.6% on MMMU-Pro w/ Python.

How many models are evaluated on MMMU-Pro w/ Python?

9 AI models have been evaluated on MMMU-Pro w/ Python on BenchLM.

Last updated: July 23, 2026 · BenchLM version MMMU-Pro w/ Python 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.