Skip to main content
BenchLM
Advertise

Benchmark profile

MMLU-Redux

A harder refresh of MMLU intended to keep broad knowledge evaluation useful after the original benchmark became too easy for frontier models.

Data verified

Benchmark score on MMLU-Redux — July 23, 2026

BenchLM mirrors the published score view for MMLU-Redux. Claude Opus 4.5 leads the public snapshot at 96.6% , followed by Qwen3.7 Max (95%) and Qwen3.5 397B (94.9%). BenchLM does not use these results to rank models overall.

1Closed

Claude Opus 4.5

Anthropic

claude-opus-4-5

96.6%
Overall 64.22Context 200K
2Closed

Qwen3.7 Max

Alibaba

qwen3-7-max

95%
Overall 72.84Context 1M
3Open

Qwen3.5 397B

Alibaba

qwen3-5-397b

94.9%
Overall 57.01Context 128K
11 modelsKnowledgeCurrentDisplay onlyUpdated July 23, 2026

Benchmark score table (11 models)

Score
1
Claude Opus 4.5Anthropic · Closed
96.6%
2
Qwen3.7 MaxAlibaba · Closed
95%
3
Qwen3.5 397BAlibaba · Open weight
94.9%
4
Qwen3.7 PlusAlibaba · Closed
94.5%
5
Qwen3.6 PlusAlibaba · Closed
94.5%
6
Qwen3.6-27BAlibaba · Open weight
93.5%
7
DeepSeek V4 Pro BaseDeepSeek · Open weight
90.8%
8
DeepSeek V4 Flash BaseDeepSeek · Open weight
89.4%
9
Mellum2-12B-A2.5B-ThinkingJetBrains · Open weight
86.2%
10
Mellum2-12B-A2.5B-InstructJetBrains · Open weight
78.1%
11
MiniCPM5-1BOpenBMB · Open weight
70.1%

The published MMLU-Redux snapshot places Claude Opus 4.5 first at 96.6%. The third row is 1.7 points behind. The broader top-10 range is 18.5 points, so the table still separates the published systems.

11 models have been evaluated on MMLU-Redux. The benchmark falls in the Knowledge category. This category carries a 12% weight in BenchLM.ai's overall scoring system. MMLU-Redux is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About MMLU-Redux

Year

2026

Tasks

Broad academic QA

Format

Multiple choice questions

Difficulty

Advanced general knowledge

MMLU-Redux is useful when MMLU itself has largely saturated. It acts as a broader knowledge sanity check with fresher or harder questions intended to preserve separation among strong general-purpose models.

Qwen3.6 launch benchmarks

BenchLM freshness & provenance

Version

MMLU-Redux 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does MMLU-Redux measure?

A harder refresh of MMLU intended to keep broad knowledge evaluation useful after the original benchmark became too easy for frontier models.

Which model scores highest on MMLU-Redux?

Claude Opus 4.5 by Anthropic currently leads with a score of 96.6% on MMLU-Redux.

How many models are evaluated on MMLU-Redux?

11 AI models have been evaluated on MMLU-Redux on BenchLM.

Compare Top Models on MMLU-Redux

Claude Opus 4.5 vs Qwen3.7 MaxQwen3.7 Max vs Qwen3.5 397BQwen3.5 397B vs Qwen3.7 PlusQwen3.7 Plus vs Qwen3.6 Plus
Last updated: July 23, 2026 · BenchLM version MMLU-Redux 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.