Benchmark profile
Chinese Massive Multitask Language Understanding (CMMLU)
A Chinese multitask academic benchmark reported in DeepSeek-V4 base-model evaluations.
Data verifiedBenchmark score on CMMLU — July 23, 2026
BenchLM mirrors the published score view for CMMLU. DeepSeek V4 Pro Base leads the public snapshot at 90.8% , followed by DeepSeek V4 Flash Base (90.4%). BenchLM does not use these results to rank models overall.
DeepSeek V4 Pro Base
DeepSeek
deepseek-v4-pro-base
DeepSeek V4 Flash Base
DeepSeek
deepseek-v4-flash-base
Benchmark score table (2 models)
ScoreAbout CMMLU
Year
2026
Tasks
Chinese academic QA
Format
Exact match
Difficulty
Broad Chinese knowledge
BenchLM stores CMMLU as a display-only provider-table row when exact values are published in DeepSeek-V4 evaluations.
BenchLM freshness & provenance
Version
CMMLU 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does CMMLU measure?
A Chinese multitask academic benchmark reported in DeepSeek-V4 base-model evaluations.
Which model scores highest on CMMLU?
DeepSeek V4 Pro Base by DeepSeek currently leads with a score of 90.8% on CMMLU.
How many models are evaluated on CMMLU?
2 AI models have been evaluated on CMMLU on BenchLM.
Compare Top Models on CMMLU
Choose a model with this week’s evidence
Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.
One email each week. Unsubscribe anytime.