Benchmark profile

MedXpertQA Multimodal (MedXpertQA (MM))

A multimodal medical multiple-choice benchmark covering clinical images such as X-rays, histology, and dermatology.

Data verified July 23, 2026

Benchmark score on MedXpertQA (MM) — July 23, 2026

BenchLM mirrors the published score view for MedXpertQA (MM). Gemini 3.1 Pro leads the public snapshot at 81.3% , followed by Muse Spark (78.4%) and GPT-5.4 (77.1%). BenchLM does not use these results to rank models overall.

1Closed

Gemini 3.1 Pro

Google

gemini-3-1-pro

81.3%

Overall 55.3Context 1M

2Closed

Muse Spark

Benchmark score table (7 models)

Score

Gemini 3.1 ProGoogle · Closed

81.3%

Muse SparkMeta · Closed

78.4%

GPT-5.4OpenAI · Closed

77.1%

Qwen3.7 PlusAlibaba · Closed

71.0%

Grok 4.20xAI · Closed

65.8%

Claude Opus 4.6Anthropic · Closed

64.8%

Gemma 4 12BGoogle · Open weight

48.7%

The published MedXpertQA (MM) snapshot places Gemini 3.1 Pro first at 81.3%. The third row is 4.2 points behind. The broader top-10 range is 32.6 points, so the table still separates the published systems.

7 models have been evaluated on MedXpertQA (MM). The benchmark falls in the Multimodal & Grounded category. This category carries a 12% weight in BenchLM.ai's overall scoring system. MedXpertQA (MM) is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About MedXpertQA (MM)

Year

2026

Tasks

2,000 multimodal medical questions

Format

Medical visual MCQ

Difficulty

Clinical multimodal reasoning

Meta describes the multimodal MedXpertQA variant as 2,000 clinically grounded medical questions with five answer choices. BenchLM stores it as a display-only health and multimodal reference.

Muse Spark Eval Methodology

BenchLM freshness & provenance

Version

MedXpertQA (MM) 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does MedXpertQA (MM) measure?

A multimodal medical multiple-choice benchmark covering clinical images such as X-rays, histology, and dermatology.

Which model scores highest on MedXpertQA (MM)?

Gemini 3.1 Pro by Google currently leads with a score of 81.3% on MedXpertQA (MM).

How many models are evaluated on MedXpertQA (MM)?

7 AI models have been evaluated on MedXpertQA (MM) on BenchLM.

Compare Top Models on MedXpertQA (MM)

Gemini 3.1 Pro vs Muse Spark Muse Spark vs GPT-5.4 GPT-5.4 vs Qwen3.7 Plus Qwen3.7 Plus vs Grok 4.20

Last updated: July 23, 2026 · BenchLM version MedXpertQA (MM) 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.