Benchmark profile

Vals MedCode (MedCode)

Vals AI healthcare benchmark for whether models can support the medical billing process.

Data verified July 16, 2026

How BenchLM shows MedCode

BenchLM mirrors the public Vals AI MedCode leaderboard captured from https://www.vals.ai/benchmarks/medcode and updated by Vals on July 16, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.

MedCode is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.

73 Vals rows1 task viewsprivate datasetTasks: OverallDisplay only

MedCode on Vals AI Vals methodology Vals home

MedCode score on MedCode — July 16, 2026

BenchLM mirrors the published medcode score view for MedCode. Gemini 3.1 Pro Preview leads the public snapshot at 59.06% , followed by Claude Fable 5 (56.07%) and Gemini 3 Flash Preview (55.92%). BenchLM does not use these results to rank models overall.

Gemini 3.1 Pro Preview

Google

google/gemini-3.1-pro-preview

59.06%

Overall —

Claude Fable 5

Anthropic

anthropic/claude-fable-5

56.07%

Overall —

Gemini 3 Flash Preview

Google

google/gemini-3-flash-preview

55.92%

Overall —

73 modelsExternal benchmark mirrorsCurrentDisplay onlyUpdated July 16, 2026

MedCode score table (73 models)

Score

Gemini 3.1 Pro PreviewGoogle

59.06%

Claude Fable 5Anthropic

56.07%

Gemini 3 Flash PreviewGoogle

55.92%

Gemini 3.5 FlashGoogle

55.83%

Claude Opus 4.7Anthropic

54.86%

Claude Opus 4.8Anthropic

53.22%

GPT-5.1OpenAI

52.73%

Gemini 3 Pro PreviewGoogle

52.20%

Muse SparkMeta

51.31%

Gemini 2.5 ProGoogle

50.59%

GPT-5.2OpenAI

49.75%

GPT-5OpenAI

49.63%

Claude Opus 4.5 20251101 ThinkingAnthropic

49.16%

Claude Opus 4.6 ThinkingAnthropic

49.13%

GPT-5.5OpenAI

49.10%

Kimi K3Moonshot AI

48.88%

Claude Opus 4.6Anthropic

48.24%

Gemini 3.1 Flash Lite PreviewGoogle

47.60%

O3OpenAI

47.29%

Claude Opus 4.1 20250805 ThinkingAnthropic

47.23%

MiniMax M3MiniMax

46.29%

Claude Opus 4.5Anthropic

45.17%

Claude Sonnet 4.5 20250929 ThinkingAnthropic

44.13%

GPT-5.6 SolOpenAI

43.97%

GPT-5.6 TerraOpenAI

43.41%

Grok 4.5SpaceXAI

43.29%

GPT-5 MiniOpenAI

43.05%

GPT-5.6 LunaOpenAI

42.39%

GLM 5.1Zhipu AI

41.60%

Claude Opus 4.1Anthropic

41.37%

GPT-5.4OpenAI

41.29%

InklingThinkingmachines

41.19%

GPT-5.4 NanoOpenAI

41.03%

GLM 5.2Zhipu AI

40.77%

Claude Sonnet 4.5Anthropic

40.57%

Gemini 2.5 Flash Preview 09 2025Google

40.54%

DeepSeek V4 ProDeepSeek

40.45%

Gemini 2.5 Flash ThinkingGoogle

40.36%

Gemini 2.5 Flash Preview 09 2025 ThinkingGoogle

40.33%

Kimi K2.6Moonshot AI

40.14%

Kimi K2.5 ThinkingMoonshot AI

39.32%

Qwen3.7 MaxAlibaba

38.75%

Nemotron 3 Ultra 550b A55bNvidia

38.62%

Gemini 2.5 FlashGoogle

38.42%

Grok 4 0709SpaceXAI

38.08%

Grok 4.3SpaceXAI

38.07%

Grok 4 Fast ReasoningSpaceXAI

37.38%

Qwen3.6 PlusAlibaba

36.89%

Llama4 Maverick Instruct BasicFireworks AI

36.51%

Claude Sonnet 4 20250514 ThinkingAnthropic

34.96%

MiniMax M2.7MiniMax

34.44%

Gemini 2.5 Flash Lite Preview 09 2025 ThinkingGoogle

34.19%

MiniMax M2.1MiniMax

34.08%

Claude Sonnet 4Anthropic

33.94%

O4 MiniOpenAI

33.79%

Mistral Medium 3.5Mistral AI

33.75%

Qwen3.5 FlashAlibaba

33.00%

GLM 4.7Zhipu AI

32.77%

Claude Haiku 4.5 20251001 ThinkingAnthropic

32.68%

Mimo V2.5 ProXiaomi

32.48%

Grok 4.20 0309 ReasoningSpaceXAI

32.16%

Mimo V2.5Xiaomi

31.89%

Qwen3 VL PlusAlibaba

31.65%

Qwen3 MaxAlibaba

31.37%

GPT-5 NanoOpenAI

30.44%

Grok 4 Fast Non ReasoningSpaceXAI

30.04%

Grok 4.1 Fast Non ReasoningSpaceXAI

28.35%

Grok 4.1 Fast ReasoningSpaceXAI

28.08%

Gemini 2.5 Flash LiteGoogle

27.11%

Gemini 2.5 Flash Lite Preview 09 2025Google

27.08%

Laguna M.1Poolside

25.24%

Meta Llama Llama 4 Scout 17B 16E InstructTogether AI

23.31%

Laguna Xs.2Poolside

20.70%

The published MedCode snapshot places Gemini 3.1 Pro Preview first at 59.06%. The third row is 3.14 points behind. The broader top-10 range is 8.47 points, so many of the published results sit in a relatively narrow band.

73 models have been evaluated on MedCode. The benchmark falls in the External benchmark mirrors category. We keep external benchmark mirrors separate from the weighted global scoring system, so these results remain source-specific evidence. MedCode is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About MedCode

Year

2026

Tasks

Medical billing support tasks

Format

Accuracy score

Difficulty

Professional healthcare administration

BenchLM mirrors the public Vals MedCode leaderboard as display-only healthcare evidence.

MedCode Public benchmark source

BenchLM freshness & provenance

Version

MedCode 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does MedCode measure?

Vals AI healthcare benchmark for whether models can support the medical billing process.

Which model leads the published MedCode snapshot?

Gemini 3.1 Pro Preview currently leads the published MedCode snapshot with 59.06% medcode score. BenchLM shows this benchmark for display only and does not use it in overall rankings.

How many models are evaluated on MedCode?

73 AI models are included in BenchLM's mirrored MedCode snapshot, based on the public leaderboard captured on July 16, 2026.

Last updated: July 16, 2026 · mirrored from the public benchmark leaderboard

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.