Skip to main content

Model profile

GPT-4o mini

OpenAISupersededReleased Jul 18, 2024
Data verified
Superseded:OpenAI has released newer models in this line —GPT-4.1 mini
Overall Score
37.87Public #183 of 200Verified #82 of 99
Arena Elo
1317
Eligible category ranks
2of 8
Price (1M tokens)
$0.15 in / $0.6 out
API pricing
Speed
33tok/s
Context
128K

Evidence coverage

10 of 323 tracked benchmarks are published. 0 are verified and 10 provisional. 5 of 8 categories are measured.

Updated July 23, 2026Methodology
Published / tracked
10 / 323
Verified
0
Provisional
10
Categories with evidence
5 / 8

Evidence by category

  • Agentic3 benchmarks
    Reported
  • Coding2 benchmarks
    Reported
  • Reasoning0 benchmarks
    Not measured
  • Knowledge3 benchmarks
    Reported
  • Math0 benchmarks
    Not measured
  • Multilingual0 benchmarks
    Not measured
  • Multimodal1 benchmark
    Reported
  • Inst. Following1 benchmark
    Reported
ProprietaryNon-Reasoning
Confidence:
Low
mini

GPT-4o mini ranks #183 out of 200 models on the public leaderboard with an overall score of 37.87/100. It also ranks #82 out of 99 on the verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

GPT-4o mini is a proprietary model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

GPT-4o mini sits inside the GPT-4o family alongside GPT-4o. This profile currently has 10 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Agentic (#110), while its weakest is Coding (#112). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.

Peer position

Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.

Range 36.5539.52

  1. Ministral 3 3B (Reasoning)
    Mistral
    #17739.52
    Ministral 3 3B (Reasoning) is #177 with a score of 39.52.
    Compare
  2. Mistral 8x7B v0.2
    Mistral
    #17839.13
    Mistral 8x7B v0.2 is #178 with a score of 39.13.
    Compare
  3. Grok Code Fast 1
    xAI
    #18038.64
    Grok Code Fast 1 is #180 with a score of 38.64.
    Compare
  4. Granite-4.0-350M
    IBM
    #18138.32
    Granite-4.0-350M is #181 with a score of 38.32.
    Compare
  5. Granite-4.0-H-350M
    IBM
    #18238.32
    Granite-4.0-H-350M is #182 with a score of 38.32.
    Compare
  6. GPT-4o miniCurrent model
    OpenAI
    #18337.87
    GPT-4o mini is #183 with a score of 37.87.
  7. Claude 4.1 Opus Thinking
    Anthropic
    #18436.55
    Claude 4.1 Opus Thinking is #184 with a score of 36.55.
    Compare

Category percentile

More

Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.

  1. Agentic8%
    Eligible cohort rank #110 of 119Category score 33.7
  2. Coding8%
    Eligible cohort rank #112 of 122Category score 35.6

Category evidence

Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticRank #110 of 119Percentile 8thWeight 22%3 benchmarksReported33.7
CodingRank #112 of 122Percentile 8thWeight 20%2 benchmarksReported35.6
ReasoningWeight 17%0 benchmarksNot measuredNot measured
KnowledgeWeight 12%3 benchmarksReportedScore pending
MathWeight 5%0 benchmarksNot measuredNot measured
MultilingualWeight 7%0 benchmarksNot measuredNot measured
MultimodalRank Not rankedWeight 12%1 benchmarkReported60.8
Inst. FollowingWeight 5%1 benchmarkReportedScore pending

Chatbot Arena performance

Scroll horizontally to inspect confidence intervals and vote counts.

Chatbot Arena Elo, confidence interval, and vote count by evaluation view
ViewEloConfidence intervalVotes
Text Overall1317Not availableNot available

Benchmark Details

Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.

Agentic3 benchmarks
AA Agentic IndexReported

Artificial Analysis Agentic Index

1.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
GDPval-AAReported

GDPval-AA normalized

0.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
GDPval-AAReported
226Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Coding2 benchmarks
AA-SciCodeReported

Artificial Analysis SciCode

22.9%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA Coding IndexReported

Artificial Analysis Coding Index

11.4%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Knowledge3 benchmarks
Artificial Analysis Intelligence IndexReported
6.9%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-GPQA DiamondReported

Artificial Analysis GPQA Diamond

42.6%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-HLEReported

Artificial Analysis Humanity's Last Exam

4.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Multimodal1 benchmark
AA-MMMU-ProReported

Artificial Analysis MMMU-Pro

41.5%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Inst. Following1 benchmark
AA-IFBenchReported

Artificial Analysis IFBench

31.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.

GPT-4o Family

Mini

Canonical Entry

GPT-4o

Frequently Asked Questions

How does GPT-4o mini perform overall in AI benchmarks?

GPT-4o mini has 10 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.

Is GPT-4o mini good for knowledge and understanding?

GPT-4o mini has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o mini good for coding and programming?

GPT-4o mini ranks #112 out of 122 models in coding and programming benchmarks with an average score of 35.6. There are stronger options in this category.

Is GPT-4o mini good for agentic tool use and computer tasks?

GPT-4o mini ranks #110 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 33.7. There are stronger options in this category.

Is GPT-4o mini good for multimodal and grounded tasks?

GPT-4o mini has visible benchmark coverage in multimodal and grounded tasks, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o mini good for instruction following?

GPT-4o mini has visible benchmark coverage in instruction following, but BenchLM does not currently assign it a global category rank there.

Which sibling models are related to GPT-4o mini?

GPT-4o mini belongs to the GPT-4o family. Related variants on BenchLM include GPT-4o.

Does GPT-4o mini have full benchmark coverage on BenchLM?

Not yet. GPT-4o mini currently has 10 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of GPT-4o mini?

GPT-4o mini has a published context window of 128K, which determines how much text it can process in a single interaction.

Last updated: July 23, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Choose with this week’s evidence

Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.

Free. One email per week.