Skip to main content

GPT-4o mini

OpenAISupersededReleased Jul 18, 2024
Overall Score
Est. 49Prov. #69 of 119
Arena Elo
1317
Categories Ranked
4of 8
Price (1M tokens)
$0.15 in / $0.6 out
Speed
33tok/s
Context
128K
ProprietaryNon-Reasoning
Confidence
mini

According to BenchLM.ai, GPT-4o mini ranks #69 out of 119 models on the provisional leaderboard with an overall score of 49/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

GPT-4o mini is a proprietary model with a 128K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

GPT-4o mini sits inside the GPT-4o family alongside GPT-4o. This profile currently has 6 of 225 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Multilingual (#60), while its weakest is Reasoning (#81). This performance profile makes it a well-rounded choice across a range of tasks.

Ranking Distribution

Category rank across 6 benchmark categories — sorted by best rank

Category Performance

Scores across all benchmark categories (0-100 scale)

Category Breakdown

Agentic

#62
39.7/ 100
Weight: 22%0 benchmarks
Terminal-Bench 2.0BrowseCompOSWorld-VerifiedGAIATAU-benchWebArena

Coding

91.1/ 100
Weight: 20%1 benchmark
SWE-bench VerifiedLiveCodeBenchSWE-bench ProSWE-RebenchSciCode

Reasoning

#81
20.4/ 100
Weight: 17%0 benchmarks
MuSRLongBench v2MRCRv2ARC-AGI-2

Knowledge

49.0/ 100
Weight: 12%3 benchmarks
GPQASuperGPQAMMLU-ProHLEFrontierScienceSimpleQA

Math

0.0/ 100
Weight: 5%0 benchmarks
AIME 2025BRUMO 2025MATH-500FrontierMath

Multilingual

#60
47.3/ 100
Weight: 7%0 benchmarks
MGSMMMLU-ProX

Multimodal

#73
40.7/ 100
Weight: 12%1 benchmark
MMMU-ProOfficeQA ProCharXivCharXiv w/o tools

Inst. Following

0.0/ 100
Weight: 5%1 benchmark
IFEvalIFBench

Chatbot Arena Performance

Text Overall1317

Benchmark Details

Only benchmark rows with an attached exact-source record are shown here. Source-unverified manual rows and generated rows are hidden from model pages.

GPT-4o Family

Mini

Canonical Entry

GPT-4o

Frequently Asked Questions

How does GPT-4o mini perform overall in AI benchmarks?

GPT-4o mini currently ranks #69 out of 119 models on BenchLM's provisional leaderboard with an overall score of 49 (estimated). It is created by OpenAI and features a 128K context window.

Is GPT-4o mini good for knowledge and understanding?

GPT-4o mini has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o mini good for coding and programming?

GPT-4o mini has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.

Is GPT-4o mini good for multimodal and grounded tasks?

GPT-4o mini ranks #73 out of 119 models in multimodal and grounded tasks benchmarks with an average score of 40.7. There are stronger options in this category.

Is GPT-4o mini good for instruction following?

GPT-4o mini has visible benchmark coverage in instruction following, but BenchLM does not currently assign it a global category rank there.

Which sibling models are related to GPT-4o mini?

GPT-4o mini belongs to the GPT-4o family. Related variants on BenchLM include GPT-4o.

Does GPT-4o mini have full benchmark coverage on BenchLM?

Not yet. GPT-4o mini currently has 6 published benchmark scores out of the 225 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of GPT-4o mini?

GPT-4o mini has a context window of 128K, which determines how much text it can process in a single interaction.

Last updated: June 2, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Don't miss the next GPT moment

Which models moved up, what’s new, and what it costs. One email a week, 3-min read.

Free. One email per week.