Skip to main content

Model profile

GPT-4.1 mini

OpenAIEstablishedReleased Apr 14, 2025
Data verified
Overall Score
44.19Public #152 of 200
Arena Elo
Not listed
Eligible category ranks
3of 8
Price (1M tokens)
$0.4 in / $1.6 out
API pricing
Speed
80tok/s
Context
1M

Evidence coverage

22 of 323 tracked benchmarks are published. 5 are verified and 17 provisional. 7 of 8 categories are measured.

Updated July 23, 2026Methodology
Published / tracked
22 / 323
Verified
5
Provisional
17
Categories with evidence
7 / 8

Evidence by category

  • Agentic4 benchmarks
    Reported
  • Coding3 benchmarks
    Mixed evidence
  • Reasoning2 benchmarks
    Reported
  • Knowledge8 benchmarks
    Mixed evidence
  • Math1 benchmark
    Verified
  • Multilingual0 benchmarks
    Not measured
  • Multimodal2 benchmarks
    Reported
  • Inst. Following2 benchmarks
    Mixed evidence
ProprietaryNon-Reasoning
Confidence:
Low
mini

GPT-4.1 mini ranks #152 out of 200 models on the public leaderboard with an overall score of 44.19/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

GPT-4.1 mini is a proprietary model with a 1M token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

GPT-4.1 mini sits inside the GPT-4.1 family alongside GPT-4.1, GPT-4.1 nano. BenchLM links it directly to GPT-4o mini as the earlier related model in that lineage. This profile currently has 22 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Instruction Following (#19), while its weakest is Coding (#94). This performance profile makes it a well-rounded choice across a range of tasks.

Peer position

Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.

Range 43.8744.79

  1. Moonshot v1
    Moonshot AI
    #14844.79
    Moonshot v1 is #148 with a score of 44.79.
    Compare
  2. Seed-2.0-Mini
    ByteDance
    #14944.6
    Seed-2.0-Mini is #149 with a score of 44.6.
    Compare
  3. Nemotron Ultra 253B
    NVIDIA
    #15044.4
    Nemotron Ultra 253B is #150 with a score of 44.4.
    Compare
  4. Nemotron 3 Nano Omni 30B A3B
    NVIDIA
    #15144.24
    Nemotron 3 Nano Omni 30B A3B is #151 with a score of 44.24.
    Compare
  5. GPT-4.1 miniCurrent model
    OpenAI
    #15244.19
    GPT-4.1 mini is #152 with a score of 44.19.
  6. GPT-5 mini
    OpenAI
    #15343.93
    GPT-5 mini is #153 with a score of 43.93.
    Compare
  7. Ling 2.6 Flash
    InclusionAI
    #15443.87
    Ling 2.6 Flash is #154 with a score of 43.87.
    Compare

Category percentile

More

Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.

  1. Inst. Following40%
    Eligible cohort rank #19 of 31Category score 74.6
  2. Agentic23%
    Eligible cohort rank #92 of 119Category score 41.0
  3. Coding23%
    Eligible cohort rank #94 of 122Category score 44.5

Category evidence

Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticRank #92 of 119Percentile 23rdWeight 22%4 benchmarksReported41.0
CodingRank #94 of 122Percentile 23rdWeight 20%3 benchmarksMixed sources44.5
ReasoningRank Not rankedWeight 17%2 benchmarksReported80.9
KnowledgeRank Not rankedWeight 12%8 benchmarksMixed sources53.0
MathRank Not rankedWeight 5%1 benchmarkVerified28.6
MultilingualWeight 7%0 benchmarksNot measuredNot measured
MultimodalRank Not rankedWeight 12%2 benchmarksReported69.2
Inst. FollowingRank #19 of 31Percentile 40thWeight 5%2 benchmarksMixed sources74.6

Benchmark Details

Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.

Agentic4 benchmarks
AA Agentic IndexReported

Artificial Analysis Agentic Index

1.7%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
τ²-bench resultsReported

τ²-Bench Tool-Agent-User Evaluation

52.9%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
GDPval-AAReported

GDPval-AA normalized

0.1%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
GDPval-AAReported
503Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Coding3 benchmarks
SWE-bench VerifiedProvider exact

Software Engineering Benchmark Verified

23.6%Weighted 16%
Source: OpenAI: Introducing GPT-4.1 in the APIProvenance: Provider exact
AA Coding IndexReported

Artificial Analysis Coding Index

20.2%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-SciCodeReported

Artificial Analysis SciCode

40.4%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Reasoning2 benchmarks
AA-LCRReported

Artificial Analysis Long Context Reasoning

42.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
CritPtReported

Critical Physics Tasks

0.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Knowledge8 benchmarks
GPQAProvider exact

Graduate-Level Google-Proof Q&A

64.2%Weighted 7%
Source: OpenAI: Introducing GPT-4.1 in the APIProvenance: Provider exact
MMLUProvider exact

Massive Multitask Language Understanding

87.5%Display only
Source: OpenAI: Introducing GPT-4.1 in the APIProvenance: Provider exact
Artificial Analysis Intelligence IndexReported
14.8%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-GPQA DiamondReported

Artificial Analysis GPQA Diamond

66.4%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-HLEReported

Artificial Analysis Humanity's Last Exam

4.6%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience IndexReported

Artificial Analysis Omniscience Index

-50.1%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience AccuracyReported

Artificial Analysis Omniscience Accuracy

17.5%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience Hallucination RateReported

Artificial Analysis Omniscience Hallucination Rate

82.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Math1 benchmark
FrontierMath v2 (Tiers 1-3)Benchmark exact

FrontierMath v2 Tiers 1-3

4.483%Weighted 30%
Source: Epoch AI FrontierMath v2 leaderboardProvenance: Epoch AI reports FrontierMath v2 Tiers 1-3 at 4.483% for gpt-4.1-mini-2025-04-14. BenchLM selects the highest published thinking effort for the model and stores the v2 benchmark slice separately.
Multimodal2 benchmarks
AA-MMMU-ProReported

Artificial Analysis MMMU-Pro

58.7%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Design Arena WebsiteReported

Design Arena Website Elo

1027Display only
Source: OpenRouter model benchmarksProvenance: Display-only Design Arena Website Elo synced from OpenRouter model benchmark metadata. It is excluded from BenchLM weighted scoring.
Inst. Following2 benchmarks
IFEvalProvider exact

Instruction-Following Eval

88.5%Weighted 35%
Source: OpenAI: Introducing GPT-4.1 in the APIProvenance: Provider exact
AA-IFBenchReported

Artificial Analysis IFBench

38.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.

GPT-4.1 Family

Mini

Canonical Entry

GPT-4.1

Related Earlier Model

GPT-4o mini

Frequently Asked Questions

How does GPT-4.1 mini perform overall in AI benchmarks?

GPT-4.1 mini has 22 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.

Is GPT-4.1 mini good for knowledge and understanding?

GPT-4.1 mini has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is GPT-4.1 mini good for coding and programming?

GPT-4.1 mini ranks #94 out of 122 models in coding and programming benchmarks with an average score of 44.5. There are stronger options in this category.

Is GPT-4.1 mini good for mathematics?

GPT-4.1 mini has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.

Is GPT-4.1 mini good for reasoning and logic?

GPT-4.1 mini has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.

Is GPT-4.1 mini good for agentic tool use and computer tasks?

GPT-4.1 mini ranks #92 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 41. There are stronger options in this category.

Is GPT-4.1 mini good for multimodal and grounded tasks?

GPT-4.1 mini has visible benchmark coverage in multimodal and grounded tasks, but BenchLM does not currently assign it a global category rank there.

Is GPT-4.1 mini good for instruction following?

GPT-4.1 mini ranks #19 out of 31 models in instruction following benchmarks with an average score of 74.6. There are stronger options in this category.

Which sibling models are related to GPT-4.1 mini?

GPT-4.1 mini belongs to the GPT-4.1 family. Related variants on BenchLM include GPT-4.1, GPT-4.1 nano.

Does GPT-4.1 mini have full benchmark coverage on BenchLM?

Not yet. GPT-4.1 mini currently has 22 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of GPT-4.1 mini?

GPT-4.1 mini has a published context window of 1M, which determines how much text it can process in a single interaction.

Last updated: July 23, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Choose with this week’s evidence

Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.

Free. One email per week.