Skip to main content
BenchLM
Advertise

Model comparison

Claude Haiku 4.5 vs GPT-5.4 mini

Data verified

Head-to-head evidence from 2 shared benchmark results across 1 category. Overall scores shown here use the public BenchAlign v5 ranking lane.

56.58/100
Margin
0.2pts
winning →
56.77/100
0 category wins1 category wins

Public leaderboard positions: Claude Haiku 4.5 #77 (Estimated); GPT-5.4 mini #75 (Estimated). Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.

Evidence parity. Claude Haiku 4.5 and GPT-5.4 mini share 2 comparable benchmark results. 1 of 8 categories are comparable. 3 results are unique to Claude Haiku 4.5; 28 to GPT-5.4 mini.

Updated July 23, 2026
Shared results
2
Claude Haiku 4.5 only
3
GPT-5.4 mini only
28
Comparable categories
1 / 8

Pick GPT-5.4 mini if you want the stronger benchmark profile. Claude Haiku 4.5 only becomes the better choice if you would rather avoid the extra latency and token burn of a reasoning model.

Confidence note. This is a partial-evidence comparison with 2 shared benchmark results across 1 evidence category; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.

Why this result

GPT-5.4 mini has the cleaner BenchAlign overall profile here, landing at 56.77 versus 56.58. It is a real lead, but still close enough that category-level strengths matter more than the headline number.

GPT-5.4 mini's sharpest advantage is in mathematics, where it averages 21.7 against 4.9. The single biggest benchmark swing on the page is FrontierMath v2 (Tiers 1-3), 5.903% to 28.280%.

Claude Haiku 4.5 is also the more expensive model on tokens at $1.00 input / $5.00 output per 1M tokens, versus $0.75 input / $4.50 output per 1M tokens for GPT-5.4 mini. GPT-5.4 mini is the reasoning model in the pair, while Claude Haiku 4.5 is not. That usually helps on harder chain-of-thought-heavy tests, but it can also mean more latency and more token spend in real use. GPT-5.4 mini gives you the larger context window at 400K, compared with 200K for Claude Haiku 4.5.

Category breakdown

Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.

Category scores and score margins for Claude Haiku 4.5 and GPT-5.4 mini
CategoryClaude Haiku 4.5ΔGPT-5.4 mini
MathClaude Haiku 4.54.9Margin→ 16.8GPT-5.4 mini21.7
AgenticClaude Haiku 4.5Not measuredMarginNo overlapGPT-5.4 mini65.7
CodingClaude Haiku 4.573.3MarginNo overlapGPT-5.4 miniNot measured
KnowledgeClaude Haiku 4.5Not measuredMarginNo overlapGPT-5.4 mini47.8
MultimodalClaude Haiku 4.5Not measuredMarginNo overlapGPT-5.4 mini76.6

Decisive benchmark drivers

The largest measured benchmark gaps in this matchup, with exact reported values.

More
A · Claude Haiku 4.5B · GPT-5.4 mini

  1. FrontierMath v2 (Tiers 1-3)

    Math
    Source ↗
    A 5.903%B 28.280%
    Winner: GPT-5.4 miniΔ 22.4
    FrontierMath v2 (Tiers 1-3): Claude Haiku 4.5 scored 5.903%; GPT-5.4 mini scored 28.280%. GPT-5.4 mini wins this benchmark.

  2. FrontierMath v2 (Tier 4)

    Math
    Source ↗
    A 2.083%B 2.080%
    Winner: Claude Haiku 4.5Δ 0
    FrontierMath v2 (Tier 4): Claude Haiku 4.5 scored 2.083%; GPT-5.4 mini scored 2.080%. Claude Haiku 4.5 wins this benchmark.

Operational comparison

Runtime and commercial metrics are compared only when both models have a complete sourced value.

MetricClaude Haiku 4.5GPT-5.4 miniComparison
Input / output priceUSD per 1M tokensClaude Haiku 4.5$1 input / $5 outputGPT-5.4 mini$0.75 input / $4.5 outputGPT-5.4 mini has the lower combined listed price.
Generation speedtokens per secondClaude Haiku 4.5Not availableGPT-5.4 mini201 tok/sA complete speed comparison is not available.
First-answer latencyseconds to first tokenClaude Haiku 4.5Not availableGPT-5.4 mini3.85 sA complete latency comparison is not available.
Context windowmaximum listed tokensClaude Haiku 4.5200KGPT-5.4 mini400KGPT-5.4 mini lists the larger context window.

Benchmark Deep Dive

Agentic
BenchmarkClaude Haiku 4.5GPT-5.4 miniResult
JobBenchSource 16.0%—Not comparable
Terminal-Bench 2.0Source —60%Not comparable
OSWorld-VerifiedSource —72.1%Not comparable
MCP AtlasSource —57.7%Not comparable
ToolathlonSource —42.9%Not comparable
τ²-bench resultsSource —83.3%Not comparable
AA Agentic IndexSource —30.2%Not comparable
APEX-Agents-AASource —28.2%Not comparable
GDPval-AASource —33.6%Not comparable
GDPval-AASource —1171Not comparable
Coding
BenchmarkClaude Haiku 4.5GPT-5.4 miniResult
SWE-bench VerifiedSource 73.3%—Not comparable
Vibe Code BenchSource —47.97%Not comparable
AA Coding IndexSource —56.1%Not comparable
AA-SciCodeSource —49.9%Not comparable
FrontierCode 1.1 MainSource —27.0%Not comparable
Reasoning
BenchmarkClaude Haiku 4.5GPT-5.4 miniResult
AA-LCRSource —69.3%Not comparable
CritPtSource —10.0%Not comparable
Knowledge
BenchmarkClaude Haiku 4.5GPT-5.4 miniResult
GPQASource —88%Not comparable
HLESource —41.5%Not comparable
HLE w/o toolsSource —28.2%Not comparable
Artificial Analysis Intelligence IndexSource —40.0%Not comparable
AA-GPQA DiamondSource —87.5%Not comparable
AA-HLESource —26.6%Not comparable
AA-Omniscience IndexSource —-18.7%Not comparable
AA-Omniscience AccuracySource —37.5%Not comparable
AA-Omniscience Hallucination RateSource —89.8%Not comparable
MathGPT-5.4 mini wins
BenchmarkClaude Haiku 4.5GPT-5.4 miniResult
FrontierMath v2 (Tiers 1-3)Source 5.903%28.280%GPT-5.4 mini leads
FrontierMath v2 (Tier 4)Source 2.083%2.080%Claude Haiku 4.5 leads
Multimodal
BenchmarkClaude Haiku 4.5GPT-5.4 miniResult
Design Arena WebsiteSource 1152—Not comparable
MMMU-ProSource —76.6%Not comparable
MMMU-Pro w/ PythonSource —78%Not comparable
AA-MMMU-ProSource —73.3%Not comparable
Inst. Following
BenchmarkClaude Haiku 4.5GPT-5.4 miniResult
AA-IFBenchSource —73.3%Not comparable
Frequently Asked Questions (2)

Which is better, Claude Haiku 4.5 or GPT-5.4 mini?

GPT-5.4 mini is ahead on BenchLM's BenchAlign leaderboard, 56.77 to 56.58. The biggest single separator in this matchup is FrontierMath v2 (Tiers 1-3), where the scores are 5.903% and 28.280%.

Which is better for math, Claude Haiku 4.5 or GPT-5.4 mini?

GPT-5.4 mini has the edge for math in this comparison, averaging 21.7 versus 4.9. Inside this category, FrontierMath v2 (Tiers 1-3) is the benchmark that creates the most daylight between them.

Related Comparisons

Explore More

Anthropic Compare Pricing Methodology Find Your Best LLM Overall Rankings
Last updated: July 23, 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.