Head-to-head comparison across 1benchmark categories. Overall scores shown here use BenchLM's provisional ranking lane.
Claude Haiku 4.5
56
GPT-4.1
57
Pick GPT-4.1 if you want the stronger benchmark profile. Claude Haiku 4.5 only becomes the better choice if coding is the priority or you want the cheaper token bill.
Coding
+18.7 difference
Claude Haiku 4.5
GPT-4.1
$1 / $5
$2 / $8
N/A
108 t/s
N/A
1.02s
200K
1M
Pick GPT-4.1 if you want the stronger benchmark profile. Claude Haiku 4.5 only becomes the better choice if coding is the priority or you want the cheaper token bill.
GPT-4.1 finishes one point ahead on BenchLM's provisional leaderboard, 57 to 56. That is enough to call, but not enough to treat as a blowout. This matchup comes down to a few meaningful edges rather than one model dominating the board.
GPT-4.1 is also the more expensive model on tokens at $2.00 input / $8.00 output per 1M tokens, versus $1.00 input / $5.00 output per 1M tokens for Claude Haiku 4.5. GPT-4.1 gives you the larger context window at 1M, compared with 200K for Claude Haiku 4.5.
GPT-4.1 is ahead on BenchLM's provisional leaderboard, 57 to 56. The biggest single separator in this matchup is SWE-bench Verified, where the scores are 73.3% and 54.6%.
Claude Haiku 4.5 has the edge for coding in this comparison, averaging 73.3 versus 54.6. Inside this category, SWE-bench Verified is the benchmark that creates the most daylight between them.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.