Model comparison
Gemma 4 26B A4B vs Soofi S 30B-A3B
Head-to-head evidence from 1 shared benchmark result across 1 category. Overall scores shown here use the public BenchAlign v5 ranking lane.
Public leaderboard positions: Gemma 4 26B A4B #67 (Supported); Soofi S 30B-A3B unranked (Not scored). Intervals and evidence labels describe ranking uncertainty, not a guarantee for a specific workload.
Evidence parity. Gemma 4 26B A4B and Soofi S 30B-A3B share 1 comparable benchmark result. 1 of 8 categories are comparable. 19 results are unique to Gemma 4 26B A4B; 7 to Soofi S 30B-A3B.
Updated July 23, 2026- Shared results
- 1
- Gemma 4 26B A4B only
- 19
- Soofi S 30B-A3B only
- 7
- Comparable categories
- 1 / 8
Treat this as a split decision. Gemma 4 26B A4B makes more sense if you want the stronger reasoning-first profile; Soofi S 30B-A3B is the better fit if knowledge is the priority or you need the larger 1M context window.
Confidence note. This is a partial-evidence comparison with 1 shared benchmark result across 1 evidence category; 1 of 8 categories currently have scoreable aggregates for both models. Treat the verdict as directional until coverage is more balanced.
Why this result
Gemma 4 26B A4B and Soofi S 30B-A3B finish on the same BenchAlign overall score, so this is less about a single winner and more about where the edge shows up. The BenchAlign headline says tie; the benchmark table is where the real choice happens.
Gemma 4 26B A4B is the reasoning model in the pair, while Soofi S 30B-A3B is not. That usually helps on harder chain-of-thought-heavy tests, but it can also mean more latency and more token spend in real use. Soofi S 30B-A3B gives you the larger context window at 1M, compared with 256K for Gemma 4 26B A4B.
Category breakdown
Exact category averages are shown below. Not measured means BenchLM does not have enough sourced public coverage for that model and category.
| Category | Gemma 4 26B A4B | Δ | Soofi S 30B-A3B |
|---|---|---|---|
| Knowledge | Gemma 4 26B A4B43.4 | Margin→ 6.5 | Soofi S 30B-A3B49.9 |
| Multimodal | Gemma 4 26B A4B73.8 | MarginNo overlap | Soofi S 30B-A3BNot measured |
Decisive benchmark drivers
The largest measured benchmark gaps in this matchup, with exact reported values.
More
- Source ↗
MMLU-Pro
KnowledgeA 82.6%B 51.4%Winner: Gemma 4 26B A4BΔ 31.2MMLU-Pro: Gemma 4 26B A4B scored 82.6%; Soofi S 30B-A3B scored 51.4%. Gemma 4 26B A4B wins this benchmark.
Operational comparison
Runtime and commercial metrics are compared only when both models have a complete sourced value.
| Metric | Gemma 4 26B A4B | Soofi S 30B-A3B | Comparison |
|---|---|---|---|
| Input / output priceUSD per 1M tokens | Gemma 4 26B A4B$0 input / $0 output | Soofi S 30B-A3B$0 input / $0 output | Listed prices are equal. |
| Generation speedtokens per second | Gemma 4 26B A4BNot available | Soofi S 30B-A3BNot available | A complete speed comparison is not available. |
| First-answer latencyseconds to first token | Gemma 4 26B A4BNot available | Soofi S 30B-A3BNot available | A complete latency comparison is not available. |
| Context windowmaximum listed tokens | Gemma 4 26B A4B256K | Soofi S 30B-A3B1M | Soofi S 30B-A3B lists the larger context window. |
Benchmark Deep Dive
Agentic4 benchmarks
Coding3 benchmarks
Reasoning4 benchmarks
KnowledgeSoofi S 30B-A3B wins12 benchmarks
| Benchmark | Gemma 4 26B A4B | Soofi S 30B-A3B | Result |
|---|---|---|---|
| MMLU-ProSource | 82.6% | 51.4% | Gemma 4 26B A4B leads |
| HLESource | 17.2% | — | Not comparable |
| HLE w/o toolsSource | 8.7% | — | Not comparable |
| Artificial Analysis Intelligence IndexSource | 25.7% | — | Not comparable |
| AA-GPQA DiamondSource | 79.2% | — | Not comparable |
| AA-HLESource | 18.3% | — | Not comparable |
| AA-Omniscience IndexSource | -48.1% | — | Not comparable |
| AA-Omniscience AccuracySource | 18.2% | — | Not comparable |
| AA-Omniscience Hallucination RateSource | 80.9% | — | Not comparable |
| GPQASource | — | 43.4% | Not comparable |
| GPQA-DSource | — | 43.4% | Not comparable |
| AGIEvalSource | — | 66.9% | Not comparable |
Math1 benchmarks
| Benchmark | Gemma 4 26B A4B | Soofi S 30B-A3B | Result |
|---|---|---|---|
| GSM8KSource | — | 86.1% | Not comparable |
Multimodal2 benchmarks
Inst. Following1 benchmarks
| Benchmark | Gemma 4 26B A4B | Soofi S 30B-A3B | Result |
|---|---|---|---|
| AA-IFBenchSource | 72.4% | — | Not comparable |
Frequently Asked Questions (2)
Which is better, Gemma 4 26B A4B or Soofi S 30B-A3B?
Gemma 4 26B A4B and Soofi S 30B-A3B are tied on the BenchAlign overall score, so the right pick depends on which category matters most for your use case.
Which is better for knowledge tasks, Gemma 4 26B A4B or Soofi S 30B-A3B?
Soofi S 30B-A3B has the edge for knowledge tasks in this comparison, averaging 49.9 versus 43.4. Inside this category, MMLU-Pro is the benchmark that creates the most daylight between them.
Related Comparisons
Explore More
Choose a model with this week’s evidence
Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.
One email each week. Unsubscribe anytime.