Model profile
Gemma 4 12B
Evidence coverage
23 of 323 tracked benchmarks are published. 11 are verified and 12 provisional. 7 of 8 categories are measured.
- Published / tracked
- 23 / 323
- Verified
- 11
- Provisional
- 12
- Categories with evidence
- 7 / 8
Evidence by category
- Agentic1 benchmarkReported
- Coding1 benchmarkReported
- Reasoning4 benchmarksMixed evidence
- Knowledge11 benchmarksMixed evidence
- Math1 benchmarkVerified
- Multilingual0 benchmarksNot measured
- Multimodal4 benchmarksMixed evidence
- Inst. Following1 benchmarkReported
Gemma 4 12B ranks #137 out of 200 models on the public leaderboard with an overall score of 47.29/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
Gemma 4 12B is a open weight model with a 256K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.
Gemma 4 12B sits inside the Gemma 4 family alongside Gemma 4 31B, Gemma 4 26B A4B, Gemma 4 E2B, Gemma 4 E4B. This profile currently has 23 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 47.2–47.74
- Claude 3.5 SonnetAnthropicCompare#13247.74Claude 3.5 Sonnet is #132 with a score of 47.74.
- GLM-4.5-AirZ.AICompare#13347.7GLM-4.5-Air is #133 with a score of 47.7.
- Qwen3.5 FlashAlibabaCompare#13447.65Qwen3.5 Flash is #134 with a score of 47.65.
- Command A+CohereCompare#13547.51Command A+ is #135 with a score of 47.51.
- o3-miniOpenAICompare#13647.41o3-mini is #136 with a score of 47.41.
- Gemma 4 12BCurrent modelGoogle#13747.29Gemma 4 12B is #137 with a score of 47.29.
- Qwen3.5 PlusAlibabaCompare#13847.2Qwen3.5 Plus is #138 with a score of 47.2.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticWeight 22%1 benchmarkReported | Score pending | Not ranked | Not available | 22% | 1 benchmark | Reported |
| CodingRank Not rankedWeight 20%1 benchmarkReported | 72.0 | Not ranked | Not available | 20% | 1 benchmark | Reported |
| ReasoningRank Not rankedWeight 17%4 benchmarksMixed sources | 24.0 | Not ranked | Not available | 17% | 4 benchmarks | Mixed sources |
| KnowledgeRank Not rankedWeight 12%11 benchmarksMixed sources | 70.5 | Not ranked | Not available | 12% | 11 benchmarks | Mixed sources |
| MathRank Not rankedWeight 5%1 benchmarkVerified | 57.7 | Not ranked | Not available | 5% | 1 benchmark | Verified |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalRank Not rankedWeight 12%4 benchmarksMixed sources | 27.7 | Not ranked | Not available | 12% | 4 benchmarks | Mixed sources |
| Inst. FollowingWeight 5%1 benchmarkReported | Score pending | Not ranked | Not available | 5% | 1 benchmark | Reported |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Agentic1 benchmark
τ²-Bench Tool-Agent-User Evaluation
Coding1 benchmark
Artificial Analysis SciCode
Reasoning4 benchmarks
BIG-Bench Hard
Artificial Analysis Long Context Reasoning
Critical Physics Tasks
Knowledge11 benchmarks
Massive Multitask Language Understanding Professional
Graduate-Level Google-Proof Q&A
GPQA Diamond
Humanity's Last Exam without tools
Artificial Analysis GPQA Diamond
Artificial Analysis Humanity's Last Exam
Artificial Analysis Omniscience Index
Artificial Analysis Omniscience Accuracy
Artificial Analysis Omniscience Hallucination Rate
Math1 benchmark
AIME 2026
Multimodal4 benchmarks
Massive Multi-discipline Multimodal Understanding Pro
MedXpertQA Multimodal
Artificial Analysis MMMU-Pro
Inst. Following1 benchmark
Artificial Analysis IFBench
Frequently Asked Questions
How does Gemma 4 12B perform overall in AI benchmarks?
Gemma 4 12B has 23 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is Gemma 4 12B good for knowledge and understanding?
Gemma 4 12B has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.
Is Gemma 4 12B good for coding and programming?
Gemma 4 12B has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.
Is Gemma 4 12B good for mathematics?
Gemma 4 12B has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.
Is Gemma 4 12B good for reasoning and logic?
Gemma 4 12B has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.
Is Gemma 4 12B good for agentic tool use and computer tasks?
Gemma 4 12B has visible benchmark coverage in agentic tool use and computer tasks, but BenchLM does not currently assign it a global category rank there.
Is Gemma 4 12B good for multimodal and grounded tasks?
Gemma 4 12B has visible benchmark coverage in multimodal and grounded tasks, but BenchLM does not currently assign it a global category rank there.
Is Gemma 4 12B good for instruction following?
Gemma 4 12B has visible benchmark coverage in instruction following, but BenchLM does not currently assign it a global category rank there.
Is Gemma 4 12B open source?
Yes, Gemma 4 12B is an open weight model created by Google, meaning it can be downloaded and run locally or fine-tuned for specific use cases.
Which sibling models are related to Gemma 4 12B?
Gemma 4 12B belongs to the Gemma 4 family. Related variants on BenchLM include Gemma 4 31B, Gemma 4 26B A4B, Gemma 4 E2B, Gemma 4 E4B.
Does Gemma 4 12B have full benchmark coverage on BenchLM?
Not yet. Gemma 4 12B currently has 23 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Gemma 4 12B?
Gemma 4 12B has a published context window of 256K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.