Skip to main content

Model profile

Granite-4.0-350M

IBMEstablishedReleased Oct 28, 2025
Data verified
Overall Score
38.32Public #181 of 200
Arena Elo
Not listed
Eligible category ranks
0of 8
Price (1M tokens)
$0 in / $0 out
API pricing
Speed
Not listed
Context
32K

Evidence coverage

11 of 323 tracked benchmarks are published. 0 are verified and 11 provisional. 5 of 8 categories are measured.

Updated July 23, 2026Methodology
Published / tracked
11 / 323
Verified
0
Provisional
11
Categories with evidence
5 / 8

Evidence by category

  • Agentic1 benchmark
    Reported
  • Coding1 benchmark
    Reported
  • Reasoning2 benchmarks
    Reported
  • Knowledge6 benchmarks
    Reported
  • Math0 benchmarks
    Not measured
  • Multilingual0 benchmarks
    Not measured
  • Multimodal0 benchmarks
    Not measured
  • Inst. Following1 benchmark
    Reported
Open WeightSelf-hostNon-Reasoning
Confidence:
Low
dense

Granite-4.0-350M ranks #181 out of 200 models on the public leaderboard with an overall score of 38.32/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.

Granite-4.0-350M is a open weight model with a 32K token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

Granite-4.0-350M sits inside the Granite 4.0 350M family alongside Granite-4.0-H-350M. This profile currently has 11 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Peer position

Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.

Range 37.8739.8

  1. Llama 4 Behemoth
    Meta
    #17639.8
    Llama 4 Behemoth is #176 with a score of 39.8.
    Compare
  2. Ministral 3 3B (Reasoning)
    Mistral
    #17739.52
    Ministral 3 3B (Reasoning) is #177 with a score of 39.52.
    Compare
  3. Mistral 8x7B v0.2
    Mistral
    #17839.13
    Mistral 8x7B v0.2 is #178 with a score of 39.13.
    Compare
  4. Grok Code Fast 1
    xAI
    #18038.64
    Grok Code Fast 1 is #180 with a score of 38.64.
    Compare
  5. Granite-4.0-350MCurrent model
    IBM
    #18138.32
    Granite-4.0-350M is #181 with a score of 38.32.
  6. Granite-4.0-H-350M
    IBM
    #18238.32
    Granite-4.0-H-350M is #182 with a score of 38.32.
    Compare
  7. GPT-4o mini
    OpenAI
    #18337.87
    GPT-4o mini is #183 with a score of 37.87.
    Compare

Category percentile

More

Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.

No eligible category percentile is available from the published evidence yet.

Category evidence

Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticWeight 22%1 benchmarkReportedScore pending
CodingWeight 20%1 benchmarkReportedScore pending
ReasoningWeight 17%2 benchmarksReportedScore pending
KnowledgeRank Not rankedWeight 12%6 benchmarksReported16.6
MathWeight 5%0 benchmarksNot measuredNot measured
MultilingualWeight 7%0 benchmarksNot measuredNot measured
MultimodalWeight 12%0 benchmarksNot measuredNot measured
Inst. FollowingRank Not rankedWeight 5%1 benchmarkReported61.6

Benchmark Details

Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.

Agentic1 benchmark
τ²-bench resultsReported

τ²-Bench Tool-Agent-User Evaluation

13.2%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Coding1 benchmark
AA-SciCodeReported

Artificial Analysis SciCode

0.9%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Reasoning2 benchmarks
AA-LCRReported

Artificial Analysis Long Context Reasoning

0.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
CritPtReported

Critical Physics Tasks

0.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Knowledge6 benchmarks
Artificial Analysis Intelligence IndexReported
1.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-GPQA DiamondReported

Artificial Analysis GPQA Diamond

20.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-HLEReported

Artificial Analysis Humanity's Last Exam

5.7%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience IndexReported

Artificial Analysis Omniscience Index

-72.1%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience AccuracyReported

Artificial Analysis Omniscience Accuracy

3.2%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience Hallucination RateReported

Artificial Analysis Omniscience Hallucination Rate

77.8%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Inst. Following1 benchmark
AA-IFBenchReported

Artificial Analysis IFBench

16.8%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.

Granite 4.0 350M Family

Dense

Frequently Asked Questions

How does Granite-4.0-350M perform overall in AI benchmarks?

Granite-4.0-350M has 11 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.

Is Granite-4.0-350M good for knowledge and understanding?

Granite-4.0-350M has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is Granite-4.0-350M good for coding and programming?

Granite-4.0-350M has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.

Is Granite-4.0-350M good for reasoning and logic?

Granite-4.0-350M has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.

Is Granite-4.0-350M good for agentic tool use and computer tasks?

Granite-4.0-350M has visible benchmark coverage in agentic tool use and computer tasks, but BenchLM does not currently assign it a global category rank there.

Is Granite-4.0-350M good for instruction following?

Granite-4.0-350M has visible benchmark coverage in instruction following, but BenchLM does not currently assign it a global category rank there.

Is Granite-4.0-350M open source?

Yes, Granite-4.0-350M is an open weight model created by IBM, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Which sibling models are related to Granite-4.0-350M?

Granite-4.0-350M belongs to the Granite 4.0 350M family. Related variants on BenchLM include Granite-4.0-H-350M.

Does Granite-4.0-350M have full benchmark coverage on BenchLM?

Not yet. Granite-4.0-350M currently has 11 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of Granite-4.0-350M?

Granite-4.0-350M has a published context window of 32K, which determines how much text it can process in a single interaction.

Last updated: July 23, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Choose with this week’s evidence

Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.

Free. One email per week.