Model profile
LFM2.5-8B-A1B
Evidence coverage
17 of 323 tracked benchmarks are published. 9 are verified and 8 provisional. 6 of 8 categories are measured.
- Published / tracked
- 17 / 323
- Verified
- 9
- Provisional
- 8
- Categories with evidence
- 6 / 8
Evidence by category
- Agentic2 benchmarksVerified
- Coding1 benchmarkReported
- Reasoning2 benchmarksReported
- Knowledge6 benchmarksMixed evidence
- Math3 benchmarksVerified
- Multilingual0 benchmarksNot measured
- Multimodal0 benchmarksNot measured
- Inst. Following3 benchmarksMixed evidence
LFM2.5-8B-A1B ranks #166 out of 200 models on the public leaderboard with an overall score of 41.42/100. It does not yet have enough sourced coverage for BenchLM's verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
LFM2.5-8B-A1B is a open weight model with a 128K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.
This profile currently has 17 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Instruction Following (#24), while its weakest is Agentic (#68). This performance profile makes it a well-rounded choice across a range of tasks.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 41.13–42.06
- GPT-4.1 nanoOpenAICompare#16142.06GPT-4.1 nano is #161 with a score of 42.06.
- Gemma 4 E2BGoogleCompare#16241.82Gemma 4 E2B is #162 with a score of 41.82.
- Mistral Large 2MistralCompare#16341.77Mistral Large 2 is #163 with a score of 41.77.
- Gemma 3 27BGoogleCompare#16441.57Gemma 3 27B is #164 with a score of 41.57.
- GPT-4oOpenAICompare#16541.49GPT-4o is #165 with a score of 41.49.
- LFM2.5-8B-A1BCurrent modelLiquidAI#16641.42LFM2.5-8B-A1B is #166 with a score of 41.42.
- Claude 3 OpusAnthropicCompare#16841.13Claude 3 Opus is #168 with a score of 41.13.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
- Inst. Following23%Eligible cohort rank #24 of 31Category score 55.7
- Agentic43%Eligible cohort rank #68 of 119Category score 46.0
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank #68 of 119Percentile 43rdWeight 22%2 benchmarksVerified | 46.0 | #68 of 119 | 43rd | 22% | 2 benchmarks | Verified |
| CodingWeight 20%1 benchmarkReported | Score pending | Not ranked | Not available | 20% | 1 benchmark | Reported |
| ReasoningWeight 17%2 benchmarksReported | Score pending | Not ranked | Not available | 17% | 2 benchmarks | Reported |
| KnowledgeWeight 12%6 benchmarksMixed sources | Score pending | Not ranked | Not available | 12% | 6 benchmarks | Mixed sources |
| MathRank Not rankedWeight 5%3 benchmarksVerified | 27.8 | Not ranked | Not available | 5% | 3 benchmarks | Verified |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| Inst. FollowingRank #24 of 31Percentile 23rdWeight 5%3 benchmarksMixed sources | 55.7 | #24 of 31 | 23rd | 5% | 3 benchmarks | Mixed sources |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Agentic2 benchmarks
Berkeley Function Calling Leaderboard v4
τ²-Bench Tool-Agent-User Evaluation
Coding1 benchmark
Artificial Analysis SciCode
Reasoning2 benchmarks
Artificial Analysis Long Context Reasoning
Critical Physics Tasks
Knowledge6 benchmarks
Artificial Analysis GPQA Diamond
Artificial Analysis Humanity's Last Exam
Artificial Analysis Omniscience Index
Artificial Analysis Omniscience Accuracy
Artificial Analysis Omniscience Hallucination Rate
Math3 benchmarks
AIME 2026
MATH-500 Problem Set
American Invitational Mathematics Examination 2025
Inst. Following3 benchmarks
Instruction Following Benchmark
Instruction-Following Eval
Artificial Analysis IFBench
Frequently Asked Questions
How does LFM2.5-8B-A1B perform overall in AI benchmarks?
LFM2.5-8B-A1B has 17 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is LFM2.5-8B-A1B good for knowledge and understanding?
LFM2.5-8B-A1B has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.
Is LFM2.5-8B-A1B good for coding and programming?
LFM2.5-8B-A1B has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.
Is LFM2.5-8B-A1B good for mathematics?
LFM2.5-8B-A1B has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.
Is LFM2.5-8B-A1B good for reasoning and logic?
LFM2.5-8B-A1B has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.
Is LFM2.5-8B-A1B good for agentic tool use and computer tasks?
LFM2.5-8B-A1B ranks #68 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 46. There are stronger options in this category.
Is LFM2.5-8B-A1B good for instruction following?
LFM2.5-8B-A1B ranks #24 out of 31 models in instruction following benchmarks with an average score of 55.7. There are stronger options in this category.
Is LFM2.5-8B-A1B open source?
Yes, LFM2.5-8B-A1B is an open weight model created by LiquidAI, meaning it can be downloaded and run locally or fine-tuned for specific use cases.
Does LFM2.5-8B-A1B have full benchmark coverage on BenchLM?
Not yet. LFM2.5-8B-A1B currently has 17 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of LFM2.5-8B-A1B?
LFM2.5-8B-A1B has a published context window of 128K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.