Skip to main content

Model profile

Soofi S 30B-A3B

Data verified
Overall Score
Unranked
Arena Elo
Not listed
Eligible category ranks
0of 8
Price (1M tokens)
$0 in / $0 out
API pricing
Speed
Not listed
Context
1M

Evidence coverage

8 of 323 tracked benchmarks are published. 8 are verified and 0 provisional. 4 of 8 categories are measured.

Updated July 23, 2026Methodology
Published / tracked
8 / 323
Verified
8
Provisional
0
Categories with evidence
4 / 8

Evidence by category

  • Agentic0 benchmarks
    Not measured
  • Coding1 benchmark
    Verified
  • Reasoning2 benchmarks
    Verified
  • Knowledge4 benchmarks
    Verified
  • Math1 benchmark
    Verified
  • Multilingual0 benchmarks
    Not measured
  • Multimodal0 benchmarks
    Not measured
  • Inst. Following0 benchmarks
    Not measured
Open WeightSelf-hostNon-Reasoning
Confidence:
Low
base

BenchLM is tracking Soofi S 30B-A3B, but this profile is currently excluded from the public leaderboard because it still lacks enough non-generated benchmark coverage to rank safely. Only non-generated public benchmark rows appear below.

Soofi S 30B-A3B is a open weight model with a 1M token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

This profile currently has 8 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Peer position

Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.

Range 77.4483.93

  1. Claude Mythos 5
    Anthropic
    #183.93
    Claude Mythos 5 is #1 with a score of 83.93.
    Compare
  2. Claude Fable 5
    Anthropic
    #283.68
    Claude Fable 5 is #2 with a score of 83.68.
    Compare
  3. GPT-5.6 Sol
    OpenAI
    #381.96
    GPT-5.6 Sol is #3 with a score of 81.96.
    Compare
  4. Kimi K3
    Moonshot AI
    #480.96
    Kimi K3 is #4 with a score of 80.96.
    Compare
  5. Claude Opus 4.8
    Anthropic
    #578.34
    Claude Opus 4.8 is #5 with a score of 78.34.
    Compare
  6. Muse Spark 1.1
    Meta
    #677.44
    Muse Spark 1.1 is #6 with a score of 77.44.
    Compare
  7. Soofi S 30B-A3BCurrent model
    Soofi Project
    UnrankedNot measured
    Soofi S 30B-A3B is Unranked with a score of Not measured.

Category percentile

More

Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.

No eligible category percentile is available from the published evidence yet.

Category evidence

Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticWeight 22%0 benchmarksNot measuredNot measured
CodingWeight 20%1 benchmarkVerifiedScore pending
ReasoningWeight 17%2 benchmarksVerifiedScore pending
KnowledgeRank Not rankedWeight 12%4 benchmarksVerified41.3
MathWeight 5%1 benchmarkVerifiedScore pending
MultilingualWeight 7%0 benchmarksNot measuredNot measured
MultimodalWeight 12%0 benchmarksNot measuredNot measured
Inst. FollowingWeight 5%0 benchmarksNot measuredNot measured

Benchmark Details

Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.

Coding1 benchmark
HumanEvalProvider exact

Evaluating Large Language Models Trained on Code

73.8%Display only
Source: Soofi Project: Soofi S pretraining reportProvenance: Tables 4 and 5 report HumanEval pass@1 at 73.8 for the selected iter_1056000 Soofi S base checkpoint.
Reasoning2 benchmarks
BBHProvider exact

BIG-Bench Hard

78.8%Display only
Source: Soofi Project: Soofi S pretraining reportProvenance: Tables 4 and 5 report BBH with chain-of-thought at 78.8 for the selected iter_1056000 Soofi S base checkpoint.
DROPProvider exact

Discrete Reasoning Over Paragraphs

66.5%Display only
Source: Soofi Project: Soofi S pretraining reportProvenance: Tables 4 and 5 report DROP exact match at 66.5 for the selected iter_1056000 Soofi S base checkpoint.
Knowledge4 benchmarks
MMLU-ProProvider exact

Massive Multitask Language Understanding Professional

51.4%Weighted 30%
Source: Soofi Project: Soofi S pretraining reportProvenance: Tables 4 and 5 report MMLU-Pro at 51.4 for the selected iter_1056000 Soofi S base checkpoint.
GPQAProvider exact

Graduate-Level Google-Proof Q&A

43.4%Weighted 7%
Source: Soofi Project: Soofi S pretraining reportProvenance: Tables 4 and 5 report GPQA-Diamond at 43.4 for the selected iter_1056000 Soofi S base checkpoint. BenchLM maps it to both GPQA and GPQA-Diamond for comparison consistency.
GPQA-DProvider exact

GPQA Diamond

43.4%Display only
Source: Soofi Project: Soofi S pretraining reportProvenance: Tables 4 and 5 report GPQA-Diamond at 43.4 for the selected iter_1056000 Soofi S base checkpoint.
AGIEvalProvider exact
66.9%Display only
Source: Soofi Project: Soofi S pretraining reportProvenance: Tables 4 and 5 report AGIEval at 66.9 for the selected iter_1056000 Soofi S base checkpoint.
Math1 benchmark
GSM8KProvider exact

Grade School Math 8K

86.1%Display only
Source: Soofi Project: Soofi S pretraining reportProvenance: Tables 4 and 5 report GSM8K at 86.1 for the selected iter_1056000 Soofi S base checkpoint.

Frequently Asked Questions

How does Soofi S 30B-A3B perform overall in AI benchmarks?

Soofi S 30B-A3B has 8 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.

Is Soofi S 30B-A3B good for knowledge and understanding?

Soofi S 30B-A3B has visible benchmark coverage in knowledge and understanding, but BenchLM does not currently assign it a global category rank there.

Is Soofi S 30B-A3B good for coding and programming?

Soofi S 30B-A3B has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.

Is Soofi S 30B-A3B good for mathematics?

Soofi S 30B-A3B has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.

Is Soofi S 30B-A3B good for reasoning and logic?

Soofi S 30B-A3B has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.

Is Soofi S 30B-A3B open source?

Yes, Soofi S 30B-A3B is an open weight model created by Soofi Project, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Does Soofi S 30B-A3B have full benchmark coverage on BenchLM?

Not yet. Soofi S 30B-A3B currently has 8 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of Soofi S 30B-A3B?

Soofi S 30B-A3B has a published context window of 1M, which determines how much text it can process in a single interaction.

Last updated: July 23, 2026 · Runtime metrics stay blank until BenchLM has a sourced snapshot.

Choose with this week’s evidence

Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.

Free. One email per week.