Skip to main content

Model profile

Thinking Machines Inkling model

Data verified
Overall Score
67.54Public #20 of 200Verified #18 of 99
Arena Elo
1447
Eligible category ranks
5of 8
Price (1M tokens)
$1.87 in / $4.68 out
API pricing
Speed
Not listed
Context
1M

Evidence coverage

32 of 323 tracked benchmarks are published. 16 are verified and 16 provisional. 7 of 8 categories are measured.

Updated July 23, 2026Methodology
Published / tracked
32 / 323
Verified
16
Provisional
16
Categories with evidence
7 / 8

Evidence by category

  • Agentic9 benchmarks
    Mixed evidence
  • Coding5 benchmarks
    Mixed evidence
  • Reasoning2 benchmarks
    Reported
  • Knowledge10 benchmarks
    Mixed evidence
  • Math1 benchmark
    Verified
  • Multilingual0 benchmarks
    Not measured
  • Multimodal4 benchmarks
    Mixed evidence
  • Inst. Following1 benchmark
    Verified
Open WeightSelf-hostHybrid
Confidence:
High
base

Inkling ranks #20 out of 200 models on the public leaderboard with an overall score of 67.54/100. It also ranks #18 out of 99 on the verified leaderboard. This places it in the mid-tier of AI models, with strengths in specific benchmark categories.

Inkling is a open weight model with a 1M token context window. It processes queries without explicit chain-of-thought reasoning, offering faster response times and lower token usage.

This profile currently has 32 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.

Its strongest category is Instruction Following (#11), while its weakest is Coding (#92). This performance profile makes it a well-rounded choice across a range of tasks.

Peer position

Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.

Range 67.0167.78

  1. MiMo-V2-Pro
    Xiaomi
    #1767.78
    MiMo-V2-Pro is #17 with a score of 67.78.
    Compare
  2. GLM-5.1
    Z.AI
    #1867.74
    GLM-5.1 is #18 with a score of 67.74.
    Compare
  3. Gemini 3 Pro
    Google
    #1967.73
    Gemini 3 Pro is #19 with a score of 67.73.
    Compare
  4. InklingCurrent model
    Thinking Machines Lab
    #2067.54
    Inkling is #20 with a score of 67.54.
  5. Qwen3.7 Plus
    Alibaba
    #2167.22
    Qwen3.7 Plus is #21 with a score of 67.22.
    Compare
  6. GPT-5.6 Luna
    OpenAI
    #2267.17
    GPT-5.6 Luna is #22 with a score of 67.17.
    Compare
  7. GPT-5.2 Pro
    OpenAI
    #2367.01
    GPT-5.2 Pro is #23 with a score of 67.01.
    Compare

Category percentile

More

Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.

  1. Inst. Following67%
    Eligible cohort rank #11 of 31Category score 88.6
  2. Multimodal25%
    Eligible cohort rank #22 of 29Category score 52.0
  3. Knowledge55%
    Eligible cohort rank #24 of 52Category score 72.5
  4. Agentic42%
    Eligible cohort rank #69 of 119Category score 45.9
  5. Coding25%
    Eligible cohort rank #92 of 122Category score 45.4

Category evidence

Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.

Category scores, ranks, weighting, benchmark coverage, and evidence status
CategoryScore
AgenticRank #69 of 119Percentile 42ndWeight 22%9 benchmarksMixed sources45.9
CodingRank #92 of 122Percentile 25thWeight 20%5 benchmarksMixed sources45.4
ReasoningWeight 17%2 benchmarksReportedScore pending
KnowledgeRank #24 of 52Percentile 55thWeight 12%10 benchmarksMixed sources72.5
MathRank Not rankedWeight 5%1 benchmarkVerified79.0
MultilingualWeight 7%0 benchmarksNot measuredNot measured
MultimodalRank #22 of 29Percentile 25thWeight 12%4 benchmarksMixed sources52.0
Inst. FollowingRank #11 of 31Percentile 67thWeight 5%1 benchmarkVerified88.6

Chatbot Arena performance

Scroll horizontally to inspect confidence intervals and vote counts.

Chatbot Arena Elo, confidence interval, and vote count by evaluation view
ViewEloConfidence intervalVotes
Text Overall1447±8.84,641
Coding1500±16.31,376
Math1468±41.7180
Instruction Following1430±15.21,573
Creative Writing1392±21.0809
Multi-turn1460±21.8764
Hard Prompts1472±10.93,041
Hard Prompts (English)1478±16.91,216
Longer Query1450±13.72,040

Benchmark Details

Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.

Agentic9 benchmarks
Terminal-Bench 2.0Provider exact
63.8%Weighted 38%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 63.8% on Terminal-Bench 2.1 with the best harness. The source assigns zero to rollouts whose web search reveals solution contamination; BenchLM stores the result in the existing Terminal-Bench 2 slot until a separate 2.1 key exists.
BrowseCompProvider exact
77.1%Weighted 28%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 77.1% on BrowseComp with context management.
MCP AtlasProvider exact
74.1%Display only
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 74.1% on MCP Atlas.
Design Arena Agentic Web DevBenchmark exact

Design Arena Agentic Web Dev Elo

1257Display only
Source: Design Arena: Agentic Web Dev leaderboardProvenance: The live Design Arena API reports model ID camellia at 1257 Elo from 1,152 blinded battles. The official Design Arena registry maps camellia to the display name Inkling and provider Thinking Machines. BenchLM stores the current Elo as display-only.
AA Agentic IndexReported

Artificial Analysis Agentic Index

32.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
GDPval-AAReported

GDPval-AA normalized

36.9%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
GDPval-AAReported
1239Display only
Source: Artificial Analysis: gdpval-aa leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
AA BriefcaseReported

Artificial Analysis Briefcase

836Display only
Source: Artificial Analysis: aa-briefcase leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
AA Tau3 BankingReported

Artificial Analysis Tau3-Banking

23.7%Display only
Source: Artificial Analysis: tau3-banking leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
Coding5 benchmarks
SWE-bench VerifiedProvider exact

Software Engineering Benchmark Verified

77.6%Weighted 16%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 77.6% on SWE-bench Verified.
SWE-bench ProProvider exact
54.3%Weighted 10%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 54.3% on the public SWE-bench Pro split.
Terminal-Bench 2.0Provider exact
63.8%Display only
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 63.8% on Terminal-Bench 2.1 with the best harness. The source assigns zero to rollouts whose web search reveals solution contamination; BenchLM stores the result in the existing Terminal-Bench 2 slot until a separate 2.1 key exists.
AA Coding IndexReported

Artificial Analysis Coding Index

52.1%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-SciCodeReported

Artificial Analysis SciCode

46.1%Display only
Source: Artificial Analysis: scicode leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
Reasoning2 benchmarks
AA-LCRReported

Artificial Analysis Long Context Reasoning

63.3%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
CritPtReported

Critical Physics Tasks

5.4%Display only
Source: Artificial Analysis: critpt leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
Knowledge10 benchmarks
HLEProvider exact

Humanity's Last Exam

46%Weighted 45%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 46.0% on HLE with tools.
GPQAProvider exact

Graduate-Level Google-Proof Q&A

87.9%Weighted 7%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 87.9% on GPQA Diamond. BenchLM stores the exact result on both the weighted GPQA lane and the GPQA Diamond display key.
GPQA-DProvider exact

GPQA Diamond

87.9%Display only
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 87.9% on GPQA Diamond.
HLE w/o toolsProvider exact

Humanity's Last Exam without tools

30%Display only
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 30.0% on text-only HLE.
Artificial Analysis Intelligence IndexReported
40.7%Display only
Source: Artificial Analysis: artificial-analysis-intelligence-index leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
AA-GPQA DiamondReported

Artificial Analysis GPQA Diamond

87.2%Display only
Source: Artificial Analysis: gpqa-diamond leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
AA-HLEReported

Artificial Analysis Humanity's Last Exam

29.7%Display only
Source: Artificial Analysis: humanitys-last-exam leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
AA-Omniscience IndexReported

Artificial Analysis Omniscience Index

2.1%Display only
Source: Artificial Analysis: omniscience leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
AA-Omniscience AccuracyReported

Artificial Analysis Omniscience Accuracy

40.0%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
AA-Omniscience Hallucination RateReported

Artificial Analysis Omniscience Hallucination Rate

63.1%Display only
Source: Artificial Analysis model benchmarksProvenance: Display-only row synced from the current Artificial Analysis model payload. It is excluded from BenchLM weighted scoring.
Math1 benchmark
AIME26Provider exact

AIME 2026

97.1%Weighted 25%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 97.1% on AIME 2026.
Multimodal4 benchmarks
MMMU-ProProvider exact

Massive Multi-discipline Multimodal Understanding Pro

73.5%Weighted 45%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 73.5% on MMMU Pro Standard 10.
CharXivProvider exact

CharXiv Reasoning

82%Weighted 25%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 82.0% on CharXiv RQ with Python.
CharXiv w/o toolsProvider exact

CharXiv Reasoning without tools

78.1%Display only
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 78.1% on CharXiv RQ without Python.
AA-MMMU-ProReported

Artificial Analysis MMMU-Pro

73.5%Display only
Source: Artificial Analysis: mmmu-pro leaderboardProvenance: Display-only row synced from the current Artificial Analysis evaluation leaderboard. It is excluded from BenchLM weighted scoring.
Inst. Following1 benchmark
IFBenchProvider exact

Instruction Following Benchmark

79.8%Weighted 65%
Source: Thinking Machines Lab: Inkling launch postProvenance: Thinking Machines reports Inkling at effort=0.99 scoring 79.8% on IFBench.

Frequently Asked Questions

How does Inkling perform overall in AI benchmarks?

Inkling currently ranks #20 out of 200 models on BenchLM's provisional leaderboard with an overall score of 67.54. It also ranks #18 out of 99 on the verified leaderboard. It is created by Thinking Machines Lab. Its published context window is 1M.

Is Inkling good for knowledge and understanding?

Inkling ranks #24 out of 52 models in knowledge and understanding benchmarks with an average score of 72.5. There are stronger options in this category.

Is Inkling good for coding and programming?

Inkling ranks #92 out of 122 models in coding and programming benchmarks with an average score of 45.4. There are stronger options in this category.

Is Inkling good for mathematics?

Inkling has visible benchmark coverage in mathematics, but BenchLM does not currently assign it a global category rank there.

Is Inkling good for reasoning and logic?

Inkling has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.

Is Inkling good for agentic tool use and computer tasks?

Inkling ranks #69 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 45.9. There are stronger options in this category.

Is Inkling good for multimodal and grounded tasks?

Inkling ranks #22 out of 29 models in multimodal and grounded tasks benchmarks with an average score of 52. There are stronger options in this category.

Is Inkling good for instruction following?

Inkling ranks #11 out of 31 models in instruction following benchmarks with an average score of 88.6. There are stronger options in this category.

Is Inkling open source?

Yes, Inkling is an open weight model created by Thinking Machines Lab, meaning it can be downloaded and run locally or fine-tuned for specific use cases.

Does Inkling have full benchmark coverage on BenchLM?

Not yet. Inkling currently has 32 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.

What is the context window size of Inkling?

Inkling has a published context window of 1M, which determines how much text it can process in a single interaction.

Choose with this week’s evidence

Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.

Free. One email per week.