Model profile
Mercury 2
Evidence coverage
0 of 323 tracked benchmarks are published. 0 are verified and 0 provisional. 0 of 8 categories are measured.
- Published / tracked
- 0 / 323
- Verified
- 0
- Provisional
- 0
- Categories with evidence
- 0 / 8
Evidence by category
- Agentic0 benchmarksNot measured
- Coding0 benchmarksNot measured
- Reasoning0 benchmarksNot measured
- Knowledge0 benchmarksNot measured
- Math0 benchmarksNot measured
- Multilingual0 benchmarksNot measured
- Multimodal0 benchmarksNot measured
- Inst. Following0 benchmarksNot measured
BenchLM is tracking Mercury 2, but sourced benchmark results are not published on the site yet. This page currently shows the model metadata we can verify now, and score-level benchmark coverage will appear once public evaluations land.
Mercury 2 is a proprietary model with a 128K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.
This profile does not yet have sourced benchmarks on BenchLM, so the benchmark sections below are intentionally marked as coming soon.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 50.97–51.67
- DeepSeek-R1DeepSeekCompare#10351.67DeepSeek-R1 is #103 with a score of 51.67.
- Qwen3.6-35B-A3BAlibabaCompare#10451.47Qwen3.6-35B-A3B is #104 with a score of 51.47.
- Mercury 2Current modelInception#10551.28Mercury 2 is #105 with a score of 51.28.
- GLM-4.7-FlashZ.AICompare#10651.25GLM-4.7-Flash is #106 with a score of 51.25.
- Grok 4.1 FastxAICompare#10751.25Grok 4.1 Fast is #107 with a score of 51.25.
- GPT-4.1OpenAICompare#10851.11GPT-4.1 is #108 with a score of 51.11.
- Nemotron 3 Super 120B A12BNVIDIACompare#10950.97Nemotron 3 Super 120B A12B is #109 with a score of 50.97.
Benchmark data coming soon
BenchLM has created this model profile, but no sourced benchmark rows are published here yet. Category charts, rankings, and score tables will appear after public evaluations are available and attached to source records.
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticWeight 22%0 benchmarksNot measured | Not measured | Not ranked | Not available | 22% | 0 benchmarks | Not measured |
| CodingWeight 20%0 benchmarksNot measured | Not measured | Not ranked | Not available | 20% | 0 benchmarks | Not measured |
| ReasoningWeight 17%0 benchmarksNot measured | Not measured | Not ranked | Not available | 17% | 0 benchmarks | Not measured |
| KnowledgeWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| MathWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| Inst. FollowingWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
Chatbot Arena performance
Scroll horizontally to inspect confidence intervals and vote counts.
| View | Elo | Confidence interval | Votes |
|---|---|---|---|
| Text Overall | 1347 | ±10.6 | 3,118 |
| Coding | 1397 | ±20.8 | 770 |
| Instruction Following | 1323 | ±20.1 | 837 |
| Creative Writing | 1299 | ±26.5 | 528 |
| Multi-turn | 1344 | ±25.5 | 538 |
| Hard Prompts | 1359 | ±13.8 | 1,760 |
| Hard Prompts (English) | 1372 | ±19.7 | 862 |
| Longer Query | 1324 | ±20.4 | 842 |
Frequently Asked Questions
How does Mercury 2 perform overall in AI benchmarks?
We are tracking Mercury 2, but sourced benchmark coverage is still coming soon. The profile lists only the model metadata that has a verified public source.
Does Mercury 2 have full benchmark coverage on BenchLM?
Not yet. Mercury 2 currently has 0 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Mercury 2?
Mercury 2 has a published context window of 128K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.