Model profile
SWE-1.7
Evidence coverage
4 of 323 tracked benchmarks are published. 4 are verified and 0 provisional. 2 of 8 categories are measured.
- Published / tracked
- 4 / 323
- Verified
- 4
- Provisional
- 0
- Categories with evidence
- 2 / 8
Evidence by category
- Agentic1 benchmarkVerified
- Coding3 benchmarksVerified
- Reasoning0 benchmarksNot measured
- Knowledge0 benchmarksNot measured
- Math0 benchmarksNot measured
- Multilingual0 benchmarksNot measured
- Multimodal0 benchmarksNot measured
- Inst. Following0 benchmarksNot measured
BenchLM is tracking SWE-1.7, but this profile is currently excluded from the public leaderboard because it still lacks enough non-generated benchmark coverage to rank safely. Only non-generated public benchmark rows appear below.
SWE-1.7 is a proprietary model with a 256K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.
This profile currently has 4 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Agentic (#25). This performance profile makes it particularly useful for coding agents, browser research, and computer-use workflows.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 77.44–83.93
- Claude Mythos 5AnthropicCompare#183.93Claude Mythos 5 is #1 with a score of 83.93.
- Claude Fable 5AnthropicCompare#283.68Claude Fable 5 is #2 with a score of 83.68.
- GPT-5.6 SolOpenAICompare#381.96GPT-5.6 Sol is #3 with a score of 81.96.
- Kimi K3Moonshot AICompare#480.96Kimi K3 is #4 with a score of 80.96.
- Claude Opus 4.8AnthropicCompare#578.34Claude Opus 4.8 is #5 with a score of 78.34.
- Muse Spark 1.1MetaCompare#677.44Muse Spark 1.1 is #6 with a score of 77.44.
- SWE-1.7Current modelCognitionUnrankedNot measuredSWE-1.7 is Unranked with a score of Not measured.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
- Agentic80%Eligible cohort rank #25 of 119Category score 54.4
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank #25 of 119Percentile 80thWeight 22%1 benchmarkVerified | 54.4 | #25 of 119 | 80th | 22% | 1 benchmark | Verified |
| CodingWeight 20%3 benchmarksVerified | Score pending | Not ranked | Not available | 20% | 3 benchmarks | Verified |
| ReasoningWeight 17%0 benchmarksNot measured | Not measured | Not ranked | Not available | 17% | 0 benchmarks | Not measured |
| KnowledgeWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| MathWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
| MultilingualWeight 7%0 benchmarksNot measured | Not measured | Not ranked | Not available | 7% | 0 benchmarks | Not measured |
| MultimodalWeight 12%0 benchmarksNot measured | Not measured | Not ranked | Not available | 12% | 0 benchmarks | Not measured |
| Inst. FollowingWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Agentic1 benchmark
Coding3 benchmarks
Frequently Asked Questions
How does SWE-1.7 perform overall in AI benchmarks?
SWE-1.7 has 4 published benchmark scores on BenchLM, but it does not yet have enough non-generated coverage to receive a global overall rank.
Is SWE-1.7 good for coding and programming?
SWE-1.7 has visible benchmark coverage in coding and programming, but BenchLM does not currently assign it a global category rank there.
Is SWE-1.7 good for agentic tool use and computer tasks?
SWE-1.7 ranks #25 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 54.4. There are stronger options in this category.
Does SWE-1.7 have full benchmark coverage on BenchLM?
Not yet. SWE-1.7 currently has 4 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of SWE-1.7?
SWE-1.7 has a published context window of 256K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.