Skip to main content
benchlm.ai

SWE Multilingual

A multilingual software-engineering benchmark for real-world code issue resolution across multiple programming languages.

Benchmark score on SWE Multilingual — June 2, 2026

BenchLM mirrors the published score view for SWE Multilingual. Claude Opus 4.8 leads the public snapshot at 84.4% , followed by Composer 2.5 (79.8%) and Qwen3.7 Max (78.3%). BenchLM does not use these results to rank models overall.

1Closed

Claude Opus 4.8

Anthropic

84.4%
Overall 95Context 1M
2Closed

Composer 2.5

Cursor

79.8%
Overall —Context 200K
3Closed

Qwen3.7 Max

Alibaba

78.3%
Overall 91Context 1M
20 modelsCodingCurrentDisplay onlyUpdated June 2, 2026

The published SWE Multilingual snapshot is tightly clustered at the top: Claude Opus 4.8 sits at 84.4%, while the third row is only 6.1 points behind. The broader top-10 spread is 10.7 points, so the benchmark still separates strong models even when the leaders cluster.

20 models have been evaluated on SWE Multilingual. The benchmark falls in the Coding category. This category carries a 20% weight in BenchLM.ai's overall scoring system. SWE Multilingual is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About SWE Multilingual

Year

2026

Tasks

Multilingual software-engineering tasks

Format

Repository task completion

Difficulty

Professional software engineering

MiniMax reports SWE Multilingual as a coding benchmark focused on multilingual software-engineering tasks beyond single-language Python issue fixing.

MiniMax M2.7: Early Echoes of Self-Evolution

BenchLM freshness & provenance

Version

SWE Multilingual 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

Benchmark score table (20 models)

1
Claude Opus 4.8
84.4%
2
Composer 2.5
79.8%
3
Qwen3.7 Max
78.3%
4
Claude Opus 4.5
77.5%
5
Kimi K2.6
76.7%
6
MiniMax M2.7
76.5%
7
DeepSeek V4 Pro (Max)
76.2%
8
DeepSeek V4 Pro (High)
74.1%
9
Qwen3.6 Plus
73.8%
10
Composer 2
73.7%
11
DeepSeek V4 Flash (Max)
73.3%
12
GLM-5
73.3%
13
Kimi K2.5
73%
14
Qwen3.6-27B
71.3%
15
DeepSeek V4 Flash (High)
70.2%
16
DeepSeek V4 Pro
69.8%
17
DeepSeek V4 Flash
69.7%
18
Qwen3.6-35B-A3B
67.2%
19
Laguna M.1
63.1%
20
Laguna XS.2
57.7%

FAQ

What does SWE Multilingual measure?

A multilingual software-engineering benchmark for real-world code issue resolution across multiple programming languages.

Which model scores highest on SWE Multilingual?

Claude Opus 4.8 by Anthropic currently leads with a score of 84.4% on SWE Multilingual.

How many models are evaluated on SWE Multilingual?

20 AI models have been evaluated on SWE Multilingual on BenchLM.

Compare Top Models on SWE Multilingual

Claude Opus 4.8 vs Composer 2.5Composer 2.5 vs Qwen3.7 MaxQwen3.7 Max vs Claude Opus 4.5Claude Opus 4.5 vs Kimi K2.6
Last updated: June 2, 2026 · BenchLM version SWE Multilingual 2026

The AI models change fast. We track them for you.

For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.

Free. No spam. Unsubscribe anytime.