Benchmark profile
SWE-bench Verified (mini-swe-agent-v2) (SWE-bench Verified*)
A display-only SWE-bench Verified reference from Arcee AI's Trinity-Large-Thinking comparison chart.
Data verifiedBenchmark score on SWE-bench Verified* — July 23, 2026
BenchLM mirrors the published score view for SWE-bench Verified*. Claude Opus 4.6 leads the public snapshot at 75.6% , followed by MiniMax M2.7 (75.4%) and GLM-5 (72.8%). BenchLM does not use these results to rank models overall.
Claude Opus 4.6
Anthropic
claude-opus-4-6
MiniMax M2.7
MiniMax
minimax-m2-7
GLM-5
Z.AI
glm-5
Benchmark score table (5 models)
ScoreThe published SWE-bench Verified* snapshot places Claude Opus 4.6 first at 75.6%. The third row is 2.8 points behind. The broader top-10 range is 12.4 points, so the table still separates the published systems.
5 models have been evaluated on SWE-bench Verified*. The benchmark falls in the Coding category. This category carries a 20% weight in BenchLM.ai's overall scoring system. SWE-bench Verified* is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
About SWE-bench Verified*
Year
2026
Tasks
Repository task completion
Format
Agent scaffold benchmark
Difficulty
Professional software engineering
BenchLM stores this chart-specific SWE-bench Verified row separately because Arcee notes all models were evaluated in mini-swe-agent-v2.
BenchLM freshness & provenance
Version
SWE-bench Verified* 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
FAQ
What does SWE-bench Verified* measure?
A display-only SWE-bench Verified reference from Arcee AI's Trinity-Large-Thinking comparison chart.
Which model scores highest on SWE-bench Verified*?
Claude Opus 4.6 by Anthropic currently leads with a score of 75.6% on SWE-bench Verified*.
How many models are evaluated on SWE-bench Verified*?
5 AI models have been evaluated on SWE-bench Verified* on BenchLM.
Compare Top Models on SWE-bench Verified*
Choose a model with this week’s evidence
Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.
One email each week. Unsubscribe anytime.