Model profile
Qwen3.5-27B
Evidence coverage
28 of 323 tracked benchmarks are published. 14 are verified and 14 provisional. 7 of 8 categories are measured.
- Published / tracked
- 28 / 323
- Verified
- 14
- Provisional
- 14
- Categories with evidence
- 7 / 8
Evidence by category
- Agentic5 benchmarksMixed evidence
- Coding3 benchmarksMixed evidence
- Reasoning3 benchmarksMixed evidence
- Knowledge9 benchmarksMixed evidence
- Math0 benchmarksNot measured
- Multilingual1 benchmarkVerified
- Multimodal5 benchmarksMixed evidence
- Inst. Following2 benchmarksMixed evidence
Qwen3.5-27B ranks #45 out of 200 models on the public leaderboard with an overall score of 60.7/100. It also ranks #34 out of 99 on the verified leaderboard. While not a frontier model, it offers specific advantages depending on the use case.
Qwen3.5-27B is a open weight model with a 262K token context window. It uses explicit chain-of-thought reasoning, which typically improves performance on math and complex reasoning tasks at the cost of higher latency and token usage.
This profile currently has 28 of 323 tracked benchmarks. BenchLM only exposes non-generated benchmark rows publicly, so missing categories stay blank until a sourced evaluation is available.
Its strongest category is Instruction Following (#2), while its weakest is Agentic (#57). This performance profile makes it a well-rounded choice across a range of tasks.
Peer position
Exact provisional scores and ranks for the closest listed peers. A score can appear before a model clears the evidence threshold for a rank, so equal scores can have different rank states.
Range 60.42–60.89
- GPT-5.4 ProOpenAICompare#4460.89GPT-5.4 Pro is #44 with a score of 60.89.
- Qwen3.5-27BCurrent modelAlibaba#4560.7Qwen3.5-27B is #45 with a score of 60.7.
- DeepSeek V4 ProDeepSeekCompare#4660.66DeepSeek V4 Pro is #46 with a score of 60.66.
- Qwen3.5-122B-A10BAlibabaCompare#4760.56Qwen3.5-122B-A10B is #47 with a score of 60.56.
- Grok 4.1 Fast (Reasoning)xAICompare#4860.51Grok 4.1 Fast (Reasoning) is #48 with a score of 60.51.
- Gemini 3 FlashGoogleCompare#4960.49Gemini 3 Flash is #49 with a score of 60.49.
- Grok 4xAICompare#5060.42Grok 4 is #50 with a score of 60.42.
Category percentile
More
Relative position among models eligible for each sourced category. A higher percentile means a stronger position within that category's ranked cohort; 100 is highest.
- Inst. Following97%Eligible cohort rank #2 of 31Category score 93.0
- Multilingual25%Eligible cohort rank #10 of 13Category score 36.8
- Knowledge69%Eligible cohort rank #17 of 52Category score 76.5
- Multimodal4%Eligible cohort rank #28 of 29Category score 0.0
- Coding74%Eligible cohort rank #33 of 122Category score 55.7
- Agentic53%Eligible cohort rank #57 of 119Category score 48.5
Category evidence
Scores and ranks appear only where this model has published benchmark evidence. Categories without displayable source records remain not measured.
| Category | Score | Rank | Percentile | Weight | Benchmarks | Evidence |
|---|---|---|---|---|---|---|
| AgenticRank #57 of 119Percentile 53rdWeight 22%5 benchmarksMixed sources | 48.5 | #57 of 119 | 53rd | 22% | 5 benchmarks | Mixed sources |
| CodingRank #33 of 122Percentile 74thWeight 20%3 benchmarksMixed sources | 55.7 | #33 of 122 | 74th | 20% | 3 benchmarks | Mixed sources |
| ReasoningRank Not rankedWeight 17%3 benchmarksMixed sources | 77.6 | Not ranked | Not available | 17% | 3 benchmarks | Mixed sources |
| KnowledgeRank #17 of 52Percentile 69thWeight 12%9 benchmarksMixed sources | 76.5 | #17 of 52 | 69th | 12% | 9 benchmarks | Mixed sources |
| MathWeight 5%0 benchmarksNot measured | Not measured | Not ranked | Not available | 5% | 0 benchmarks | Not measured |
| MultilingualRank #10 of 13Percentile 25thWeight 7%1 benchmarkVerified | 36.8 | #10 of 13 | 25th | 7% | 1 benchmark | Verified |
| MultimodalRank #28 of 29Percentile 4thWeight 12%5 benchmarksMixed sources | 0.0 | #28 of 29 | 4th | 12% | 5 benchmarks | Mixed sources |
| Inst. FollowingRank #2 of 31Percentile 97thWeight 5%2 benchmarksMixed sources | 93.0 | #2 of 31 | 97th | 5% | 2 benchmarks | Mixed sources |
Chatbot Arena performance
Scroll horizontally to inspect confidence intervals and vote counts.
| View | Elo | Confidence interval | Votes |
|---|---|---|---|
| Text Overall | 1409 | ±4.4 | 27,308 |
| Coding | 1450 | ±7.4 | 7,522 |
| Math | 1429 | ±14.6 | 1,648 |
| Instruction Following | 1401 | ±6.9 | 8,562 |
| Creative Writing | 1358 | ±9.8 | 4,058 |
| Multi-turn | 1416 | ±9.2 | 4,592 |
| Hard Prompts | 1427 | ±5.4 | 17,030 |
| Hard Prompts (English) | 1441 | ±7.0 | 8,445 |
| Longer Query | 1423 | ±6.7 | 10,210 |
Benchmark Details
Rows below have a displayable published verification record. Each source link and provenance note remains in the page HTML while its category is closed. Source-unverified manual rows and generated rows stay hidden.
Agentic5 benchmarks
τ²-Bench Tool-Agent-User Evaluation
Gert Labs Composite Game Benchmark
Coding3 benchmarks
Software Engineering Benchmark Verified
Artificial Analysis SciCode
Reasoning3 benchmarks
Artificial Analysis Long Context Reasoning
Critical Physics Tasks
Knowledge9 benchmarks
Massive Multitask Language Understanding Professional
SuperGPQA: Scaling LLM Evaluation Across 285 Graduate Disciplines
Graduate-Level Google-Proof Q&A
Artificial Analysis GPQA Diamond
Artificial Analysis Humanity's Last Exam
Artificial Analysis Omniscience Index
Artificial Analysis Omniscience Accuracy
Artificial Analysis Omniscience Hallucination Rate
Multilingual1 benchmark
Multimodal5 benchmarks
Massive Multi-discipline Multimodal Understanding
Multimodal Multi-disciplinary Video Understanding
Artificial Analysis MMMU-Pro
Inst. Following2 benchmarks
Instruction-Following Eval
Artificial Analysis IFBench
Frequently Asked Questions
How does Qwen3.5-27B perform overall in AI benchmarks?
Qwen3.5-27B currently ranks #45 out of 200 models on BenchLM's provisional leaderboard with an overall score of 60.7. It also ranks #34 out of 99 on the verified leaderboard. It is created by Alibaba. Its published context window is 262K.
Is Qwen3.5-27B good for knowledge and understanding?
Qwen3.5-27B ranks #17 out of 52 models in knowledge and understanding benchmarks with an average score of 76.5. There are stronger options in this category.
Is Qwen3.5-27B good for coding and programming?
Qwen3.5-27B ranks #33 out of 122 models in coding and programming benchmarks with an average score of 55.7. There are stronger options in this category.
Is Qwen3.5-27B good for reasoning and logic?
Qwen3.5-27B has visible benchmark coverage in reasoning and logic, but BenchLM does not currently assign it a global category rank there.
Is Qwen3.5-27B good for agentic tool use and computer tasks?
Qwen3.5-27B ranks #57 out of 119 models in agentic tool use and computer tasks benchmarks with an average score of 48.5. There are stronger options in this category.
Is Qwen3.5-27B good for multimodal and grounded tasks?
Qwen3.5-27B ranks #28 out of 29 models in multimodal and grounded tasks benchmarks with an average score of 0. There are stronger options in this category.
Is Qwen3.5-27B good for instruction following?
Qwen3.5-27B ranks #2 out of 31 models in instruction following benchmarks with an average score of 93. It is among the top performers in this category.
Is Qwen3.5-27B good for multilingual tasks?
Qwen3.5-27B ranks #10 out of 13 models in multilingual tasks benchmarks with an average score of 36.8. It is among the top performers in this category.
Is Qwen3.5-27B open source?
Yes, Qwen3.5-27B is an open weight model created by Alibaba, meaning it can be downloaded and run locally or fine-tuned for specific use cases.
Does Qwen3.5-27B have full benchmark coverage on BenchLM?
Not yet. Qwen3.5-27B currently has 28 published benchmark scores out of the 323 benchmarks BenchLM tracks. BenchLM only exposes non-generated public benchmark rows, so missing categories stay blank until a sourced evaluation is available.
What is the context window size of Qwen3.5-27B?
Qwen3.5-27B has a published context window of 262K, which determines how much text it can process in a single interaction.
Related Resources
Choose with this week’s evidence
Join 2,000+ readers for ranking moves, new releases, pricing changes, and the evidence behind them.
Free. One email per week.