Benchmark profile

SimpleVQA

A visual question answering benchmark focused on straightforward image-grounded understanding.

Data verified July 23, 2026

Benchmark score on SimpleVQA — July 23, 2026

BenchLM mirrors the published score view for SimpleVQA. Qwen3.7 Plus leads the public snapshot at 81.7% , followed by Step 3.7 Flash (79.2%) and Gemini 3.1 Pro (72.4%). BenchLM does not use these results to rank models overall.

1Closed

Qwen3.7 Plus

Alibaba

qwen3-7-plus

81.7%

Overall 67.22Context 1M

2Open

Step 3.7 Flash

StepFun

step-3-7-flash

79.2%

Overall 50.87Context 256K

3Closed

Gemini 3.1 Pro

Google

gemini-3-1-pro

72.4%

Overall 55.3Context 1M

8 modelsMultimodal & GroundedCurrentDisplay onlyUpdated July 23, 2026

Benchmark score table (8 models)

Score

Qwen3.7 PlusAlibaba · Closed

81.7%

Step 3.7 FlashStepFun · Open weight

79.2%

Gemini 3.1 ProGoogle · Closed

72.4%

Muse SparkMeta · Closed

71.3%

GPT-5.4OpenAI · Closed

61.1%

Qwen3.6-35B-A3BAlibaba · Open weight

58.9%

Grok 4.20xAI · Closed

57.4%

Qwen3.6-27BAlibaba · Open weight

56.1%

The published SimpleVQA snapshot places Qwen3.7 Plus first at 81.7%. The third row is 9.3 points behind. The broader top-10 range is 25.6 points, so the table still separates the published systems.

8 models have been evaluated on SimpleVQA. The benchmark falls in the Multimodal & Grounded category. This category carries a 12% weight in BenchLM.ai's overall scoring system. SimpleVQA is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.

About SimpleVQA

Year

2026

Tasks

Visual QA tasks

Format

Image-grounded question answering

Difficulty

General visual understanding

BenchLM uses SimpleVQA as a display-only visual QA reference rather than a weighted multimodal ranking input.

GLM-5V-Turbo

BenchLM freshness & provenance

Version

SimpleVQA 2026

Refresh cadence

Quarterly

Staleness state

Current

Question availability

Public benchmark set

CurrentDisplay only

BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.

FAQ

What does SimpleVQA measure?

A visual question answering benchmark focused on straightforward image-grounded understanding.

Which model scores highest on SimpleVQA?

Qwen3.7 Plus by Alibaba currently leads with a score of 81.7% on SimpleVQA.

How many models are evaluated on SimpleVQA?

8 AI models have been evaluated on SimpleVQA on BenchLM.

Compare Top Models on SimpleVQA

Qwen3.7 Plus vs Step 3.7 Flash Step 3.7 Flash vs Gemini 3.1 Pro Gemini 3.1 Pro vs Muse Spark Muse Spark vs GPT-5.4

Last updated: July 23, 2026 · BenchLM version SimpleVQA 2026

Choose a model with this week’s evidence

Join 2,000+ readers for ranking moves, pricing changes, and the claims that still need proof.

One email each week. Unsubscribe anytime.