Vals.ai benchmark for evaluating whether models can build complete web applications from natural language specifications in a production-like development environment.
BenchLM mirrors the public Vals AI Vibe Code Bench v1.1 leaderboard captured from https://www.vals.ai/benchmarks/vibe-code and updated by Vals on May 28, 2026. The snapshot preserves overall scores, uncertainty, latency, cost-per-test metadata, and task-level scores where Vals publishes them.
Vibe Code Bench v1.1 is display only on BenchLM. Vals proprietary or Vals-hosted aggregate views are useful context, but BenchLM does not use them as weighted ranking inputs or as a replacement for benchmark-native source records.
BenchLM mirrors the published vibe code score view for Vibe Code Bench. Claude Opus 4.8 leads the public snapshot at 82.72% , followed by Claude Opus 4.7 (71.00%) and GPT-5.5 (69.85%). BenchLM does not use these results to rank models overall.
Claude Opus 4.8
Anthropic
anthropic/claude-opus-4-8
Claude Opus 4.7
Anthropic
anthropic/claude-opus-4-7
GPT-5.5
OpenAI
openai/gpt-5.5
The published Vibe Code Bench snapshot is tightly clustered at the top: Claude Opus 4.8 sits at 82.72%, while the third row is only 12.88 points behind. The broader top-10 spread is 32.79 points, so the benchmark still separates strong models even when the leaders cluster.
47 models have been evaluated on Vibe Code Bench. The benchmark falls in the Coding category. This category carries a 20% weight in BenchLM.ai's overall scoring system. Vibe Code Bench is currently displayed for reference but excluded from the scoring formula, so it does not directly affect overall rankings.
Year
2026
Tasks
End-to-end web application builds
Format
Full-stack app implementation benchmark
Difficulty
End-to-end software delivery
Vibe Code Bench v1.1 asks models to build full web apps with services such as Supabase, Stripe test mode, email, browsing, and file editing available. The score is overall application pass accuracy across private end-to-end app tasks.
Version
Vibe Code Bench 2026
Refresh cadence
Quarterly
Staleness state
Current
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Vals.ai benchmark for evaluating whether models can build complete web applications from natural language specifications in a production-like development environment.
Claude Opus 4.8 currently leads the published Vibe Code Bench snapshot with 82.72% vibe code score. BenchLM shows this benchmark for display only and does not use it in overall rankings.
47 AI models are included in BenchLM's mirrored Vibe Code Bench snapshot, based on the public leaderboard captured on May 28, 2026.
For engineers, researchers, and the plain curious — a weekly brief on new models, ranking shifts, and pricing changes.
Free. No spam. Unsubscribe anytime.