Graduate-Level Google-Proof Q&A (GPQA)
GPT-6 Astra leads the GPQA leaderboard on BenchLM's October 2026 update with 96%, ahead of Sakana Fugu-Ultra (95.5%) and Sakana Fugu (95.5%), across 145 models.
A challenging dataset of 448 multiple-choice questions written by domain experts in biology, physics, and chemistry. Designed to be difficult even for skilled non-experts with access to Google.
Top models on GPQA — October 25, 2026
As of October 25, 2026, GPT-6 Astra leads the GPQA leaderboard with 96% , followed by Sakana Fugu-Ultra (95.5%) and Sakana Fugu (95.5%).
GPT-6 Astra
OpenAI
Sakana Fugu-Ultra
Sakana AI
Sakana Fugu
Sakana AI
145 modelsKnowledgeGPQA follows the active BenchAlign v5.8 policy.MethodologyRefreshingUpdated October 25, 2026
Leaderboard (145 models)
| Rank | Model / configuration | Score | Parameters (B) | Open / closed |
|---|---|---|---|---|
| 1 | GPT-6 AstraOpenAI | 96% | Not reported | Closed |
| 2 | Sakana Fugu-UltraSakana AI | 95.5% | Not reported | Closed |
| 3 | Sakana FuguSakana AI | 95.5% | Not reported | Closed |
| 4 | GPT-5.6 SolOpenAI | 94.6% | Not reported | Closed |
| 5 | Claude Opus 4.7 (Adaptive)Anthropic | 94.2% | Not reported | Closed |
| 6 | Kimi K3.1 ProMoonshot AI | 94.2% | Not reported | Pending |
| 7 | Claude Mythos 5Anthropic | 94.1% | Not reported | Closed |
| 8 | Claude Opus 4.8Anthropic | 93.6% | Not reported | Closed |
| 9 | GPT-5.5OpenAI | 93.6% | Not reported | Closed |
| 10 | Kimi K3Moonshot AI | 93.5% | Not reported | Pending |
| 11 | GPT-5.6 TerraOpenAI | 92.9% | Not reported | Closed |
| 12 | GPT-5.4OpenAI | 92.8% | Not reported | Closed |
| 13 | Ornith-1.5-397BOrnith AI | 92.8% | Not reported | Open |
| 14 | Qwen3.8 MaxAlibaba | 92.6% | Not reported | Open |
| 15 | Qwen3.7 MaxAlibaba | 92.4% | Not reported | Closed |
| 16 | GPT-5.2OpenAI | 92.4% | Not reported | Closed |
| 17 | GPT-5.6 LunaOpenAI | 92.3% | Not reported | Closed |
| 18 | Hy4 previewTencent | 92.3% | Not reported | Open |
| 19 | Gemini 3.5 FlashGoogle | 92.2% | Not reported | Closed |
| 20 | Qwen3.8-Flash-NextAlibaba | 91.7% | Not reported | Open |
| 21 | Claude Opus 4.6Anthropic | 91.3% | Not reported | Closed |
| 22 | GLM-5.2Z.AI | 91.2% | Not reported | Open |
| 23 | Qwen3.8-Omni-FlashAlibaba | 91% | Not reported | Closed |
| 24 | DeepSeek V4.1 Flash 1017DeepSeek | 90.9% | Not reported | Open |
| 25 | Kimi K2.6Moonshot AI | 90.5% | Not reported | Open |
| 26 | Qwen3.6 PlusAlibaba | 90.4% | Not reported | Closed |
| 27 | Qwen3.7 PlusAlibaba | 90.3% | Not reported | Closed |
| 28 | DeepSeek V4 Pro 0813DeepSeek | 90.1% | Not reported | Open |
| 29 | Grok 4.3xAI | 90.1% | Not reported | Closed |
| 30 | Claude Sonnet 4.6Anthropic | 89.9% | Not reported | Closed |
| 31 | Interfaze BetaInterfaze | 89.9% | Not reported | Closed |
| 32 | Inkling-SmallThinking Machines Lab | 89.5% | Not reported | Open |
| 33 | Qwen3.8-27BAlibaba | 89.2% | Not reported | Open |
| 34 | Ornith-1.5-35B-A3BOrnith AI | 89.2% | Not reported | Open |
| 35 | DeepSeek V4 Pro (High)DeepSeek | 89.1% | Not reported | Open |
| 36 | Qwen3.5 397BAlibaba | 88.4% | Not reported | Open |
| 37 | DeepSeek V4 Flash 0731DeepSeek | 88.1% | Not reported | Open |
| 38 | GPT-5.4 miniOpenAI | 88% | Not reported | Closed |
| 39 | InklingThinking Machines Lab | 87.9% | Not reported | Open |
| 40 | Qwen3.6-27BAlibaba | 87.8% | Not reported | Open |
| 41 | Kimi K2.5 (Reasoning)Moonshot AI | 87.6% | Not reported | Closed |
| 42 | Kimi K2.5Moonshot AI | 87.6% | Not reported | Open |
| 43 | DeepSeek V4 Flash (High)DeepSeek | 87.4% | Not reported | Open |
| 44 | Hy3 PreviewTencent | 87.2% | Not reported | Open |
| 45 | Claude Opus 4.5Anthropic | 87% | Not reported | Closed |
| 46 | Nemotron 3 UltraNVIDIA | 87% | Not reported | Open |
| 47 | Qwen3.5-122B-A10BAlibaba | 86.6% | Not reported | Open |
| 48 | Ornith-1.5-9BOrnith AI | 86.4% | Not reported | Open |
| 49 | GLM-5Z.AI | 86% | Not reported | Open |
| 50 | Qwen3.6-35B-A3BAlibaba | 86% | Not reported | Open |
| 51 | Ternary Bonsai 2 27BPrism ML | 85.8% | Not reported | Open |
| 52 | GLM-4.7Z.AI | 85.7% | Not reported | Open |
| 53 | Qwen3.5-27BAlibaba | 85.5% | Not reported | Open |
| 54 | Ling 3.0 FlashInclusionAI | 85.0% | Not reported | Open |
| 55 | Gemma 4 31BGoogle | 84.3% | Not reported | Open |
| 56 | Qwen3.5-35B-A3BAlibaba | 84.2% | Not reported | Open |
| 57 | MAI-Thinking-1Microsoft | 84.2% | Not reported | Closed |
| 58 | Ling 3.0 Flash FP8InclusionAI | 84% | Not reported | Open |
| 59 | MiMo-V2-FlashXiaomi | 83.7% | Not reported | Open |
| 60 | Claude Sonnet 4.5Anthropic | 83.4% | Not reported | Closed |
| 61 | Gemini 2.5 ProGoogle | 83% | Not reported | Closed |
| 62 | GPT-5.4 nanoOpenAI | 82.8% | Not reported | Closed |
| 63 | Gemma 4 26B A4BGoogle | 82.3% | Not reported | Open |
| 64 | Qwen3 235B 2507 (Reasoning)Alibaba | 81.1% | Not reported | Open |
| 65 | DeepSeek-R1-0528DeepSeek | 81% | Not reported | Open |
| 66 | Grok 3 MinixAI | 80.3% | Not reported | Closed |
| 67 | DeepSeek V3.1 (Reasoning)DeepSeek | 80.1% | Not reported | Open |
| 68 | GPT-OSS 120BOpenAI | 80.1% | Not reported | Open |
| 69 | Claude 4 Opus ThinkingAnthropic | 79.6% | Not reported | Closed |
| 70 | Nemotron 3 Super 100BNVIDIA | 79.2% | Not reported | Open |
| 71 | o1-proOpenAI | 79% | Not reported | Closed |
| 72 | Gemma 4 12BGoogle | 78.8% | Not reported | Open |
| 73 | Claude 3.7 Sonnet ThinkingAnthropic | 78.2% | Not reported | Closed |
| 74 | o4-miniOpenAI | 77.6% | Not reported | Closed |
| 75 | Qwen3 235B 2507Alibaba | 77.5% | Not reported | Open |
| 76 | o3-miniOpenAI | 77.2% | Not reported | Closed |
| 77 | Nemotron Ultra 253BNVIDIA | 76.0% | Not reported | Open |
| 78 | o1OpenAI | 75.7% | Not reported | Closed |
| 79 | Nemotron 3.5 Lightning 30B A3B NVFP4NVIDIA | 75.6% | Not reported | Open |
| 80 | Grok 3 [Beta]xAI | 75.4% | Not reported | Closed |
| 81 | GLM-4.7-FlashZ.AI | 75.2% | Not reported | Open |
| 82 | Kimi K2Moonshot AI | 75.1% | Not reported | Closed |
| 83 | Claude 4 OpusAnthropic | 74.9% | Not reported | Closed |
| 84 | DeepSeek V3.1DeepSeek | 74.9% | Not reported | Open |
| 85 | LFM2.5-24B-A2BLiquidAI | 74.4% | Not reported | Open |
| 86 | Mercury 2Inception | 73.6% | Not reported | Closed |
| 87 | Nemotron 3 Nano 30BNVIDIA | 73% | Not reported | Open |
| 88 | DeepSeek V4 ProDeepSeek | 72.9% | Not reported | Open |
| 89 | Nemotron 3 Nano Omni 30B A3BNVIDIA | 72.2% | Not reported | Open |
| 90 | DeepSeek-R1DeepSeek | 71.5% | Not reported | Open |
| 91 | GPT-OSS 20BOpenAI | 71.5% | Not reported | Open |
| 92 | Ministral 3 14B (Reasoning)Mistral | 71.2% | Not reported | Open |
| 93 | DeepSeek V4 FlashDeepSeek | 71.2% | Not reported | Open |
| 94 | GPT-5 nanoOpenAI | 71.2% | Not reported | Closed |
| 95 | Qwen3 235B-A22B (Reasoning)Alibaba | 71.1% | Not reported | Open |
| 96 | ZAYA1-8BZyphra | 71% | Not reported | Open |
| 97 | Magistral MediumMistral | 70.8% | Not reported | Closed |
| 98 | Spark-X2.6-4BSparkLLM | 69.9% | Not reported | Open |
| 99 | GPT-4.5OpenAI | 69.5% | Not reported | Closed |
| 100 | Phi-4-reasoning-plusMicrosoft | 68.9% | Not reported | Open |
| 101 | Qwen3 32B (Reasoning)Alibaba | 68.4% | Not reported | Open |
| 102 | Magistral SmallMistral | 68.2% | Not reported | Open |
| 103 | Claude 3.7 SonnetAnthropic | 68% | Not reported | Closed |
| 104 | Granite 4.2 30BIBM | 66.4% | Not reported | Open |
| 105 | GPT-4.1OpenAI | 66.3% | Not reported | Closed |
| 106 | Phi-4-reasoningMicrosoft | 65.8% | Not reported | Open |
| 107 | QwQ-32BAlibaba | 65.6% | Not reported | Open |
| 108 | Gemini 2.0 FlashGoogle | 65.2% | Not reported | Closed |
| 109 | Gemini 2.5 Flash-LiteGoogle | 64.6% | Not reported | Closed |
| 110 | GPT-4.1 miniOpenAI | 64.2% | Not reported | Closed |
| 111 | Granite 4.2 8BIBM | 64.1% | Not reported | Open |
| 112 | Qwen3 235B-A22BAlibaba | 62.9% | Not reported | Open |
| 113 | Qwen2.5-MaxAlibaba | 60.1% | Not reported | Closed |
| 114 | o1-miniOpenAI | 60% | Not reported | Closed |
| 115 | Claude 3.5 SonnetAnthropic | 59.4% | Not reported | Closed |
| 116 | DeepSeek V3DeepSeek | 59.1% | Not reported | Open |
| 117 | Ling 2.6 FlashInclusionAI | 59% | Not reported | Open |
| 118 | Gemma 4 E4BGoogle | 58.6% | Not reported | Open |
| 119 | Mellum2-12B-A2.5B-ThinkingJetBrains | 57.6% | Not reported | Open |
| 120 | ZAYA1-74B-PreviewZyphra | 57.3% | Not reported | Open |
| 121 | Phi-4Microsoft | 56.1% | Not reported | Open |
| 122 | Grok 2xAI | 56% | Not reported | Closed |
| 123 | Granite 4.2 3BIBM | 54.8% | Not reported | Open |
| 124 | Qwen3 32BAlibaba | 54.6% | Not reported | Open |
| 125 | Grok 2 minixAI | 51% | Not reported | Closed |
| 126 | Llama 3.3 70BMeta | 50.5% | Not reported | Open |
| 127 | Gemini 2.0 Flash-LiteGoogle | 50.5% | Not reported | Closed |
| 128 | GPT-4.1 nanoOpenAI | 50.3% | Not reported | Closed |
| 129 | Gemini 1.5 FlashGoogle | 50% | Not reported | Closed |
| 130 | Llama 3.1 70BMeta | 46.7% | Not reported | Open |
| 131 | Qwen2.5-VL-32BAlibaba | 46% | Not reported | Open |
| 132 | Mistral Small 3.1Mistral | 46.0% | Not reported | Open |
| 133 | Gemma 4 E2BGoogle | 43.4% | Not reported | Open |
| 134 | Soofi S 30B-A3BSoofi Project | 43.4% | Not reported | Open |
| 135 | Claude 3.5 HaikuAnthropic | 41.6% | Not reported | Closed |
| 136 | Mellum2-12B-A2.5B-InstructJetBrains | 40.9% | Not reported | Open |
| 137 | LFM2.5-350MLiquidAI | 30.6% | Not reported | Open |
| 138 | Llama 3.1 8BMeta | 30.4% | Not reported | Open |
| 139 | Phi-3.5-miniMicrosoft | 30.4% | Not reported | Open |
| 140 | Granite-4.0-1BIBM | 29.9% | Not reported | Open |
| 141 | Granite-4.0-H-1BIBM | 29.7% | Not reported | Open |
| 142 | Granite-4.0-H-350MIBM | 26.1% | Not reported | Open |
| 143 | LFM2.5-VL-450MLiquidAI | 25.7% | Not reported | Open |
| 144 | LFM2.5-230MLiquidAI | 25.4% | Not reported | Open |
| 145 | Granite-4.0-350MIBM | 24.1% | Not reported | Open |
GPQA Main Zero-Shot (Kaggle)
Native proportions are displayed as percentages. Source profiles, task versions, evaluation dates, and symmetric intervals stay attached to each row. Missing results are not zero. How Kaggle Benchmarks reruns tests.
| Source rank | Source model or configuration | Accuracy (%) | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | GPT-6 Astra | 89.7% | Task version 4; Evaluated 2026-09-14Original result | Not reported | Unknown |
| 2 | Claude Opus 5 | 89.0% | Task version 4; Evaluated 2026-07-27Original result | Not reported | Unknown |
| 3 | Gemini 3.5 Flash | 88.4% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 4 | Grok 4.5 | 88.2% | Task version 4; Evaluated 2026-07-23Original result | Not reported | Unknown |
| 5 | Gemini 3.6 Flash | 87.9% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 6 | Gemini 3 Pro Preview | 87.9% | Task version 4; Evaluated 2025-11-13Original result | Not reported | Unknown |
| 7 | Gemini 3 Flash Preview | 85.7% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 8 | GPT-5.6 Sol | 83.9% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 9 | Gemma 4 31B | 82.6% | Task version 4; Evaluation date not reportedOriginal result | Not reported | Unknown |
| 10 | GPT-5.6 Terra | 81.9% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 11 | Grok 4 | 80.9% | Task version 4; Evaluated 2025-09-02Original result | Not reported | Unknown |
| 12 | Claude Opus 4.8 | 80.0% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 13 | Gemini 2.5 Pro Preview | 79.5% | Task version 4; Evaluated 2025-06-06Original result | Not reported | Unknown |
| 14 | o3 | 79.5% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 15 | GPT-5 | 78.8% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
| 16 | DeepSeek-R1 | 77.9% | Task version 4; Evaluated 2025-06-04Original result | Not reported | Unknown |
| 17 | GPT-5.6 Luna | 77.2% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 18 | Gemma 4 26B A4B | 75.2% | Task version 4; Evaluation date not reportedOriginal result | Not reported | Unknown |
| 19 | Grok 3 Mini | 73.4% | Task version 4; Evaluated 2025-05-26Original result | Not reported | Unknown |
| 20 | o1 | 72.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 21 | gpt-oss-120b | 70.1% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
| 22 | o4 mini | 70.1% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 23 | Claude Opus 4.1 | 69.2% | Task version 4; Evaluated 2025-08-20Original result | Not reported | Unknown |
| 24 | Claude Opus 4 | 69.0% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 25 | o3 mini | 67.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 26 | Gemini 3.5 Flash-Lite | 67.0% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 27 | Claude Sonnet 4 | 64.3% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 28 | deepseek-v3.1 | 64.3% | Task version 4; Evaluated 2025-08-26Original result | Not reported | Unknown |
| 29 | DeepSeek-V3 | 62.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 30 | o1 mini | 58.7% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 31 | Gemini 2.5 Flash Preview | 54.9% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 32 | Gemini 2.0 Flash | 52.0% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 33 | gpt-oss-20b | 52.0% | Task version 4; Evaluated 2025-08-15Original result | Not reported | Unknown |
| 34 | Gemini 1.5 Pro | 50.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 35 | Grok 2 | 50.7% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 36 | Claude 3.7 Sonnet | 49.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 37 | Claude 3.5 Sonnet | 49.1% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 38 | GPT-4o | 49.1% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 39 | GPT-4.1 | 48.0% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 40 | Gemini 1.5 Flash | 46.0% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 41 | Grok 3 | 44.9% | Task version 4; Evaluated 2025-05-26Original result | Not reported | Unknown |
| 42 | Mistral Large 2 | 43.5% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 43 | Claude 3.5 Haiku | 41.1% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 44 | Gemma 3 27B | 37.7% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 45 | Mixtral 8x22B | 37.5% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 46 | GPT-4o mini | 35.5% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 47 | Granite 4.0 Small | 35.0% | Task version 4; Evaluated 2025-09-30Original result | Not reported | Unknown |
| 48 | Codestral | 34.2% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 49 | Gemini 1.5 Flash 8B | 32.4% | Task version 4; Evaluated 2025-05-22Original result | Not reported | Unknown |
| 50 | Gemma 3 12B | 32.4% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 51 | GPT-3.5 Turbo | 31.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 52 | Gemma 3 4B | 30.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 53 | Ministral 3B | 29.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 54 | Ministral 8B | 26.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 55 | Qwen 3 235B A22B Thinking | 16.5% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
GPQA Main Few-Shot (Kaggle)
Native proportions are displayed as percentages. Source profiles, task versions, evaluation dates, and symmetric intervals stay attached to each row. Missing results are not zero. How Kaggle Benchmarks reruns tests.
| Source rank | Source model or configuration | Accuracy (%) | Source setup | Parameters (B) | Open / closed |
|---|---|---|---|---|---|
| 1 | Grok 4.5 | 90.4% | Task version 4; Evaluated 2026-07-16Original result | Not reported | Unknown |
| 2 | Gemini 3.5 Flash | 90.2% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 3 | GPT-6 Astra | 89.7% | Task version 4; Evaluated 2026-09-15Original result | Not reported | Unknown |
| 4 | Claude Opus 5 | 89.1% | Task version 4; Evaluated 2026-07-27Original result | Not reported | Unknown |
| 5 | Gemini 3 Pro Preview | 87.7% | Task version 4; Evaluated 2025-11-13Original result | Not reported | Unknown |
| 6 | Gemini 3.6 Flash | 87.3% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 7 | GPT-5.6 Sol | 86.8% | Task version 4; Evaluated 2026-07-17Original result | Not reported | Unknown |
| 8 | Gemini 3 Flash Preview | 85.7% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 9 | Grok 4 | 82.1% | Task version 4; Evaluated 2025-09-03Original result | Not reported | Unknown |
| 10 | Claude Opus 4.8 | 81.4% | Task version 4; Evaluated 2026-06-28Original result | Not reported | Unknown |
| 11 | Gemma 4 31B | 81.3% | Task version 4; Evaluation date not reportedOriginal result | Not reported | Unknown |
| 12 | Gemini 2.5 Pro Preview | 79.0% | Task version 4; Evaluated 2025-06-06Original result | Not reported | Unknown |
| 13 | GPT-5 | 79.0% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
| 14 | GPT-5.6 Terra | 79.0% | Task version 4; Evaluated 2026-07-16Original result | Not reported | Unknown |
| 15 | o3 | 77.7% | Task version 4; Evaluated 2025-05-09Original result | Not reported | Unknown |
| 16 | GPT-5.6 Luna | 77.0% | Task version 4; Evaluated 2026-07-17Original result | Not reported | Unknown |
| 17 | DeepSeek-R1 | 75.9% | Task version 4; Evaluated 2025-06-04Original result | Not reported | Unknown |
| 18 | Gemma 4 26B A4B | 73.6% | Task version 4; Evaluation date not reportedOriginal result | Not reported | Unknown |
| 19 | o4 mini | 73.4% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 20 | Gemini 3.5 Flash-Lite | 71.4% | Task version 4; Evaluated 2026-07-22Original result | Not reported | Unknown |
| 21 | Grok 3 | 69.9% | Task version 4; Evaluated 2025-05-26Original result | Not reported | Unknown |
| 22 | o1 | 69.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 23 | o3 mini | 69.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 24 | deepseek-v3.1 | 69.4% | Task version 4; Evaluated 2025-08-26Original result | Not reported | Unknown |
| 25 | Grok 3 Mini | 69.2% | Task version 4; Evaluated 2025-05-26Original result | Not reported | Unknown |
| 26 | Claude Opus 4.1 | 68.8% | Task version 4; Evaluated 2025-08-20Original result | Not reported | Unknown |
| 27 | Claude Opus 4 | 67.0% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 28 | GPT-4.1 | 63.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 29 | gpt-oss-120b | 63.6% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
| 30 | Claude Sonnet 4 | 62.9% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 31 | DeepSeek-V3 | 62.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 32 | Claude 3.7 Sonnet | 61.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 33 | Gemini 2.0 Flash | 61.4% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 34 | Claude 3.5 Sonnet | 59.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 35 | Gemini 1.5 Pro | 58.0% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 36 | o1 mini | 54.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 37 | Grok 2 | 53.6% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 38 | Mistral Large 2 | 52.2% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 39 | GPT-4o | 48.7% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 40 | Gemini 1.5 Flash | 44.2% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 41 | Gemma 3 27B | 42.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 42 | GPT-4o mini | 41.5% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 43 | Claude 3.5 Haiku | 40.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 44 | gpt-oss-20b | 40.4% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
| 45 | Granite 4.0 Small | 38.2% | Task version 4; Evaluated 2025-09-30Original result | Not reported | Unknown |
| 46 | Mixtral 8x22B | 37.9% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 47 | Gemma 3 12B | 36.4% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 48 | Codestral | 34.2% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 49 | Gemini 1.5 Flash 8B | 33.7% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 50 | Ministral 8B | 31.3% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 51 | GPT-3.5 Turbo | 30.4% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 52 | Ministral 3B | 28.8% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 53 | Gemma 3 4B | 27.7% | Task version 4; Evaluated 2025-05-08Original result | Not reported | Unknown |
| 54 | Gemini 2.5 Flash Preview | 23.4% | Task version 4; Evaluated 2025-05-23Original result | Not reported | Unknown |
| 55 | Qwen 3 235B A22B Thinking | 15.2% | Task version 4; Evaluated 2025-08-19Original result | Not reported | Unknown |
How to read this leaderboard
GPQA is a four-choice biology, physics and chemistry benchmark written and validated by domain experts. The published family contains a 546-question Extended set, a 448-question Main set and the stricter 198-question Diamond subset.
Variant check: At the September 22, 2026 editorial check, the GPQA source ledger was mixed: most underlying reports said GPQA Diamond, while some identified only GPQA. The table does not expose a complete per-row subset or protocol label.
The table does not expose complete per-row variant or evaluation-setup labels. Consult the original provider or benchmark report before comparing results, and compare only runs that establish the same subset, prompting, tool access and scoring protocol.
Operator receipt: 145 sourced rows are currently displayable on this page; the leading published row is GPT-6 Astra at 96%.
Provenance: At the September 22, 2026 editorial check, the table was assembled from provider and secondary reports. It was not an official benchmark-owner leaderboard, and the source ledger contained no benchmark-owner or independent result rows for this lane.
Source freshness: The primary paper was submitted on November 20, 2023 and published at COLM 2024. The official repository and gated dataset define the benchmark; this page's refresh date records changes to the source ledger, not a new GPQA release.
Honest limit: The mixed source ledger prevents a controlled whole-table comparison, and the gated questions should not be reproduced. Treat the sorted values as directional until the original provider or benchmark report confirms the subset and setup for the particular results being compared.
According to BenchLM.ai, GPT-6 Astra leads the GPQA benchmark with a score of 96%, followed by Sakana Fugu-Ultra (95.5%) and Sakana Fugu (95.5%). The top models are clustered within 0.5 points, suggesting this benchmark is nearing saturation for frontier models.
145 models have been evaluated on GPQA. The benchmark falls in the Knowledge category. GPQA follows the active BenchAlign v5.8 policy. See the methodology for the current scoring and qualification rules.
About GPQA
Year
2023
Tasks
448 questions
Format
Multiple choice questions
Difficulty
Graduate level
GPQA questions are crafted by PhD-level domain experts and validated to be answerable by experts but challenging for non-experts even with internet access. This makes it an excellent test of deep scientific knowledge and reasoning.
Freshness and provenance
Version
GPQA Diamond
Refresh cadence
Static
Staleness state
Refreshing
Question availability
Public benchmark set
BenchLM uses freshness metadata to decide whether a benchmark should still be treated as a strong differentiator, a benchmark to watch, or a display-only reference. For the full scoring policy, see the BenchLM methodology page.
Questions
What does GPQA measure?
GPQA is a four-choice science benchmark written and validated by domain experts. The published family includes a 546-question Extended set, a 448-question Main set, and the stricter 198-question Diamond subset. A result is interpretable only when its source identifies which subset and evaluation setup it used.
Are all rows on this page GPQA Diamond results?
No. At the September 22, 2026 editorial check, underlying reports were mostly labelled GPQA Diamond, while some identified only GPQA. The table does not expose a variant label for every row. Consult the original provider or benchmark report, and compare results only when they establish the same subset and setup.
Where should I verify a GPQA result?
Use the paper, official repository, and gated dataset for the benchmark definition. At the September 22, 2026 editorial check, this source ledger was assembled from provider and secondary reports, not an official owner-run leaderboard. The dataset authors use controlled access and contamination markers, so this page does not reproduce benchmark questions.
Know when it’s worth switching models
The model to choose, the cheaper alternative, and the release we would wait on.
Read a sample issueJoin 6,100+ subscribers.
One email each week. Unsubscribe anytime.