Skip to content
Weights Not Walls
Menu

GPQA diamond

Re-run by Epoch AI

Multiple-choice questions in biology, physics and chemistry, written by people with or studying for PhDs and hard to answer by searching the web. Diamond is the subset where expert validators agreed on the answer.

Kind
Run independently by Epoch AI, with public logs. Our own re-runs are not built yet.
Score shown
Epoch's column "Best score (across scorers)", as a percentage, higher is better; random guessing scores about 25.0%. Error bars as the source gives them.
Results
341 in all: 131 for open-weight models, 206 for closed ones, 4 where Epoch does not say. 109 linked to a model page here.

Best open-weight result: moonshotai/Kimi-K3.1-Pro, 94.2%, number 15 of 341 results.

GPQA diamond results
#ModelWeightsSettingScoreDateSource
1gpt-6.2-astra_maxOpenAIclosedeffort max96.8%±1.227 Oct 2026Epoch AI
2gemini-4-hydrogen_xhighGoogle DeepMindclosedeffort xhigh96.8%±1.213 Nov 2026Epoch AI log
3gemini-4-carbon_highGoogle DeepMindclosedeffort high96.5%±1.22 Nov 2026Epoch AI
4gemini-4-argon_highGoogle DeepMindclosedeffort high96.4%±1.213 Oct 2026Epoch AI log
5claude-fable-5-2-fallback_maxAnthropicclosedeffort max96.0%±1.36 Nov 2026Epoch AI
6gpt-6-astra_maxOpenAIclosedeffort max95.8%±1.430 Aug 2026Epoch AI log
7claude-sonnet-5-5_maxAnthropicclosedeffort max95.6%±1.429 Sep 2026Epoch AI log
8gemini-3.8-flash_highGoogle DeepMindclosedeffort high95.4%±1.42 Sep 2026Epoch AI log
9gpt-6.1-sol_maxOpenAIclosedeffort max95.4%±1.429 Sep 2026Epoch AI log
10gemini-3.7-flash_highGoogle DeepMindclosedeffort high94.8%±1.314 Aug 2026Epoch AI log
11gpt-5.4-pro-2026-03-05_xhighOpenAIclosedeffort xhigh94.6%±1.620 Mar 2026Epoch AI
12gemini-3.1-pro-preview_highGoogle DeepMindclosedeffort high94.4%±1.66 Aug 2026Epoch AI log
13gpt-6-sol_maxOpenAIclosedeffort max94.3%±1.522 Sep 2026Epoch AI log
14gpt-6.1-terra_maxOpenAIclosedeffort max94.3%±1.526 Oct 2026Epoch AI log
15moonshotai/Kimi-K3.1-ProEpoch: kimi-k3.1-pro-together_max, Moonshotopeneffort max94.2%±1.46 Nov 2026Epoch AI log
16gemini-3.6-flash_highGoogle DeepMindclosedeffort high94.1%±1.42 Aug 2026Epoch AI log
17gemini-3.1-pro-previewGoogle DeepMindcloseddefault94.1%±1.720 Feb 2026Epoch AI log
18claude-opus-5-5-fallback_maxAnthropicclosedeffort max94.1%±1.522 Sep 2026Epoch AI
19gpt-5.5-pre-release_xhighOpenAIclosedeffort xhigh94.0%±1.524 Apr 2026Epoch AI log
20grok-4.6_highxAIclosedeffort high94.0%±1.412 Aug 2026Epoch AI log
21gpt-5.5-pro-pre-release_xhighOpenAIclosedeffort xhigh93.9%±1.624 Apr 2026Epoch AI log
22claude-fable-5-2_maxAnthropicclosedeffort max93.9%±1.66 Nov 2026Epoch AI
23claude-fable-5-fallback_maxAnthropicclosedeffort max93.9%±1.76 Aug 2026Epoch AI
24claude-opus-5_maxAnthropicclosedeffort max93.9%±1.524 Jul 2026Epoch AI log
25gpt-5.6-sol_maxOpenAIclosedeffort max93.5%±1.69 Jul 2026Epoch AI log
26grok-4.5_highxAIclosedeffort high93.4%±1.48 Jul 2026Epoch AI log
27gpt-5.6-terra_maxOpenAIclosedeffort max93.3%±1.59 Jul 2026Epoch AI log
28gpt-5.4-2026-03-05_xhighOpenAIclosedeffort xhigh93.3%±1.86 Mar 2026Epoch AI log
29deepseek-ai/DeepSeek-V4.1-Flash-1017Epoch: deepseek-v4.1-flash-1017_max, DeepSeekopeneffort max93.2%±1.619 Oct 2026Epoch AI log
30grok-4.6_xhighxAIclosedeffort xhigh93.2%±1.514 Aug 2026Epoch AI log
31doubao-seed-evolving_highByteDanceclosedeffort high93.1%±1.62 Nov 2026Epoch AI log
32moonshotai/Kimi-K3Epoch: kimi-k3_max, Moonshotopeneffort max93.1%±1.516 Jul 2026Epoch AI log
33claude-opus-5Anthropiccloseddefault92.9%±1.86 Aug 2026Epoch AI log
34gemini-3.5-flash_highGoogle DeepMindclosedeffort high92.8%±1.622 May 2026Epoch AI log
35grok-4.7_xhighxAIclosedeffort xhigh92.7%±1.622 Sep 2026Epoch AI log
36qwen3.8-max_xhighAlibabaclosedeffort xhigh92.7%±1.74 Aug 2026Epoch AI log
37gemini-3-pro-previewGoogle DeepMindcloseddefault92.6%±1.719 Nov 2025Epoch AI log
38qwen3.8-max-0902_xhighAlibabaclosedeffort xhigh92.3%±1.72 Sep 2026Epoch AI log
39moonshotai/Kimi-K3Epoch: kimi-k3_high, Moonshotopeneffort high91.9%±1.97 Aug 2026Epoch AI log
40zai-org/GLM-5.2Epoch: glm-5.2_max, Z.ai (Zhipu AI)openeffort max91.9%±1.624 Jun 2026Epoch AI log
41deepseek-ai/DeepSeek-V4-Pro-0813Epoch: deepseek-v4-pro-0813_max, DeepSeekopeneffort max91.7%±1.518 Aug 2026Epoch AI log
42gpt-5.6-luna_maxOpenAIclosedeffort max91.6%±1.79 Jul 2026Epoch AI log
43gpt-5.2-2025-12-11_xhighOpenAIclosedeffort xhigh91.4%±1.813 Dec 2025Epoch AI log
44claude-opus-4-8_maxAnthropicclosedeffort max91.0%±1.97 Jun 2026Epoch AI log
45deepseek-ai/DeepSeek-V4-Flash-0731Epoch: deepseek-v4-flash-0731_max, DeepSeekopeneffort max91.0%±1.82 Aug 2026Epoch AI log
46deepseek-ai/DeepSeek-V4-ProEpoch: deepseek-v4-pro_high, DeepSeekopeneffort high90.9%±2.06 Aug 2026Epoch AI log
47zai-org/GLM-5.3Epoch: glm-5.3_max, Z.ai (Zhipu AI)openeffort max90.9%±1.624 Aug 2026Epoch AI log
48MiniMaxAI/MiniMax-M3Epoch: MiniMax-M3, MiniMaxopendefault90.9%±2.010 Aug 2026Epoch AI log
49qwen3.7-maxAlibabacloseddefault90.9%±2.07 Aug 2026Epoch AI log
50moonshotai/Kimi-K2.6Epoch: kimi-k2.6, Moonshotopendefault90.8%±1.71 May 2026Epoch AI log
51gpt-5.5_lowOpenAIclosedeffort low90.7%±1.85 May 2026Epoch AI log
52claude-opus-5-5_maxAnthropicclosedeffort max90.6%±1.922 Sep 2026Epoch AI log
53claude-opus-4-6_32KAnthropiccloseddefault90.5%±1.76 Feb 2026Epoch AI log
54claude-sonnet-5_xhighAnthropicclosedeffort xhigh90.5%±1.81 Jul 2026Epoch AI log
55gpt-6-luna_maxOpenAIclosedeffort max90.5%±1.922 Sep 2026Epoch AI log
56claude-opus-4-7_xhighAnthropicclosedeffort xhigh90.2%±1.817 Apr 2026Epoch AI log
57zai-org/GLM-5.3-FlashEpoch: glm-5.3-flash_max, Z.ai (Zhipu AI)openeffort max90.2%±1.726 Aug 2026Epoch AI log
58mistral-large-4-0-oss_highMistral AIno page matchopeneffort high90.2%±1.82 Nov 2026Epoch AI log
59zai-org/GLM-5.1Epoch: glm-5.1, Z.ai (Zhipu AI)opendefault89.9%±2.110 Aug 2026Epoch AI log
60gpt-5.4-2026-03-05_highOpenAIclosedeffort high89.9%±2.115 Jul 2026Epoch AI log
61gpt-5.6-sol_lowOpenAIclosedeffort low89.9%±2.17 Aug 2026Epoch AI log
62deepseek-ai/DeepSeek-V4.1-FlashEpoch: deepseek-v4.1-flash_max, DeepSeekopeneffort max89.8%±1.79 Oct 2026Epoch AI log
63muse-sparkMeta AIcloseddefault89.8%±2.28 Apr 2026Epoch AI
64claude-haiku-5-5_maxAnthropicclosedeffort max89.6%±2.09 Oct 2026Epoch AI log
65deepseek-ai/DeepSeek-V4-ProEpoch: deepseek-v4-pro_max, DeepSeekopeneffort max89.6%±1.716 Jun 2026Epoch AI log
66doubao-seed-2.1-turbo-260628_highByteDanceclosedeffort high89.6%±1.830 Oct 2026Epoch AI log
67gemini-3-flash-preview_highGoogle DeepMindclosedeffort high89.4%±2.26 Aug 2026Epoch AI log
68doubao-seed-2.1-pro-260628_highByteDanceclosedeffort high89.3%±1.828 Oct 2026Epoch AI log
69grok-4.20-0309-reasoningxAIcloseddefault89.3%±1.913 Jul 2026Epoch AI log
70gemini-3.5-flash_lowGoogle DeepMindclosedeffort low88.9%±2.26 Aug 2026Epoch AI log
71gpt-5.4-2026-03-05_mediumOpenAIclosedeffort medium88.9%±2.215 Jul 2026Epoch AI log
72grok-4.3_highxAIclosedeffort high88.8%±2.017 Jun 2026Epoch AI log
73claude-opus-4-6_64KAnthropiccloseddefault88.8%±1.96 Feb 2026Epoch AI log
74meta-models/Muse-Spark-Open-816B-A42BEpoch: Muse-Spark-Open-816B-A42B_xhigh, Meta AIopeneffort xhigh88.6%±1.915 Oct 2026Epoch AI log
75thinkingmachines/Inkling-SmallEpoch: inkling-small_xhigh, Thinking Machinesopeneffort xhigh88.5%±1.914 Aug 2026Epoch AI log
76claude-opus-4-6_maxAnthropicclosedeffort max88.4%±2.36 Aug 2026Epoch AI log
77claude-opus-4-8_lowAnthropicclosedeffort low88.4%±2.36 Aug 2026Epoch AI log
78qwen3.6-plusAlibabacloseddefault88.4%±2.37 Aug 2026Epoch AI log
79thinkingmachines/InklingEpoch: Inkling_xhigh, Thinking Machinesopeneffort xhigh88.3%±1.95 Aug 2026Epoch AI log
80doubao-seed-2.0-pro-260215_highByteDanceclosedeffort high88.2%±1.928 Oct 2026Epoch AI log
81gpt-5.2-2025-12-11_highOpenAIclosedeffort high88.2%±1.911 Dec 2025Epoch AI log
82doubao-seed-2.0-lite-260428_highByteDanceclosedeffort high88.1%±1.928 Oct 2026Epoch AI log
83mistral-large-4-0_highMistral AIno page matchopeneffort high88.1%±1.912 Oct 2026Epoch AI log
84claude-opus-5_lowAnthropicclosedeffort low87.9%±2.36 Aug 2026Epoch AI log
85zai-org/GLM-5.2Epoch: glm-5.2_low, Z.ai (Zhipu AI)openeffort low87.9%±2.310 Aug 2026Epoch AI log
86gpt-5.2-2025-12-11_mediumOpenAIclosedeffort medium87.9%±1.911 Dec 2025Epoch AI log
87moonshotai/Kimi-K2.7-CodeEpoch: kimi-k2.7-code, Moonshotopendefault87.9%±2.37 Aug 2026Epoch AI log
88qwen3.7-plusAlibabacloseddefault87.9%±2.37 Aug 2026Epoch AI log
89zai-org/GLM-5Epoch: glm-5, Z.ai (Zhipu AI)opendefault87.8%±2.312 Feb 2026Epoch AI log
90gpt-5.1-2025-11-13_highOpenAIclosedeffort high87.6%±1.913 Nov 2025Epoch AI log
91moonshotai/Kimi-K2.5Epoch: fireworks/kimi-k2p5, Moonshotopendefault87.6%±1.92 Feb 2026Epoch AI log
92claude-sonnet-4-6_32KAnthropiccloseddefault87.4%±2.020 Feb 2026Epoch AI log
93gpt-5.6-terra_lowOpenAIclosedeffort low87.4%±2.47 Aug 2026Epoch AI log
94qwen3.6-max-previewAlibabanot stateddefault87.4%±2.47 Aug 2026Epoch AI log
95grok-4-0709xAIcloseddefault87.0%±2.0not datedEpoch AI
96gpt-5.4-mini-2026-03-17_xhighOpenAIclosedeffort xhigh86.9%±2.47 Aug 2026Epoch AI log
97claude-opus-4-7_maxAnthropicclosedeffort max86.4%±2.46 Aug 2026Epoch AI log
98gemini-3.5-flash_minimalGoogle DeepMindclosedeffort minimal86.4%±2.415 Jul 2026Epoch AI log
99gemini-3.6-flash_lowGoogle DeepMindclosedeffort low86.4%±2.46 Aug 2026Epoch AI log
100Qwen/Qwen3.5-397B-A17BEpoch: qwen3.5-397b-a17b_none, Alibabaopeneffort none86.4%±2.47 Aug 2026Epoch AI log
101gpt-5-2025-08-07_highOpenAIclosedeffort high86.2%±2.129 Oct 2025Epoch AI log
102claude-opus-4-5-20251101_32KAnthropiccloseddefault86.0%±2.124 Nov 2025Epoch AI log
103claude-fable-5_maxAnthropicclosedeffort max85.9%±2.56 Aug 2026Epoch AI log
104gemini-3.6-flash_minimalGoogle DeepMindclosedeffort minimal85.9%±2.57 Aug 2026Epoch AI log
105Qwen/Qwen3.5-397B-A17BEpoch: qwen3.5-397b-a17b, Alibabaopendefault85.9%±2.57 Aug 2026Epoch AI log
106Qwen/Qwen3.6-27BEpoch: qwen3.6-27b, Alibabaopendefault85.9%±2.57 Aug 2026Epoch AI log
107claude-opus-4-5-20251101_16KAnthropiccloseddefault85.5%±2.225 Nov 2025Epoch AI log
108claude-opus-4-8_noneAnthropicclosedeffort none85.4%±2.56 Aug 2026Epoch AI log
109gpt-5-2025-08-07_mediumOpenAIclosedeffort medium85.4%±2.17 Aug 2025Epoch AI log
110nemotron-3-ultraNvidiano page matchopendefault85.4%±2.510 Aug 2026Epoch AI log
111gemini-2.5-proGoogle DeepMindcloseddefault85.3%±2.116 Nov 2025Epoch AI log
112gpt-5.1-2025-11-13_mediumOpenAIclosedeffort medium85.0%±2.117 Nov 2025Epoch AI log
113gemini-2.5-pro-preview-06-05Google DeepMindcloseddefault84.8%±2.65 Jun 2025Epoch AI log
114gpt-5.4-2026-03-05_lowOpenAIclosedeffort low84.8%±2.615 Jul 2026Epoch AI log
115moonshotai/Kimi-K3Epoch: kimi-k3_low, Moonshotopeneffort low84.8%±2.67 Aug 2026Epoch AI log
116qwen3.5-plusAlibabanot stateddefault84.8%±2.67 Aug 2026Epoch AI log
117Qwen/Qwen3.6-27BEpoch: qwen3.6-27b_none, Alibabaopeneffort none84.8%±2.67 Aug 2026Epoch AI log
118Qwen/Qwen3.6-35B-A3BEpoch: qwen3.6-35b-a3b_none, Alibabaopeneffort none84.8%±2.67 Aug 2026Epoch AI log
119kimi-k2-thinking-turboMoonshotno page matchopendefault84.2%±2.111 Nov 2025Epoch AI log
120gemini-2.5-pro-exp-03-25Google DeepMindcloseddefault83.8%±2.631 Mar 2025Epoch AI log
121Qwen/Qwen3.6-35B-A3BEpoch: qwen3.6-35b-a3b, Alibabaopendefault83.8%±2.67 Aug 2026Epoch AI log
122gpt-5.4-mini-2026-03-17_highOpenAIclosedeffort high83.6%±2.215 Apr 2026Epoch AI log
123Qwen/Qwen3.5-35B-A3BEpoch: qwen3.5-35b-a3b, Alibabaopendefault83.5%±2.228 Aug 2026Epoch AI log
124deepseek-reasonerDeepSeekno page matchopendefault83.4%±2.016 Dec 2025Epoch AI log
125claude-fable-5_highAnthropicclosedeffort high83.3%±2.76 Aug 2026Epoch AI log
126claude-sonnet-4-6_highAnthropicclosedeffort high83.3%±2.713 Jul 2026Epoch AI log
127claude-sonnet-4-6_mediumAnthropicclosedeffort medium83.3%±2.713 Jul 2026Epoch AI log
128gemini-3.5-flash-lite_highGoogle DeepMindclosedeffort high83.3%±2.76 Aug 2026Epoch AI log
129zai-org/GLM-4.7Epoch: glm-4.7, Z.ai (Zhipu AI)opendefault83.3%±2.429 Jan 2026Epoch AI log
130qwen3.6-flashAlibabanot stateddefault83.3%±2.77 Aug 2026Epoch AI log
131gemini-3-flash-previewGoogle DeepMindcloseddefault83.2%±1.917 Dec 2025Epoch AI log
132gpt-5.6-sol_noneOpenAIclosedeffort none82.8%±2.77 Aug 2026Epoch AI log
133gpt-5.2-2025-12-11_lowOpenAIclosedeffort low82.7%±2.311 Dec 2025Epoch AI log
134gpt-5.5-instantOpenAIcloseddefault82.5%±2.32 Aug 2026Epoch AI log
135claude-sonnet-4-5-20250929_59KAnthropiccloseddefault82.3%±2.728 Oct 2025Epoch AI log
136gpt-5.6-luna_lowOpenAIclosedeffort low82.3%±2.77 Aug 2026Epoch AI log
137qwen3.5-flashAlibabanot stateddefault82.3%±2.77 Aug 2026Epoch AI log
138qwen3.7-flashAlibabacloseddefault82.3%±2.77 Aug 2026Epoch AI log
139gemini-3.1-flash-lite_highGoogleclosedeffort high81.8%±2.76 Aug 2026Epoch AI log
140o3-2025-04-16_highOpenAIclosedeffort high81.8%±2.116 Apr 2025Epoch AI log
141qwen3.7-plus_noneAlibabaclosedeffort none81.8%±2.77 Aug 2026Epoch AI log
142claude-sonnet-4-5-20250929_32KAnthropiccloseddefault81.7%±2.821 Oct 2025Epoch AI log
143MiniMaxAI/MiniMax-M3Epoch: MiniMax-M3_none, MiniMaxopeneffort none81.3%±2.810 Aug 2026Epoch AI log
144Qwen/Qwen3.5-35B-A3BEpoch: qwen3.5-35b-a3b_none, Alibabaopeneffort none81.2%±2.328 Aug 2026Epoch AI log
145o3-2025-04-16_mediumOpenAIclosedeffort medium80.8%±2.87 Aug 2026Epoch AI log
146qwen3.7-flash_noneAlibabaclosedeffort none80.8%±2.87 Aug 2026Epoch AI log
147claude-opus-4-5-20251101Anthropiccloseddefault80.7%±2.424 Nov 2025Epoch AI log
148claude-sonnet-5_maxAnthropicclosedeffort max80.3%±2.86 Aug 2026Epoch AI log
149Qwen/Qwen3-235B-A22B-Thinking-2507Epoch: Qwen3-235B-A22B-Thinking-2507, Alibabaopendefault80.1%±2.611 Dec 2025Epoch AI log
150o3-2025-04-16_lowOpenAIclosedeffort low79.8%±2.915 Jul 2026Epoch AI log
151claude-3-7-sonnet-20250219_64KAnthropiccloseddefault79.7%±2.726 May 2025Epoch AI log
152o4-mini-2025-04-16_highOpenAIclosedeffort high79.6%±2.416 Apr 2025Epoch AI log
153claude-sonnet-4-20250514_59KAnthropiccloseddefault79.2%±2.726 May 2025Epoch AI log
154Qwen/Qwen3.5-9BEpoch: qwen3.5-9B, Alibabaopendefault79.0%±2.427 Aug 2026Epoch AI log
155Qwen/Qwen3.5-9BEpoch: qwen3.5-9B_none, Alibabaopeneffort none78.9%±2.427 Aug 2026Epoch AI log
156claude-fable-5_lowAnthropicclosedeffort low78.8%±2.96 Aug 2026Epoch AI log
157claude-sonnet-4-5-20250929_16KAnthropiccloseddefault78.8%±2.928 Oct 2025Epoch AI log
158claude-sonnet-4-6_maxAnthropicclosedeffort max78.8%±2.96 Aug 2026Epoch AI log
159gpt-5.4-nano-2026-03-17_highOpenAIclosedeffort high78.5%±2.414 Apr 2026Epoch AI log
160claude-sonnet-4-20250514_32KAnthropiccloseddefault78.3%±2.922 May 2025Epoch AI log
161o4-mini-2025-04-16_mediumOpenAIclosedeffort medium77.8%±3.07 Aug 2026Epoch AI log
162seed-1.6ByteDancecloseddefault77.6%±2.530 Oct 2026Epoch AI log
163claude-opus-4-1-20250805_16KAnthropiccloseddefault77.3%±3.05 Aug 2025Epoch AI log
164gpt-5.5_noneOpenAIclosedeffort none77.3%±3.07 Aug 2026Epoch AI log
165gpt-5.6-terra_noneOpenAIclosedeffort none77.3%±3.07 Aug 2026Epoch AI log
166o3-mini-2025-01-31_highOpenAIclosedeffort high77.0%±2.613 Feb 2025Epoch AI log
167claude-3-7-sonnet-20250219_16KAnthropiccloseddefault76.8%±3.026 Feb 2025Epoch AI log
168claude-3-7-sonnet-20250219_32KAnthropiccloseddefault76.8%±3.010 Mar 2025Epoch AI log
169claude-opus-4-1-20250805_27KAnthropiccloseddefault76.8%±3.05 Aug 2025Epoch AI log
170o1-2024-12-17_highOpenAIclosedeffort high76.8%±3.013 Feb 2025Epoch AI log
171deepseek-ai/DeepSeek-R1-0528Epoch: DeepSeek-R1-0528, DeepSeekopendefault76.3%±2.429 May 2025Epoch AI log
172claude-opus-4-20250514_16KAnthropiccloseddefault76.3%±3.022 May 2025Epoch AI log
173grok-3-mini-beta_lowxAIclosedeffort low76.3%±3.010 Apr 2025Epoch AI log
174claude-sonnet-4-20250514_16KAnthropiccloseddefault75.8%±3.122 May 2025Epoch AI log
175gemini-3.5-flash-lite_lowGoogle DeepMindclosedeffort low75.8%±3.16 Aug 2026Epoch AI log
176google/gemma-4-31B-itEpoch: gemma-4-31b-it_minimal, Google DeepMindopeneffort minimal75.8%±3.16 Aug 2026Epoch AI log
177grok-3-betaxAIcloseddefault75.8%±2.726 May 2025Epoch AI log
178o1-2024-12-17_mediumOpenAIclosedeffort medium75.8%±3.127 Jan 2025Epoch AI log
179openai/gpt-oss-120bEpoch: openai/gpt-oss-120b_high, OpenAIopeneffort high75.8%±2.711 Dec 2025Epoch AI log
180grok-3-mini-beta_highxAIclosedeffort high75.5%±2.826 May 2025Epoch AI log
181o4-mini-2025-04-16_lowOpenAIclosedeffort low75.3%±3.111 Jul 2026Epoch AI log
182gpt-5-mini-2025-08-07_highOpenAIclosedeffort high75.0%±2.330 Oct 2025Epoch AI log
183gpt-5.4-2026-03-05_noneOpenAIclosedeffort none74.7%±3.115 Jul 2026Epoch AI log
184o3-mini-2025-01-31_mediumOpenAIclosedeffort medium74.3%±2.531 Jan 2025Epoch AI log
185gemini-3.1-flash-lite_lowGoogleclosedeffort low74.2%±3.16 Aug 2026Epoch AI log
186gemini-3.5-flash-lite_minimalGoogle DeepMindclosedeffort minimal74.2%±3.16 Aug 2026Epoch AI log
187o1-2024-12-17_lowOpenAIclosedeffort low74.2%±3.120 Jul 2026Epoch AI log
188claude-sonnet-4-5-20250929Anthropiccloseddefault73.7%±3.129 Sep 2025Epoch AI log
189gemini-3.1-flash-lite_minimalGoogleclosedeffort minimal73.7%±3.16 Aug 2026Epoch AI log
190claude-opus-4-1-20250805Anthropiccloseddefault73.2%±3.25 Aug 2025Epoch AI log
191deepseek-ai/DeepSeek-V4-ProEpoch: deepseek-v4-pro_none, DeepSeekopeneffort none73.2%±3.26 Aug 2026Epoch AI log
192google/gemma-4-26B-A4B-itEpoch: gemma-4-26b-a4b-it_minimal, Google DeepMindopeneffort minimal73.2%±3.26 Aug 2026Epoch AI log
193gpt-5.2-2025-12-11_noneOpenAIclosedeffort none73.2%±3.213 Jul 2026Epoch AI log
194qwen3-max-2025-09-23Alibabacloseddefault72.6%±2.76 Oct 2025Epoch AI log
195gpt-5.4-nano-2026-03-17_lowOpenAIclosedeffort low72.2%±3.27 Aug 2026Epoch AI log
196deepseek-ai/DeepSeek-R1Epoch: DeepSeek-R1, DeepSeekopendefault71.7%±3.126 May 2025Epoch AI log
197gpt-5-2025-08-07_minimalOpenAIclosedeffort minimal71.7%±3.220 Jul 2026Epoch AI log
198gpt-5-mini-2025-08-07_minimalOpenAIclosedeffort minimal71.7%±3.27 Aug 2026Epoch AI log
199gpt-5-mini-2025-08-07_mediumOpenAIclosedeffort medium71.7%±2.37 Aug 2025Epoch AI log
200ByteDance-Seed/Seed-OSS-36B-InstructEpoch: seed-oss-36b-instructopendefault71.5%±2.730 Aug 2026Epoch AI log
201claude-haiku-4-5-20251001_32KAnthropiccloseddefault71.2%±3.222 Oct 2025Epoch AI log
202deepseek-chatDeepSeekno page matchopendefault71.2%±3.216 Jul 2026Epoch AI log
203zai-org/GLM-5.2Epoch: glm-5.2_none, Z.ai (Zhipu AI)openeffort none71.2%±3.210 Aug 2026Epoch AI log
204Qwen/Qwen3-235B-A22BEpoch: qwen3-235b-a22b, Alibabaopendefault70.7%±2.73 Jun 2025Epoch AI log
205Qwen/Qwen3-30B-A3B-Thinking-2507Epoch: qwen3-30b-a3b-thinking-2507, Alibabaopendefault70.1%±2.830 Aug 2026Epoch AI log
206gpt-5-nano-2025-08-07_highOpenAIclosedeffort high69.4%±2.830 Oct 2025Epoch AI log
207claude-opus-4-20250514Anthropiccloseddefault69.2%±3.322 May 2025Epoch AI log
208gpt-4.5-preview-2025-02-27OpenAIcloseddefault68.7%±3.328 Feb 2025Epoch AI log
209o3-mini-2025-01-31_lowOpenAIclosedeffort low68.2%±3.320 Jul 2026Epoch AI log
210deepseek-ai/DeepSeek-V3-0324Epoch: DeepSeek-V3-0324, DeepSeekopendefault67.6%±2.71 Apr 2025Epoch AI log
211gpt-5-nano-2025-08-07_mediumOpenAIclosedeffort medium67.4%±2.77 Aug 2025Epoch AI log
212meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8Epoch: Llama-4-Maverick-17B-128E-Instruct-FP8, Meta AIopendefault67.0%±2.88 Apr 2025Epoch AI log
213gpt-4.1-2025-04-14OpenAIcloseddefault66.9%±2.814 Apr 2025Epoch AI log
214claude-sonnet-4-20250514Anthropiccloseddefault66.7%±3.422 May 2025Epoch AI log
215gemini-2.5-pro-preview-05-06Google DeepMindcloseddefault66.7%±3.43 Jun 2025Epoch AI log
216gpt-5.1-2025-11-13_noneOpenAIclosedeffort none66.7%±3.47 Aug 2026Epoch AI log
217claude-3-7-sonnet-20250219Anthropiccloseddefault66.0%±2.724 Feb 2025Epoch AI log
218gpt-4.1-mini-2025-04-14OpenAIcloseddefault65.8%±2.714 Apr 2025Epoch AI log
219Qwen/Qwen3-32BEpoch: Qwen3-32B, Alibabaopendefault65.7%±2.828 Aug 2026Epoch AI log
220gemini-2.0-pro-exp-02-05Google DeepMindcloseddefault65.7%±3.47 Feb 2025Epoch AI log
221qwq-plusAlibabacloseddefault65.4%±2.811 Apr 2025Epoch AI log
222Qwen/QwQ-32BEpoch: QwQ-32B, Alibabaopendefault65.3%±2.828 Aug 2026Epoch AI log
223deepseek-ai/DeepSeek-R1-Distill-Qwen-32BEpoch: DeepSeek-R1-Distill-Qwen-32B, DeepSeekopendefault64.1%±2.828 Aug 2026Epoch AI log
224gemini-2.0-flash-001Google DeepMind,Googlecloseddefault64.1%±2.76 Feb 2025Epoch AI log
225gpt-5.4-mini-2026-03-17_noneOpenAIclosedeffort none64.1%±3.47 Aug 2026Epoch AI log
226Qwen/Qwen3-14BEpoch: qwen3-14b, Alibabaopendefault63.8%±2.928 Aug 2026Epoch AI log
227gpt-5.6-luna_noneOpenAIclosedeffort none63.6%±3.47 Aug 2026Epoch AI log
228o1-mini-2024-09-12_highOpenAIclosedeffort high62.4%±2.713 Feb 2025Epoch AI log
229Qwen/Qwen3-30B-A3BEpoch: Qwen3-30B-A3B, Alibabaopendefault61.7%±3.030 Aug 2026Epoch AI log
230openai/gpt-oss-20bEpoch: gpt-oss-20b_medium, OpenAIopeneffort medium60.8%±2.527 Aug 2026Epoch AI log
231zai-org/GLM-4.7-FlashEpoch: glm-4.7-flashopendefault60.5%±2.930 Aug 2026Epoch AI log
232claude-haiku-4-5-20251001Anthropiccloseddefault60.5%±2.816 Oct 2025Epoch AI log
233mistral-medium-2505Mistral AIcloseddefault59.5%±2.87 May 2025Epoch AI log
234o1-mini-2024-09-12_mediumOpenAIclosedeffort medium59.5%±2.827 Jan 2025Epoch AI log
235gpt-5-nano-2025-08-07_lowOpenAIclosedeffort low57.6%±3.513 Jul 2026Epoch AI log
236gemini-1.5-pro-002Google DeepMindcloseddefault57.2%±2.827 Jan 2025Epoch AI log
237gemini-2.0-flash-thinking-exp-01-21Google DeepMind,Googlecloseddefault57.1%±3.56 Feb 2025Epoch AI log
238Qwen/Qwen3-8BEpoch: qwen3-8b, Alibabaopendefault56.8%±2.927 Aug 2026Epoch AI log
239deepseek-ai/DeepSeek-V3Epoch: DeepSeek-V3, DeepSeekopendefault56.5%±2.827 Jan 2025Epoch AI log
240qwen-max-2025-01-25Alibabacloseddefault56.1%±2.81 Apr 2025Epoch AI log
241mistralai/Magistral-Small-2506Epoch: magistral-small-2506, Mistral AIopendefault56.1%±3.56 Aug 2026Epoch AI log
242microsoft/phi-4Epoch: phi-4, Microsoft Researchopendefault56.1%±2.631 Jan 2025Epoch AI log
243deepseek-ai/DeepSeek-R1-Distill-Llama-70BEpoch: DeepSeek-R1-Distill-Llama-70B, DeepSeekopendefault55.7%±3.010 Mar 2025Epoch AI log
244Qwen/Qwen3-30B-A3B-Instruct-2507Epoch: qwen3-30b-a3b-instruct-2507, Alibabaopendefault55.6%±2.930 Aug 2026Epoch AI log
245gpt-5.4-nano-2026-03-17_noneOpenAIclosedeffort none55.6%±3.57 Aug 2026Epoch AI log
246claude-3-5-sonnet-20241022Anthropiccloseddefault55.3%±2.827 Jan 2025Epoch AI log
247Qwen/Qwen3-32BEpoch: Qwen3-32B_none, Alibabaopeneffort none54.1%±2.830 Aug 2026Epoch AI log
248claude-3-5-sonnet-20240620Anthropiccloseddefault54.0%±2.827 Jan 2025Epoch AI log
249grok-2-1212xAIcloseddefault53.8%±2.727 Jan 2025Epoch AI log
250Qwen/Qwen3-14BEpoch: qwen3-14b_none, Alibabaopeneffort none53.4%±2.828 Aug 2026Epoch AI log
251openai/gpt-oss-20bEpoch: gpt-oss-20b_low, OpenAIopeneffort low53.2%±2.527 Aug 2026Epoch AI log
252Qwen/Qwen3-4BEpoch: qwen3-4b, Alibabaopendefault52.3%±3.028 Aug 2026Epoch AI log
253meta-llama/Llama-4-Scout-17B-16E-InstructEpoch: Llama-4-Scout-17B-16E-Instruct, Meta AIopendefault51.8%±3.28 Apr 2025Epoch AI log
254mistral-large-2411Mistral AIno page matchopendefault51.3%±2.725 Feb 2025Epoch AI log
255meta-llama/Llama-3.1-405B-InstructEpoch: Llama-3.1-405B-Instruct, Meta AIopendefault50.9%±2.627 Jan 2025Epoch AI log
256Qwen/Qwen3-30B-A3BEpoch: Qwen3-30B-A3B_none, Alibabaopeneffort none50.4%±2.830 Aug 2026Epoch AI log
257o1-preview-2024-09-12OpenAIcloseddefault50.3%±2.827 Jan 2025Epoch AI log
258gpt-4o-2024-08-06OpenAIcloseddefault49.2%±2.627 Jan 2025Epoch AI log
259Qwen/Qwen2.5-72B-InstructEpoch: qwen2.5-72b-instruct, Alibabaopendefault49.1%±2.727 Jan 2025Epoch AI log
260mistral-small-3.2-2506Mistral AIno page matchopendefault49.1%±2.828 Aug 2026Epoch AI log
261mistral-large-2407Mistral AIno page matchopendefault49.0%±2.627 Jan 2025Epoch AI log
262gpt-4.1-nano-2025-04-14OpenAIcloseddefault48.9%±2.514 Apr 2025Epoch AI log
263gpt-4o-2024-05-13OpenAIcloseddefault48.9%±2.627 Jan 2025Epoch AI log
264gpt-5-nano-2025-08-07_minimalOpenAIclosedeffort minimal48.5%±3.613 Jul 2026Epoch AI log
265qwen-plus-2025-01-25Alibabacloseddefault48.1%±2.77 Apr 2025Epoch AI log
266gpt-4o-2024-11-20OpenAIcloseddefault47.9%±2.65 Feb 2025Epoch AI log
267google/gemma-3-27b-itEpoch: gemma-3-27b-it, Google DeepMindopendefault47.7%±2.727 Aug 2026Epoch AI log
268mistralai/Magistral-Small-2509Epoch: magistral-small-2509, Mistral AIopendefault47.6%±2.630 Aug 2026Epoch AI log
269mistral-small-2503Mistral AIno page matchopendefault47.5%±2.818 Mar 2025Epoch AI log
270Qwen/Qwen3-8BEpoch: qwen3-8b_none, Alibabaopeneffort none47.5%±2.627 Aug 2026Epoch AI log
271meta-llama/Llama-3.3-70B-InstructEpoch: Llama-3.3-70B-Instruct, Meta AIopendefault47.4%±2.927 Jan 2025Epoch AI log
272gemini-1.5-flash-002Google DeepMindcloseddefault47.3%±2.827 Jan 2025Epoch AI log
273mistral-small-3-2501Mistral AIno page matchopendefault47.3%±2.830 Aug 2026Epoch AI log
274claude-3-opus-20240229Anthropiccloseddefault47.2%±2.627 Jan 2025Epoch AI log
275gpt-4-turbo-2024-04-09OpenAIcloseddefault46.6%±2.727 Feb 2025Epoch AI log
276allenai/Llama-3.1-Tulu-3-70B-DPOEpoch: Llama-3.1-Tulu-3-70B-DPO, Allen Institute for AI,University of Washingtonopendefault46.3%±2.427 Jan 2025Epoch AI log
277Qwen/Qwen2.5-32B-InstructEpoch: qwen2.5-32b-instruct, Alibabaopendefault46.1%±2.630 Jan 2025Epoch AI log
278openai/gpt-oss-20bEpoch: gpt-oss-20b_high, OpenAIopeneffort high46.0%±3.66 Aug 2026Epoch AI log
279gemini-1.5-pro-001Google DeepMindcloseddefault45.9%±2.627 Jan 2025Epoch AI log
280Qwen/Qwen3-4B-Instruct-2507Epoch: qwen3-4b-instruct-2507opendefault45.8%±2.928 Aug 2026Epoch AI log
281mistral-small-2501Mistral AIno page matchopendefault45.3%±2.530 Jan 2025Epoch AI log
282zai-org/GLM-4.7-FlashEpoch: glm-4.7-flash_noneopeneffort none45.1%±2.230 Aug 2026Epoch AI log
283deepseek-ai/DeepSeek-R1-Distill-Qwen-14BEpoch: DeepSeek-R1-Distill-Qwen-14B, DeepSeekopendefault44.7%±2.910 Mar 2025Epoch AI log
284meta-llama/Llama-3.1-70B-InstructEpoch: Llama-3.1-70B-Instruct, Meta AIopendefault44.2%±2.527 Jan 2025Epoch AI log
285Qwen/Qwen3-4BEpoch: qwen3-4b_none, Alibabaopeneffort none43.6%±2.728 Aug 2026Epoch AI log
286WizardLM-2-8x22BMicrosoftno page matchopendefault43.4%±2.327 Jan 2025Epoch AI log
287gpt-4-1106-previewOpenAIcloseddefault42.4%±2.427 Jan 2025Epoch AI log
288gpt-4-0125-previewOpenAIcloseddefault42.3%±2.727 Jan 2025Epoch AI log
289mistral-small-3.1-2503Mistral AIno page matchopendefault41.9%±2.330 Aug 2026Epoch AI log
290qwen-turbo-2024-11-01Alibabacloseddefault41.8%±2.67 Apr 2025Epoch AI log
291meta-llama/Llama-3.2-90B-Vision-InstructEpoch: Llama-3.2-90B-Vision-Instruct, Meta AIopendefault41.0%±2.327 Jan 2025Epoch AI log
292Qwen/Qwen2-72B-InstructEpoch: qwen2-72b-instruct, Alibabaopendefault40.8%±2.627 Jan 2025Epoch AI log
293claude-3-sonnet-20240229Anthropiccloseddefault40.6%±2.427 Jan 2025Epoch AI log
294meta-llama/Meta-Llama-3-70B-InstructEpoch: Meta-Llama-3-70B-Instruct, Meta AIopendefault40.6%±2.627 Jan 2025Epoch AI log
295gemini-1.5-flash-001Google DeepMindcloseddefault40.4%±2.427 Jan 2025Epoch AI log
296google/gemma-3-12b-itEpoch: gemma-3-12b-it, Google DeepMindopendefault39.5%±2.528 Aug 2026Epoch AI log
297mistral-large-2402Mistral AIcloseddefault38.8%±2.527 Jan 2025Epoch AI log
298claude-3-5-haiku-20241022Anthropiccloseddefault38.1%±2.612 Mar 2025Epoch AI log
299Qwen/Qwen3-1.7BEpoch: qwen3-1.7b, Alibabaopendefault38.0%±2.728 Aug 2026Epoch AI log
300gpt-4o-mini-2024-07-18OpenAIcloseddefault37.7%±2.427 Jan 2025Epoch AI log
301Hermes-2-Theta-Llama-3-70BNous Research,Arcee AIno page matchopendefault37.5%±2.527 Jan 2025Epoch AI log
302google/gemma-2-27b-itEpoch: gemma-2-27b-it, Google DeepMindopendefault36.5%±2.427 Jan 2025Epoch AI log
303claude-3-haiku-20240307Anthropiccloseddefault36.3%±2.427 Jan 2025Epoch AI log
304gpt-4-0314OpenAIcloseddefault35.7%±2.423 Oct 2025Epoch AI log
305Qwen/Qwen2.5-7B-InstructEpoch: qwen2.5-7b-instruct, Alibabaopendefault35.5%±2.330 Aug 2026Epoch AI log
306claude-2.0Anthropiccloseddefault34.7%±2.527 Jan 2025Epoch AI log
307open-mixtral-8x22bMistral AIno page matchopendefault34.1%±2.127 Jan 2025Epoch AI log
308gemini-1.0-pro-001Google DeepMindcloseddefault34.0%±2.027 Jan 2025Epoch AI log
309Eurus-2-7B-PRIMETsinghua University,University of Illinois Urbana-Champaign (UIUC),Shanghai AI Lab,Peking University,Shanghai Jiao Tong University,CUHK Shenzhen Research Instituteno page matchopendefault33.9%±2.127 Jan 2025Epoch AI log
310deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5BEpoch: DeepSeek-R1-Distill-Qwen-1.5B, DeepSeekopendefault33.6%±2.128 Aug 2026Epoch AI log
311claude-2.1Anthropiccloseddefault33.0%±2.327 Jan 2025Epoch AI log
312gemini-1.5-flash-8b-001Google DeepMindcloseddefault33.0%±2.412 Mar 2025Epoch AI log
313dbrx-instructDatabricksno page matchopendefault32.9%±3.327 Jan 2025Epoch AI log
31401-ai/Yi-1.5-34B-ChatEpoch: Yi-1.5-34B-Chat, 01.AIopendefault32.0%±2.027 Jan 2025Epoch AI log
315Qwen/Qwen1.5-32B-ChatEpoch: qwen1.5-32b-chat, Alibabaopendefault30.7%±2.027 Jan 2025Epoch AI log
316gpt-4-0613OpenAIcloseddefault30.7%±2.327 Jan 2025Epoch AI log
317Qwen/Qwen3-1.7BEpoch: qwen3-1.7b_none, Alibabaopeneffort none30.6%±2.328 Aug 2026Epoch AI log
318mistralai/Mixtral-8x7B-Instruct-v0.1Epoch: Mixtral-8x7B-Instruct-v0.1, Mistral AIopendefault30.6%±1.927 Jan 2025Epoch AI log
319open-mistral-nemo-2407Mistral AIno page matchopendefault29.9%±2.127 Jan 2025Epoch AI log
320open-mixtral-8x7bMistral AIno page matchopendefault29.8%±1.927 Jan 2025Epoch AI log
321Qwen/Qwen1.5-72B-ChatEpoch: qwen1.5-72b-chat, Alibabaopendefault28.8%±2.027 Jan 2025Epoch AI log
322ibm-granite/granite-4.0-microEpoch: granite-4.0-microopendefault28.3%±1.830 Aug 2026Epoch AI log
323gpt-3.5-turbo-1106OpenAIcloseddefault28.0%±1.927 Jan 2025Epoch AI log
324microsoft/Phi-3-medium-128k-instructEpoch: Phi-3-medium-128k-instruct, Microsoftopendefault27.6%±1.631 Jan 2025Epoch AI log
325google/gemma-2-9b-itEpoch: gemma-2-9b-it, Google DeepMindopendefault27.5%±2.327 Jan 2025Epoch AI log
326gpt-3.5-turbo-0125OpenAIcloseddefault27.2%±2.027 Jan 2025Epoch AI log
327ministral-8b-2410Mistral AIno page matchopendefault27.1%±2.127 Jan 2025Epoch AI log
328meta-llama/Llama-3.1-8B-InstructEpoch: Llama-3.1-8B-Instruct, Meta AIopendefault27.0%±1.927 Aug 2026Epoch AI log
329meta-llama/Llama-2-70b-chat-hfEpoch: Llama-2-70b-chat-hf, Meta AIopendefault26.3%±2.027 Jan 2025Epoch AI log
330meta-llama/Meta-Llama-3-8B-InstructEpoch: Meta-Llama-3-8B-Instruct, Meta AIopendefault26.1%±1.727 Jan 2025Epoch AI log
331ministral-3b-2410Mistral AIcloseddefault25.3%±1.927 Jan 2025Epoch AI log
332deepseek-ai/deepseek-llm-67b-chatEpoch: deepseek-llm-67b-chat, DeepSeekopendefault24.6%±1.427 Jan 2025Epoch AI log
333ibm-granite/granite-4.0-1bEpoch: granite-4.0-1bopendefault24.0%±1.628 Aug 2026Epoch AI log
334meta-llama/Llama-3.2-1B-InstructEpoch: Llama-3.2-1B-Instruct, Meta AIopendefault23.9%±1.630 Aug 2026Epoch AI log
335google/gemma-3-4b-itEpoch: gemma-3-4b-it, Google DeepMindopendefault23.2%±1.928 Aug 2026Epoch AI log
336google/gemma-3-1b-itEpoch: gemma-3-1b-it, Google DeepMindopendefault19.9%±1.528 Aug 2026Epoch AI log
337mistralai/Mistral-7B-Instruct-v0.3Epoch: Mistral-7B-Instruct-v0.3, Mistral AIopendefault15.2%±1.027 Jan 2025Epoch AI log
33801-ai/Yi-34B-ChatEpoch: Yi-34B-Chat, 01.AIopendefault14.7%±1.127 Jan 2025Epoch AI log
339open-mistral-7bMistral AIno page matchopendefault13.2%±1.027 Jan 2025Epoch AI log
340ibm-granite/granite-4.0-350mEpoch: granite-4.0-350mopendefault11.2%±0.928 Aug 2026Epoch AI log
341deepseek-ai/DeepSeek-R1-0528-Qwen3-8BEpoch: deepseek-r1-0528-qwen3-8bopendefault9.3%±1.128 Aug 2026Epoch AI log

Open-weight rows are shaded. Dates are when the result was run or evaluated, where the data says. Data from Epoch AI (CC-BY 4.0), fetched 19 Nov 2026: Epoch AI, ‘Capabilities & benchmarking’. Published online at epoch.ai. Retrieved from ‘https://epoch.ai/benchmarks’ [online resource]. Epoch AI. Method