Skip to content
Weights Not Walls
Menu

Chess Puzzles

Re-run by Epoch AI

No description yet: we only describe an eval set when we can do it correctly.

Kind
Run independently by Epoch AI, with public logs. Our own re-runs are not built yet.
Score shown
Epoch's column "Best score (across scorers)", as a percentage, higher is better; random guessing scores about 5.0%. Error bars as the source gives them.
Results
166 in all: 25 for open-weight models, 138 for closed ones, 3 where Epoch does not say. 23 linked to a model page here.

Best open-weight result: deepseek-ai/DeepSeek-V4.1-Flash, 48.0%, number 24 of 166 results.

Chess Puzzles results
#ModelWeightsSettingScoreDateSource
1claude-fable-5-2_maxAnthropicclosedeffort max79.0%±4.16 Nov 2026Epoch AI
2gemini-4-carbon_highGoogle DeepMindclosedeffort high78.0%±4.22 Nov 2026Epoch AI
3gpt-6.2-astra_maxOpenAIclosedeffort max78.0%±4.227 Oct 2026Epoch AI
4gpt-6-astra_promaxOpenAIcloseddefault76.0%±4.315 Oct 2026Epoch AI log
5gpt-6-astra_maxOpenAIclosedeffort max74.0%±4.413 Oct 2026Epoch AI log
6gpt-5.6-sol_promaxOpenAIcloseddefault68.0%±4.714 Oct 2026Epoch AI log
7gpt-6.1-sol_maxOpenAIclosedeffort max68.0%±4.713 Oct 2026Epoch AI log
8claude-opus-5-5_maxAnthropicclosedeffort max67.0%±4.713 Oct 2026Epoch AI log
9gemini-3.7-flash_highGoogle DeepMindclosedeffort high66.0%±4.813 Oct 2026Epoch AI log
10gpt-5.5_xhighOpenAIclosedeffort xhigh63.0%±4.913 Oct 2026Epoch AI log
11gpt-5.5-pro_xhighOpenAIclosedeffort xhigh62.0%±4.914 Oct 2026Epoch AI log
12gemini-4-hydrogen_xhighGoogle DeepMindclosedeffort xhigh60.0%±4.913 Nov 2026Epoch AI log
13gpt-5.2-pro-2025-12-11_xhighOpenAIclosedeffort xhigh60.0%±4.914 Oct 2026Epoch AI log
14claude-sonnet-5-5_maxAnthropicclosedeffort max59.0%±4.913 Oct 2026Epoch AI log
15gemini-4-argon_highGoogle DeepMindclosedeffort high59.0%±4.913 Oct 2026Epoch AI log
16gpt-5.4-pro-2026-03-05_xhighOpenAIclosedeffort xhigh59.0%±4.914 Oct 2026Epoch AI log
17gpt-5.6-sol_maxOpenAIclosedeffort max59.0%±4.913 Oct 2026Epoch AI log
18gemini-3.8-flash_highGoogle DeepMindclosedeffort high58.0%±5.013 Oct 2026Epoch AI log
19gpt-6-sol_maxOpenAIclosedeffort max56.0%±5.013 Oct 2026Epoch AI log
20claude-haiku-5-5_maxAnthropicclosedeffort max55.0%±5.013 Oct 2026Epoch AI log
21claude-opus-4-8_maxAnthropicclosedeffort max52.0%±5.013 Oct 2026Epoch AI log
22gemini-3.1-pro-preview_highGoogle DeepMindclosedeffort high51.0%±5.013 Oct 2026Epoch AI log
23claude-fable-5-1_maxAnthropicclosedeffort max48.0%±5.013 Oct 2026Epoch AI log
24deepseek-ai/DeepSeek-V4.1-FlashEpoch: deepseek-v4.1-flash_max, DeepSeekopeneffort max48.0%±5.013 Oct 2026Epoch AI log
25gpt-5-pro-2025-10-06_highOpenAIclosedeffort high48.0%±5.014 Oct 2026Epoch AI log
26gpt-5.2-2025-12-11_xhighOpenAIclosedeffort xhigh48.0%±5.014 Oct 2026Epoch AI log
27gpt-5.4-2026-03-05_xhighOpenAIclosedeffort xhigh48.0%±5.013 Oct 2026Epoch AI log
28claude-fable-5_maxAnthropicclosedeffort max47.0%±5.013 Oct 2026Epoch AI log
29gpt-5.6-terra_maxOpenAIclosedeffort max47.0%±5.013 Oct 2026Epoch AI log
30deepseek-ai/DeepSeek-V4-Pro-0813Epoch: deepseek-v4-pro-0813_max, DeepSeekopeneffort max46.0%±5.013 Oct 2026Epoch AI log
31deepseek-ai/DeepSeek-V4.1-Flash-1017Epoch: deepseek-v4.1-flash-1017_max, DeepSeekopeneffort max46.0%±5.019 Oct 2026Epoch AI log
32qwen3.8-max_xhighAlibabaclosedeffort xhigh46.0%±5.013 Oct 2026Epoch AI log
33claude-fable-5_highAnthropicclosedeffort high45.0%±5.013 Oct 2026Epoch AI log
34claude-sonnet-5_maxAnthropicclosedeffort max45.0%±5.013 Oct 2026Epoch AI log
35gemini-3.5-flash_highGoogle DeepMindclosedeffort high45.0%±5.013 Oct 2026Epoch AI log
36gpt-5.2-2025-12-11_highOpenAIclosedeffort high45.0%±5.013 Oct 2026Epoch AI log
37gpt-5.4-nano-2026-03-17_xhighOpenAIclosedeffort xhigh45.0%±5.014 Oct 2026Epoch AI log
38moonshotai/Kimi-K3.1-ProEpoch: kimi-k3.1-pro-together_max, Moonshotopeneffort max45.0%±5.06 Nov 2026Epoch AI log
39claude-opus-5_maxAnthropicclosedeffort max43.0%±5.013 Oct 2026Epoch AI log
40gpt-5.6-luna_maxOpenAIclosedeffort max43.0%±5.013 Oct 2026Epoch AI log
41gemini-3.5-flash_lowGoogle DeepMindclosedeffort low42.0%±5.013 Oct 2026Epoch AI log
42gemini-3.6-flash_lowGoogle DeepMindclosedeffort low42.0%±5.013 Oct 2026Epoch AI log
43gpt-5.1-2025-11-13_highOpenAIclosedeffort high42.0%±5.013 Oct 2026Epoch AI log
44gpt-5.4-2026-03-05_highOpenAIclosedeffort high42.0%±5.013 Oct 2026Epoch AI log
45claude-opus-4-7_maxAnthropicclosedeffort max41.0%±4.913 Oct 2026Epoch AI log
46grok-4.7_xhighxAIclosedeffort xhigh41.0%±4.913 Oct 2026Epoch AI log
47doubao-seed-evolving_highByteDanceclosedeffort high40.0%±4.92 Nov 2026Epoch AI log
48gemini-3-flash-preview_highGoogle DeepMindclosedeffort high40.0%±4.913 Oct 2026Epoch AI log
49gemini-3.6-flash_highGoogle DeepMindclosedeffort high40.0%±4.913 Oct 2026Epoch AI log
50zai-org/GLM-5.3Epoch: glm-5.3_max, Z.ai (Zhipu AI)openeffort max37.0%±4.913 Oct 2026Epoch AI log
51gpt-5.4-2026-03-05_mediumOpenAIclosedeffort medium37.0%±4.913 Oct 2026Epoch AI log
52moonshotai/Kimi-K3Epoch: kimi-k3_high, Moonshotopeneffort high37.0%±4.913 Oct 2026Epoch AI log
53muse-spark-1.3_maxMeta AIclosedeffort max37.0%±4.913 Oct 2026Epoch AI log
54o3-2025-04-16_mediumOpenAIclosedeffort medium37.0%±4.913 Oct 2026Epoch AI log
55qwen3.8-max-0902_xhighAlibabaclosedeffort xhigh37.0%±4.913 Oct 2026Epoch AI log
56claude-opus-4-7_xhighAnthropicclosedeffort xhigh36.0%±4.813 Oct 2026Epoch AI log
57gpt-5-2025-08-07_highOpenAIclosedeffort high36.0%±4.813 Oct 2026Epoch AI log
58gpt-5.2-2025-12-11_mediumOpenAIclosedeffort medium36.0%±4.813 Oct 2026Epoch AI log
59gpt-5.4-nano-2026-03-17_highOpenAIclosedeffort high36.0%±4.813 Oct 2026Epoch AI log
60gpt-6-luna_maxOpenAIclosedeffort max36.0%±4.813 Oct 2026Epoch AI log
61moonshotai/Kimi-K3Epoch: kimi-k3_max, Moonshotopeneffort max36.0%±4.813 Oct 2026Epoch AI log
62o3-2025-04-16_highOpenAIclosedeffort high36.0%±4.813 Oct 2026Epoch AI log
63o3-2025-04-16_lowOpenAIclosedeffort low36.0%±4.813 Oct 2026Epoch AI log
64grok-4.5_highxAIclosedeffort high35.0%±4.813 Oct 2026Epoch AI log
65claude-sonnet-5_xhighAnthropicclosedeffort xhigh34.0%±4.813 Oct 2026Epoch AI log
66muse-spark-1.1_xhighMeta AIclosedeffort xhigh34.0%±4.813 Oct 2026Epoch AI log
67muse-spark-1.3_xhighMeta AIclosedeffort xhigh34.0%±4.813 Oct 2026Epoch AI log
68grok-4.6_highxAIclosedeffort high33.0%±4.713 Oct 2026Epoch AI log
69grok-4.6_xhighxAIclosedeffort xhigh33.0%±4.713 Oct 2026Epoch AI log
70mistral-large-4-0_highMistral AIno page matchopeneffort high33.0%±4.715 Oct 2026Epoch AI log
71deepseek-ai/DeepSeek-V4-Flash-0731Epoch: deepseek-v4-flash-0731_max, DeepSeekopeneffort max32.0%±4.713 Oct 2026Epoch AI log
72gpt-5-2025-08-07_mediumOpenAIclosedeffort medium32.0%±4.713 Oct 2026Epoch AI log
73claude-fable-5_lowAnthropicclosedeffort low31.0%±4.613 Oct 2026Epoch AI log
74gpt-5.6-sol_lowOpenAIclosedeffort low31.0%±4.613 Oct 2026Epoch AI log
75gpt-5.5_lowOpenAIclosedeffort low30.0%±4.613 Oct 2026Epoch AI log
76claude-opus-4-8_lowAnthropicclosedeffort low29.0%±4.613 Oct 2026Epoch AI log
77gemini-3.6-flash_minimalGoogle DeepMindclosedeffort minimal29.0%±4.613 Oct 2026Epoch AI log
78grok-4.20-0309-reasoningxAIcloseddefault29.0%±4.613 Oct 2026Epoch AI log
79mistral-large-4-0-oss_highMistral AIno page matchopeneffort high29.0%±4.62 Nov 2026Epoch AI log
80claude-opus-5_lowAnthropicclosedeffort low27.0%±4.513 Oct 2026Epoch AI log
81gemini-3.5-flash_minimalGoogle DeepMindclosedeffort minimal27.0%±4.513 Oct 2026Epoch AI log
82gpt-5-2025-08-07_lowOpenAIclosedeffort low27.0%±4.513 Oct 2026Epoch AI log
83gpt-5.6-terra_lowOpenAIclosedeffort low27.0%±4.513 Oct 2026Epoch AI log
84muse-spark-1.2_xhighMeta AIclosedeffort xhigh27.0%±4.513 Oct 2026Epoch AI log
85qwen3.7-maxAlibabacloseddefault27.0%±4.513 Oct 2026Epoch AI log
86claude-opus-4-7_lowAnthropicclosedeffort low26.0%±4.413 Oct 2026Epoch AI log
87doubao-seed-2.1-turbo-260628_highByteDanceclosedeffort high26.0%±4.430 Oct 2026Epoch AI log
88gpt-5.2-2025-12-11_lowOpenAIclosedeffort low26.0%±4.413 Oct 2026Epoch AI log
89claude-haiku-5-5_lowAnthropicclosedeffort low24.0%±4.313 Oct 2026Epoch AI log
90gpt-5-mini-2025-08-07_highOpenAIclosedeffort high24.0%±4.313 Oct 2026Epoch AI log
91claude-sonnet-4-6_maxAnthropicclosedeffort max23.0%±4.213 Oct 2026Epoch AI log
92gpt-5.1-2025-11-13_lowOpenAIclosedeffort low23.0%±4.213 Oct 2026Epoch AI log
93gpt-5.4-mini-2026-03-17_highOpenAIclosedeffort high23.0%±4.213 Oct 2026Epoch AI log
94zai-org/GLM-5.2Epoch: glm-5.2_max, Z.ai (Zhipu AI)openeffort max22.0%±4.214 Oct 2026Epoch AI log
95gpt-5-nano-2025-08-07_highOpenAIclosedeffort high22.0%±4.213 Oct 2026Epoch AI log
96o4-mini-2025-04-16_mediumOpenAIclosedeffort medium22.0%±4.213 Oct 2026Epoch AI log
97claude-opus-4-6_maxAnthropicclosedeffort max21.0%±4.113 Oct 2026Epoch AI log
98doubao-seed-2.1-pro-260628_highByteDanceclosedeffort high21.0%±4.128 Oct 2026Epoch AI log
99gemini-3.5-flash-lite_lowGoogle DeepMindclosedeffort low21.0%±4.113 Oct 2026Epoch AI log
100zai-org/GLM-4.7Epoch: glm-4.7, Z.ai (Zhipu AI)opendefault21.0%±4.114 Oct 2026Epoch AI log
101zai-org/GLM-5.3-FlashEpoch: glm-5.3-flash_max, Z.ai (Zhipu AI)openeffort max21.0%±4.113 Oct 2026Epoch AI log
102thinkingmachines/InklingEpoch: Inkling_xhigh, Thinking Machinesopeneffort xhigh21.0%±4.113 Oct 2026Epoch AI log
103doubao-seed-2.0-lite-260428_highByteDanceclosedeffort high20.0%±4.028 Oct 2026Epoch AI log
104doubao-seed-2.0-pro-260215_highByteDanceclosedeffort high20.0%±4.028 Oct 2026Epoch AI log
105zai-org/GLM-5.1Epoch: glm-5.1, Z.ai (Zhipu AI)opendefault20.0%±4.014 Oct 2026Epoch AI log
106gpt-5.4-nano-2026-03-17_lowOpenAIclosedeffort low20.0%±4.013 Oct 2026Epoch AI log
107moonshotai/Kimi-K2.6Epoch: kimi-k2.6, Moonshotopendefault20.0%±4.013 Oct 2026Epoch AI log
108claude-opus-4-8_noneAnthropicclosedeffort none19.0%±3.913 Oct 2026Epoch AI log
109claude-sonnet-4-6_highAnthropicclosedeffort high19.0%±3.913 Oct 2026Epoch AI log
110deepseek-ai/DeepSeek-V4-ProEpoch: deepseek-v4-pro_max, DeepSeekopeneffort max19.0%±3.913 Oct 2026Epoch AI log
111zai-org/GLM-5.2Epoch: glm-5.2_none, Z.ai (Zhipu AI)openeffort none19.0%±3.914 Oct 2026Epoch AI log
112gpt-5.4-2026-03-05_lowOpenAIclosedeffort low19.0%±3.913 Oct 2026Epoch AI log
113zai-org/GLM-5.2Epoch: glm-5.2_low, Z.ai (Zhipu AI)openeffort low18.0%±3.914 Oct 2026Epoch AI log
114grok-4.3_highxAIclosedeffort high18.0%±3.913 Oct 2026Epoch AI log
115moonshotai/Kimi-K3Epoch: kimi-k3_low, Moonshotopeneffort low18.0%±3.913 Oct 2026Epoch AI log
116gpt-5.4-mini-2026-03-17_xhighOpenAIclosedeffort xhigh17.0%±3.813 Oct 2026Epoch AI log
117gpt-5.6-luna_lowOpenAIclosedeffort low17.0%±3.813 Oct 2026Epoch AI log
118MiniMaxAI/MiniMax-M3Epoch: MiniMax-M3, MiniMaxopendefault17.0%±3.813 Oct 2026Epoch AI log
119claude-sonnet-4-6_mediumAnthropicclosedeffort medium16.0%±3.713 Oct 2026Epoch AI log
120deepseek-ai/DeepSeek-V4-ProEpoch: deepseek-v4-pro_high, DeepSeekopeneffort high16.0%±3.713 Oct 2026Epoch AI log
121gemini-3.5-flash-lite_highGoogle DeepMindclosedeffort high16.0%±3.713 Oct 2026Epoch AI log
122gpt-5-mini-2025-08-07_lowOpenAIclosedeffort low16.0%±3.713 Oct 2026Epoch AI log
123qwen3.6-plusAlibabacloseddefault16.0%±3.713 Oct 2026Epoch AI log
124gpt-5-nano-2025-08-07_lowOpenAIclosedeffort low15.0%±3.613 Oct 2026Epoch AI log
125o3-mini-2025-01-31_highOpenAIclosedeffort high15.0%±3.613 Oct 2026Epoch AI log
126o4-mini-2025-04-16_lowOpenAIclosedeffort low15.0%±3.613 Oct 2026Epoch AI log
127claude-opus-4-5-20251101_59KAnthropiccloseddefault14.0%±3.513 Oct 2026Epoch AI log
128moonshotai/Kimi-K2.7-CodeEpoch: kimi-k2.7-code, Moonshotopendefault14.0%±3.513 Oct 2026Epoch AI log
129qwen3.5-flashAlibabanot stateddefault14.0%±3.513 Oct 2026Epoch AI log
130o4-mini-2025-04-16_highOpenAIclosedeffort high13.0%±3.413 Oct 2026Epoch AI log
131qwen3.6-flashAlibabanot stateddefault12.0%±3.313 Oct 2026Epoch AI log
132gpt-4.1-2025-04-14OpenAIcloseddefault11.0%±3.113 Oct 2026Epoch AI log
133gpt-5-2025-08-07_minimalOpenAIclosedeffort minimal11.0%±3.113 Oct 2026Epoch AI log
134o1-2024-12-17_lowOpenAIclosedeffort low11.0%±3.113 Oct 2026Epoch AI log
135o3-mini-2025-01-31_mediumOpenAIclosedeffort medium11.0%±3.113 Oct 2026Epoch AI log
136claude-sonnet-4-5-20250929_32KAnthropiccloseddefault10.0%±3.013 Oct 2026Epoch AI log
137claude-sonnet-4-5-20250929_59KAnthropiccloseddefault10.0%±3.013 Oct 2026Epoch AI log
138o1-2024-12-17_highOpenAIclosedeffort high10.0%±3.013 Oct 2026Epoch AI log
139gpt-4o-2024-08-06OpenAIcloseddefault9.0%±2.913 Oct 2026Epoch AI log
140gpt-5.5_noneOpenAIclosedeffort none9.0%±2.913 Oct 2026Epoch AI log
141qwen3.5-plusAlibabanot stateddefault9.0%±2.913 Oct 2026Epoch AI log
142claude-haiku-4-5-20251001_59KAnthropiccloseddefault8.0%±2.713 Oct 2026Epoch AI log
143MiniMaxAI/MiniMax-M3Epoch: MiniMax-M3_none, MiniMaxopeneffort none8.0%±2.713 Oct 2026Epoch AI log
144o1-2024-12-17_mediumOpenAIclosedeffort medium8.0%±2.713 Oct 2026Epoch AI log
145gemini-3.5-flash-lite_minimalGoogle DeepMindclosedeffort minimal7.0%±2.613 Oct 2026Epoch AI log
146gpt-5.6-sol_noneOpenAIclosedeffort none7.0%±2.613 Oct 2026Epoch AI log
147claude-sonnet-4-5-20250929Anthropiccloseddefault6.0%±2.413 Oct 2026Epoch AI log
148gpt-5.1-2025-11-13_noneOpenAIclosedeffort none6.0%±2.413 Oct 2026Epoch AI log
149o3-mini-2025-01-31_lowOpenAIclosedeffort low6.0%±2.413 Oct 2026Epoch AI log
150claude-haiku-4-5-20251001_32KAnthropiccloseddefault5.0%±2.213 Oct 2026Epoch AI log
151claude-opus-4-5-20251101Anthropiccloseddefault5.0%±2.213 Oct 2026Epoch AI log
152claude-opus-4-5-20251101_32KAnthropiccloseddefault5.0%±2.213 Oct 2026Epoch AI log
153gpt-5.6-terra_noneOpenAIclosedeffort none5.0%±2.213 Oct 2026Epoch AI log
154seed-1.6ByteDancecloseddefault5.0%±2.230 Oct 2026Epoch AI log
155claude-3-opus-20240229Anthropiccloseddefault4.0%±2.013 Oct 2026Epoch AI log
156deepseek-ai/DeepSeek-V4-ProEpoch: deepseek-v4-pro_none, DeepSeekopeneffort none4.0%±2.013 Oct 2026Epoch AI log
157gpt-4o-mini-2024-07-18OpenAIcloseddefault3.0%±1.713 Oct 2026Epoch AI log
158gpt-5.4-2026-03-05_noneOpenAIclosedeffort none3.0%±1.713 Oct 2026Epoch AI log
159gpt-5.6-luna_noneOpenAIclosedeffort none3.0%±1.713 Oct 2026Epoch AI log
160gpt-5-nano-2025-08-07_minimalOpenAIclosedeffort minimal2.0%±1.413 Oct 2026Epoch AI log
161gpt-5.2-2025-12-11_noneOpenAIclosedeffort none2.0%±1.413 Oct 2026Epoch AI log
162gpt-5.4-mini-2026-03-17_noneOpenAIclosedeffort none2.0%±1.413 Oct 2026Epoch AI log
163gpt-5.4-nano-2026-03-17_noneOpenAIclosedeffort none2.0%±1.413 Oct 2026Epoch AI log
164gpt-4.1-mini-2025-04-14OpenAIcloseddefault1.0%±1.013 Oct 2026Epoch AI log
165gpt-4.1-nano-2025-04-14OpenAIcloseddefault0.0%13 Oct 2026Epoch AI log
166gpt-5-mini-2025-08-07_minimalOpenAIclosedeffort minimal0.0%13 Oct 2026Epoch AI log

Open-weight rows are shaded. Dates are when the result was run or evaluated, where the data says. Data from Epoch AI (CC-BY 4.0), fetched 19 Nov 2026: Epoch AI, ‘Capabilities & benchmarking’. Published online at epoch.ai. Retrieved from ‘https://epoch.ai/benchmarks’ [online resource]. Epoch AI. Method