Skip to content
Weights Not Walls
Menu

Remote Labor Index

Reported

No description yet: we only describe an eval set when we can do it correctly.

Kind
Published by a third party's leaderboard, collected by Epoch AI. The leaderboard is named and linked.
Score shown
Epoch's column "Score", as a percentage, higher is better; random guessing scores about 0.0%. The source gives no error bars.
Results
20 in all: 1 for open-weight models, 19 for closed ones. 1 linked to a model page here.

Best open-weight result: deepseek-ai/DeepSeek-V4.1-Flash, 9.6%, number 8 of 20 results.

Remote Labor Index results
#ModelWeightsSettingScoreDateSource
1claude-fable-5-2_unknownAnthropicclosedeffort unknown41.3%not datedvia Epoch AI
2claude-opus-5-5_unknownAnthropicclosedeffort unknown21.3%not datedvia Epoch AI
3gpt-6-astra_unknownOpenAIclosedeffort unknown20.8%not datedvia Epoch AI
4claude-fable-5-1_unknownAnthropicclosedeffort unknown17.9%not datedvia Epoch AI
5gemini-4-argon_unknownGoogle DeepMindclosedeffort unknown17.1%not datedvia Epoch AI
6claude-fable-5Anthropiccloseddefault16.1%not datedvia Epoch AI
7claude-fable-5_unknownAnthropicclosedeffort unknown15.8%not datedvia Epoch AI
8deepseek-ai/DeepSeek-V4.1-FlashEpoch: deepseek-v4.1-flash_unknown, DeepSeekopeneffort unknown9.6%not datedvia Epoch AI
9claude-opus-4-8_unknownAnthropicclosedeffort unknown8.3%not datedvia Epoch AI
10gpt-5.5_unknownOpenAIclosedeffort unknown6.3%not datedvia Epoch AI
11gemini-3.8-flash_unknownGoogle DeepMindclosedeffort unknown5.8%not datedvia Epoch AI
12gemini-3.7-flash_unknownGoogle DeepMindclosedeffort unknown5.0%not datedvia Epoch AI
13claude-opus-4-6_unknownAnthropicclosedeffort unknown4.2%not datedvia Epoch AI
14claude-opus-4-5-20251101_unknownAnthropicclosedeffort unknown3.8%not datedvia Epoch AI
15gpt-5.2-2025-12-11_mediumOpenAIclosedeffort medium2.5%not datedvia Epoch AI
16claude-sonnet-4-5-20250929_unknownAnthropicclosedeffort unknown2.1%not datedvia Epoch AI
17gpt-5.2-2025-12-11_unknownOpenAIclosedeffort unknown2.1%not datedvia Epoch AI
18gpt-5-2025-08-07_unknownOpenAIclosedeffort unknown1.7%not datedvia Epoch AI
19gemini-3-pro-previewGoogle DeepMindcloseddefault1.3%not datedvia Epoch AI
20gemini-2.5-pro-preview-06-05Google DeepMindcloseddefault0.8%not datedvia Epoch AI

Open-weight rows are shaded. Dates are when the result was run or evaluated, where the data says. Data from Epoch AI (CC-BY 4.0), fetched 19 Nov 2026: Epoch AI, ‘Capabilities & benchmarking’. Published online at epoch.ai. Retrieved from ‘https://epoch.ai/benchmarks’ [online resource]. Epoch AI. Method