OSWorld
ReportedTasks done in a real desktop operating system through the screen, keyboard and mouse.
- Kind
- Published by a third party's leaderboard, collected by Epoch AI. The leaderboard is named and linked.
- Link
- https://os-world.github.io/
- Score shown
- Epoch's column "Score", as a percentage, higher is better; random guessing scores about 0.0%. The source gives no error bars.
- Results
- 20 in all: 3 for open-weight models, 14 for closed ones, 3 where Epoch does not say. 1 linked to a model page here.
Best open-weight result: moonshotai/Kimi-K2.5, 63.3%, number 3 of 20 results.
| # | Model | Weights | Setting | Score | Date | Source |
|---|---|---|---|---|---|---|
| 1 | claude-sonnet-4-6Anthropic | closed | Agent: claude-sonnet-4-6 (100 steps) | 72.1% | not dated | OS World Website |
| 2 | claude-opus-4-5-20251101Anthropic | closed | Agent: Claude Opus 4.5 | 66.3% | 25 Nov 2025 | Anthropic annoucement |
| 3 | moonshotai/Kimi-K2.5Epoch: kimi-k2.5, Moonshot | open | Agent: Kimi-K2.5 | 63.3% | 3 Feb 2026 | OS World Website |
| 4 | claude-sonnet-4-5-20250929Anthropic | closed | Agent: claude-sonnet-4-5-20250929 (100 steps) | 62.9% | 30 Oct 2025 | OS World Website |
| 5 | claude-sonnet-4-5-20250929Anthropic | closed | Agent: claude-sonnet-4-5-20250929 (50 steps) | 58.1% | 30 Oct 2025 | OS World Website |
| 6 | claude-sonnet-4-20250514Anthropic | closed | Agent: claude-4-sonnet-20250514 (50 steps) | 43.9% | 27 Jul 2025 | OS World Website |
| 7 | claude-sonnet-4-5-20250929Anthropic | closed | Agent: claude-sonnet-4-5-20250929 (15 steps) | 42.9% | 30 Oct 2025 | OS World Website |
| 8 | claude-sonnet-4-20250514Anthropic | closed | Agent: claude-4-sonnet-20250514 (100 steps) | 41.4% | 27 Jul 2025 | OS World Website |
| 9 | claude-3-7-sonnet-20250219Anthropic | closed | Agent: claude-3-7-sonnet-20250219 (50 steps) | 35.8% | 27 Jul 2025 | OS World Website |
| 10 | claude-3-7-sonnet-20250219Anthropic | closed | Agent: claude-3-7-sonnet-20250219 (100 steps) | 35.6% | 27 Jul 2025 | OS World Website |
| 11 | computer-use-preview-2025-03-11 | not stated | Agent: computer-use-preview (50 steps) | 31.3% | 27 Jul 2025 | OS World Website |
| 12 | claude-sonnet-4-20250514Anthropic | closed | Agent: claude-4-sonnet-20250514 (15 steps) | 31.2% | 27 Jul 2025 | OS World Website |
| 13 | computer-use-preview-2025-03-11 | not stated | Agent: computer-use-preview (100 steps) | 30.5% | 27 Jul 2025 | OS World Website |
| 14 | claude-3-7-sonnet-20250219Anthropic | closed | Agent: claude-3-7-sonnet-20250219 (15 steps) | 27.1% | 27 Jul 2025 | OS World Website |
| 15 | computer-use-preview-2025-03-11 | not stated | Agent: computer-use-preview (15 steps) | 26.0% | 27 Jul 2025 | OS World Website |
| 16 | o3-2025-04-16_mediumOpenAI | closed | effort medium; Agent: o3 (100 steps) | 23.0% | 27 Jul 2025 | OS World Website |
| 17 | o3-2025-04-16_mediumOpenAI | closed | effort medium; Agent: o3 (50 steps) | 17.2% | 27 Jul 2025 | OS World Website |
| 18 | o3-2025-04-16_mediumOpenAI | closed | effort medium; Agent: o3 (15 steps) | 9.1% | 27 Jul 2025 | OS World Website |
| 19 | Qwen2.5-VL-72B-InstructAlibabano page match | open | Agent: qwen2.5-vl-72b-instruct (100 steps) | 5.0% | 27 Jul 2025 | OS World Website |
| 20 | Qwen2.5-VL-72B-InstructAlibabano page match | open | Agent: qwen2.5-vl-72b-instruct (15 steps) | 4.4% | 27 Jul 2025 | OS World Website |
Open-weight rows are shaded. Dates are when the result was run or evaluated, where the data says. Data from Epoch AI (CC-BY 4.0), fetched 19 Nov 2026: Epoch AI, ‘Capabilities & benchmarking’. Published online at epoch.ai. Retrieved from ‘https://epoch.ai/benchmarks’ [online resource]. Epoch AI. Method