Last updated Aug 05, 2026
Online-Mind2Web Leaderboard
The official leaderboard's latest evaluation data, as reported by our Scout
Human evaluation table selected
| Agent | Model | Organization | Source | Easy | Medium | Hard | Average SR | Date |
|---|---|---|---|---|---|---|---|---|
| Hark | Hark Handoff | Hark | Careerflow.ai | 100.0 | 95.0 | 100.0 | 97.7% | Aug 04, 2026 |
| Navigator | n1.5-latest | Yutori | Careerflow.ai | 100.0 | 96.5 | 96.1 | 97.3% | Jun 28, 2026 |
| ACT-2 | GPT-5.4 | Enhans | Careerflow.ai | 93.0 | 94.3 | 89.9 | 92.7% | Aug 04, 2026 |
| Navigator | n1-preview-11-2025 | Yutori | Halluminate | 90.1 | 76.2 | 71.1 | 78.7% | Nov 18, 2025 |
| Google Computer Use (09-2025) | Gemini 2.5 Computer Use | Google DeepMind | Google DeepMind | 77.1 | 71.3 | 55.4 | 69.0% | Sep 29, 2025 |
| Operator | OpenAI Computer-Using Agent | OpenAI | OSU NLP | 83.1 | 58.0 | 43.2 | 61.3% | Mar 22, 2025 |
| ACT-1-20250814 | o3-2025-04-16 and Claude-sonnet-4-20250514 | Enhans | Enhans | 81.9 | 54.5 | 35.1 | 57.3% | Aug 23, 2025 |
| Claude Computer Use 3.7 (w/o thinking) | Claude-3-7-sonnet-20250219 | Anthropic | OSU NLP | 90.4 | 49.0 | 32.4 | 56.3% | Apr 20, 2025 |
| ACT-1-20250703 | o3-2025-04-16 and Claude-sonnet-4-20250514 | Enhans | Enhans | 65.1 | 46.2 | 23.0 | 45.7% | Jul 16, 2025 |
| SeeAct | gpt-4o-2024-08-06 | OSU | OSU NLP | 60.2 | 25.2 | 8.1 | 30.7% | Mar 22, 2025 |
| Browser Use | gpt-4o-2024-08-06 | Browser Use | OSU NLP | 55.4 | 26.6 | 8.1 | 30.0% | Mar 22, 2025 |
| Claude Computer Use 3.5 | claude-3-5-sonnet-20241022 | Anthropic | OSU NLP | 56.6 | 20.3 | 14.9 | 29.0% | Mar 22, 2025 |
| Agent-E | gpt-4o-2024-08-06 | Emergence AI | OSU NLP | 49.4 | 26.6 | 6.8 | 28.0% | Mar 22, 2025 |
Frequently asked questions
Resources
Paper (arXiv 2504.01382)Code (GitHub · OSU-NLP)Dataset (Hugging Face)Official leaderboard (Hugging Face Space)
Citation
@article{xue2025illusionprogressassessingcurrent,
title={An Illusion of Progress? Assessing the Current State of Web Agents},
author={Tianci Xue and Weijian Qi and Tianneng Shi and Chan Hee Song and
Boyu Gou and Dawn Song and Huan Sun and Yu Su},
year={2025},
eprint={2504.01382},
archivePrefix={arXiv},
primaryClass={cs.AI},
url={https://arxiv.org/abs/2504.01382},
}