Skip to content
Eval Suites50

WebArena

Browser agents complete tasks on self-hosted e-commerce, forum, GitLab, and CMS sites, graded on final page or DB state.

WebArena at a glance

Maintainer
WebArena authors / Carnegie Mellon University
Size
812 tasks[1]
Category
Agents & Tool Use
Runs with
Self-hosted sandbox
License
Apache-2.0
Tier
frontier

Failure modes WebArena catches

Navigation loops
Form errors
Wrong final state

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

WebArena starter
git clone https://github.com/web-arena-x/webarena
# follow the repo README for setup and run commands

Sources

  1. 1. WebArena official page or repository · WebArena authors / Carnegie Mellon University · Repository · Sources checked
  2. 2. WebArena paper · arXiv · Paper · Sources checked