Skip to content
Eval Suites50

OSWorld

Open-ended computer-use tasks on real desktop apps in Ubuntu, checked by execution-based scripts.

OSWorld at a glance

Maintainer
XLang Lab / OSWorld authors (including HKU and Salesforce Research)
Size
369 tasks[1]
Category
Agents & Tool Use
Runs with
Sandbox VM
License
Apache-2.0
Tier
frontier

Failure modes OSWorld catches

Misclicks
Lost UI state
Unfinished workflows

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

OSWorld starter
git clone https://github.com/xlang-ai/OSWorld
# follow the repo README for setup and run commands

Sources

  1. 1. OSWorld official page or repository · XLang Lab / OSWorld authors (including HKU and Salesforce Research) · Repository · Sources checked
  2. 2. OSWorld paper · arXiv · Paper · Sources checked