Skip to content
Eval Suites50

τ-bench / τ²-bench

Multi-turn agents follow domain policy while talking to a simulated user. τ²-bench adds a telecom domain where agent and user both act on shared state (dual-control).

τ-bench / τ²-bench at a glance

Maintainer
Sierra
Size
165 tasks (τ) · 278 (τ²)[1]
Category
Agents & Tool Use
Runs with
Python
License
MIT
Tier
production

Failure modes τ-bench / τ²-bench catches

Policy violations
Inconsistent retries
Wrong DB state

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

τ-bench / τ²-bench starter
git clone https://github.com/sierra-research/tau2-bench
# follow the repo README for setup and run commands

Sources

  1. 1. τ-bench / τ²-bench official page or repository · Sierra · Repository · Sources checked
  2. 2. τ-bench / τ²-bench paper · arXiv · Paper · Sources checked