Skip to content
Eval Suites50

GAIA

General-assistant questions that need web browsing, file reading, and multi-step tool use, with short exact answers.

GAIA at a glance

Maintainer
Meta; Hugging Face; AutoGPT
Size
466 questions[1]
Category
Agents & Tool Use
Runs with
Inspect AI
License
Not stated by the source. Check before commercial use.
Tier
production

Failure modes GAIA catches

Shallow search
Tool chaining errors
Answer format drift

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

GAIA starter
pip install inspect-ai inspect-evals
inspect eval inspect_evals/gaia --model openai/gpt-4.1 --limit 20

Sources

  1. 1. GAIA official page or repository · Meta; Hugging Face; AutoGPT · Repository · Sources checked
  2. 2. GAIA paper · arXiv · Paper · Sources checked