Skip to content
Eval Suites50

IFEval

Prompts with verifiable instructions such as word limits, required keywords, and formats, checked by code instead of a judge.

IFEval at a glance

Maintainer
Google Research
Size
541 prompts[1]
Category
Voice & Multimodal
Runs with
Inspect AI
License
Apache-2.0
Tier
starter

Failure modes IFEval catches

Format violations
Length violations
Ignored constraints

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

IFEval starter
pip install inspect-ai inspect-evals
inspect eval inspect_evals/ifeval --model openai/gpt-4.1 --limit 20

Sources

  1. 1. IFEval official page or repository · Google Research · Repository · Sources checked
  2. 2. IFEval paper · arXiv · Paper · Sources checked