IFEval
Prompts with verifiable instructions such as word limits, required keywords, and formats, checked by code instead of a judge.
Failure modes IFEval catches
Format violations
Length violations
Ignored constraints
Starter command
A starting point, not a guarantee. Commands change between releases, so confirm against the official README.
pip install inspect-ai inspect-evals
inspect eval inspect_evals/ifeval --model openai/gpt-4.1 --limit 20Sources
- 1. IFEval official page or repository · Google Research · Repository · Sources checked
- 2. IFEval paper · arXiv · Paper · Sources checked