TruthfulQA
Questions where common human misconceptions are the tempting answer; measures whether models repeat falsehoods.
Failure modes TruthfulQA catches
Imitative falsehoods
False premises
Starter command
A starting point, not a guarantee. Commands change between releases, so confirm against the official README.
pip install inspect-ai inspect-evals
inspect eval inspect_evals/truthfulqa --model openai/gpt-4.1 --limit 20Sources
- 1. TruthfulQA official page or repository · Stephanie Lin; Jacob Hilton; Owain Evans · Repository · Sources checked
- 2. TruthfulQA paper · arXiv · Paper · Sources checked