Inspect Evals
Community collection of benchmarks packaged for Inspect AI: safety, cyber, coding, reasoning, and knowledge. Maintained by Generality Labs; founded with the UK AI Security Institute.
Failure modes Inspect Evals catches
Capability gaps
Unsafe behavior
Cyber uplift
Starter command
A starting point, not a guarantee. Commands change between releases, so confirm against the official README.
pip install inspect-ai inspect-evals
inspect eval inspect_evals/gpqa_diamond --model openai/gpt-4.1 --limit 20Sources
- 1. Inspect Evals official page or repository · Generality Labs (founded with UK AI Security Institute) · Repository · Sources checked