Skip to content
Eval Suites50

Inspect Evals

Community collection of benchmarks packaged for Inspect AI: safety, cyber, coding, reasoning, and knowledge. Maintained by Generality Labs; founded with the UK AI Security Institute.

Inspect Evals at a glance

Maintainer
Generality Labs (founded with UK AI Security Institute)
Size
Collection (many evals)[1]
Category
Security & Red-Teaming
Runs with
Inspect AI
License
MIT
Tier
production

Failure modes Inspect Evals catches

Capability gaps
Unsafe behavior
Cyber uplift

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

Inspect Evals starter
pip install inspect-ai inspect-evals
inspect eval inspect_evals/gpqa_diamond --model openai/gpt-4.1 --limit 20

Sources

  1. 1. Inspect Evals official page or repository · Generality Labs (founded with UK AI Security Institute) · Repository · Sources checked