Skip to content
Eval Suites50

Promptfoo

Declarative YAML test suites with deterministic and model-graded assertions, red-teaming, and a GitHub Action for PR gates.

Promptfoo at a glance

Maintainer
Promptfoo (now part of OpenAI)
Size
Tool (bring your tests)[1]
Category
Harnesses & Runners
Runs with
Promptfoo CLI
License
MIT
Tier
starter

Failure modes Promptfoo catches

Prompt regressions
Injection
Format drift

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

Promptfoo starter
npx promptfoo@latest init
npx promptfoo@latest eval

Sources

  1. 1. Promptfoo official page or repository · Promptfoo (now part of OpenAI) · Repository · Sources checked