Skip to content
Eval Suites50

Braintrust Autoevals

Open-source scorer library (factuality, closed QA, JSON diff, embeddings) usable alone or with Braintrust's commercial platform.

Braintrust Autoevals at a glance

Maintainer
Braintrust
Size
Library[1]
Category
Harnesses & Runners
Runs with
TypeScript / Python
License
MIT
Tier
starter

Failure modes Braintrust Autoevals catches

Factual errors
Schema mismatches

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

Braintrust Autoevals starter
pip install autoevals
# or: npm install autoevals

Sources

  1. 1. Braintrust Autoevals official page or repository · Braintrust · Repository · Sources checked