Skip to content
Eval Suites50

HaluEval

Generated and human-annotated hallucination samples across QA, dialogue, and summarization for detection testing.

HaluEval at a glance

Maintainer
RUCAIBox / Renmin University of China
Size
35,000 samples[1]
Category
RAG & Factuality
Runs with
Python
License
MIT
Tier
starter

Failure modes HaluEval catches

Undetected hallucinations
Fabricated details

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

HaluEval starter
git clone https://github.com/RUCAIBox/HaluEval
# follow the repo README for setup and run commands

Sources

  1. 1. HaluEval official page or repository · RUCAIBox / Renmin University of China · Repository · Sources checked
  2. 2. HaluEval paper · arXiv · Paper · Sources checked