Ragas
starterMetrics library for RAG pipelines: faithfulness, response relevancy, context precision, and context recall, many reference-free.
- Size
- Library (bring your data)
- Runs with
- Python / Ragas
- License
- Apache-2.0
- Category
- RAG
RAG and factuality suites check whether answers are supported by evidence, whether retrieval found the right context, and whether a model declines when it doesn't know.
7 of 7 suites
Metrics library for RAG pipelines: faithfulness, response relevancy, context precision, and context recall, many reference-free.
Hand-crafted prompts for deep-research agents that need many search steps to assemble complete answer sets.
Multi-hop questions that combine several Wikipedia articles, testing retrieval, reasoning, and factuality together.
Short fact-seeking questions graded correct, incorrect, or not attempted, so declining beats a confident wrong answer.
Questions where common human misconceptions are the tempting answer; measures whether models repeat falsehoods.
Generated and human-annotated hallucination samples across QA, dialogue, and summarization for detection testing.
Collects 20 datasets of unanswerable, underspecified, false-premise, and stale questions to test whether models abstain. Noncommercial license.
Size and license come from each suite's primary source. Not stated means the source doesn't declare a license; check the repo before commercial use.