FRAMES
Multi-hop questions that combine several Wikipedia articles, testing retrieval, reasoning, and factuality together.
Failure modes FRAMES catches
Multi-hop gaps
Temporal errors
Numeric reasoning
Starter command
A starting point, not a guarantee. Commands change between releases, so confirm against the official README.
pip install datasets
python -c "from datasets import load_dataset; print(load_dataset('google/frames-benchmark'))"Sources
- 1. FRAMES official page or repository · Google · Repository · Sources checked
- 2. FRAMES paper · arXiv · Paper · Sources checked