LiveCodeBench
Competitive programming problems collected over time with release dates, so you can score only problems published after a model's cutoff.
Failure modes LiveCodeBench catches
Contamination
Edge-case failures
Timeouts
Starter command
A starting point, not a guarantee. Commands change between releases, so confirm against the official README.
git clone https://github.com/LiveCodeBench/LiveCodeBench
# follow the repo README for setup and run commandsSources
- 1. LiveCodeBench official page or repository · LiveCodeBench authors · Repository · Sources checked
- 2. LiveCodeBench paper · arXiv · Paper · Sources checked