HumanEval+ (EvalPlus)
HumanEval's 164 problems with roughly 80x more tests, catching code that passed the original thin test suites.
Failure modes HumanEval+ (EvalPlus) catches
Edge-case bugs
Off-by-one
Type errors
Starter command
A starting point, not a guarantee. Commands change between releases, so confirm against the official README.
pip install evalplus
evalplus.evaluate --model gpt-4.1 --dataset humaneval --backend openaiSources
- 1. HumanEval+ (EvalPlus) official page or repository · EvalPlus team · Repository · Sources checked
- 2. HumanEval+ (EvalPlus) paper · arXiv · Paper · Sources checked