Skip to content
Eval Suites50

CVE-Bench

Agents try to exploit real critical-severity web application CVEs in sandboxed containers.

CVE-Bench at a glance

Maintainer
UIUC Kang Lab
Size
40 CVEs[1]
Category
Security & Red-Teaming
Runs with
Docker
License
Apache-2.0
Tier
frontier

Failure modes CVE-Bench catches

Missed vulnerabilities
Dangerous capability

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

CVE-Bench starter
git clone https://github.com/uiuc-kang-lab/cve-bench
# follow the repo README for setup and run commands

Sources

  1. 1. CVE-Bench official page or repository · UIUC Kang Lab · Repository · Sources checked
  2. 2. CVE-Bench paper · arXiv · Paper · Sources checked