Skip to content
Eval Suites50

CyberSecEval 3

Meta's PurpleLlama suite for insecure code generation, prompt injection, and offensive-cyber risk.

CyberSecEval 3 at a glance

Maintainer
Meta
Size
Multiple sub-benchmarks[1]
Category
Security & Red-Teaming
Runs with
Python
License
MIT
Tier
production

Failure modes CyberSecEval 3 catches

Insecure code
Prompt injection
Cyberattack help

Starter command

A starting point, not a guarantee. Commands change between releases, so confirm against the official README.

CyberSecEval 3 starter
git clone https://github.com/meta-llama/PurpleLlama
# follow the repo README for setup and run commands

Sources

  1. 1. CyberSecEval 3 official page or repository · Meta · Repository · Sources checked
  2. 2. CyberSecEval 3 paper · arXiv · Paper · Sources checked