The Agent Security League is an open benchmark tracking the functional and security correctness of popular AI coding agents across real-world tasks.
Agent Security League
Updated as new commercial agents and models ship. Sorted by security correctness.
Methodology
Peer-reviewed research
The Agent Security League extends SusVibes, a foundational benchmark developed at Carnegie Mellon University.
Real-world tasks
The benchmark consists of 200 tasks drawn from 108 open-source Python projects spanning 77 CWE vulnerability classes.
Anti-cheating safeguards
Our evaluation pipeline includes prompt hardening, workspace sanitization, and automated cheating detection.
Resources
Security in every line, so you can code without compromise.
AI coding agents can write code, but they lack security context. AURI is the security harness your coding agent is missing.
Always free for developers.