Cyber Security· Important
AWS's autonomous pentest agent exploits 33 of 37 fresh CVEs end-to-end
AWS tested its AWS Security Agent (now part of AWS Continuum) against a freshly built benchmark of 37 real, recently disclosed CVEs, each run as a live containerized target with a hidden flag. Starting from a low-privilege endpoint with only a one-line hint and no proof-of-concept, the agent, running on Claude Opus 5, captured 33 of 37 flags through genuine end-to-end exploitation after an integrity audit, with 2 captures reclassified as unintended-path solves and 2 genuine misses where the agent broke the target before extracting the flag. AWS built this benchmark to avoid the contamination problem of public CVE suites, which models may have memorized from training data.