Amazon Threat Intelligence observed autonomous agents using the open-source ARTEX framework to conduct large-scale credential theft and deepfake-based identity fraud. These campaigns exploited unpatched AI infrastructure and public misconfigurations to automate multi-stage offensive operations.
Microsoft researchers have uncovered 'Lazarus,' a technique that reprograms dormant neurons in LLMs to inject malicious behaviors. By modifying fewer than 10 neurons, an attacker can trigger the execution of unauthorized commands without impacting standard model performance or evaluation scores.
Researchers have introduced RL-ATTACK, a novel framework that uses reinforcement learning to generate adversarial attacks against language models without needing access to internal model gradients. By learning from the target model's responses, this method achieves superior query efficiency and successfully bypasses safety filters by forcing unintended outputs.
Collinear AI has launched CWE-bench v2, a benchmarking suite featuring 100 tasks covering 91 common vulnerability types. The tool allows developers to programmatically evaluate how effectively their AI agents find and fix security weaknesses in open-source repositories.
Researchers introduced CoFiBreak, a reward mechanism for training attacker LLMs that forces a higher diversity of jailbreak strategies. By using a coarse-to-fine reward structure in Group Relative Policy Optimization, the method avoids the typical reinforcement learning collapse where models converge on a narrow set of repetitive prompts.
Google Project Zero analyzed how LLM-based systems (BigSleep) compare to traditional generative fuzzers (Fuzzilli) in finding V8 JavaScript engine vulnerabilities. Over six months, both methods independently discovered unique bugs, with an estimated overlap of approximately 25-60%.
GitHub replaced its LLM-based pipeline for detecting generic secrets (like passwords and API keys) with a fine-tuned ModernBERT classifier combined with regex candidate generation. The new two-stage system improved detection accuracy while cutting scan time and serving costs dramatically, and it's now fast enough to run during push protection, not just after code is committed.
AWS describes a new two-stage access control architecture for Retrieval Augmented Generation (RAG) in Amazon Quick and Amazon Bedrock Knowledge Bases. Instead of relying only on periodically synced access control lists (ACLs), the system now verifies permissions in real time against the authoritative data source (e.g. Google Drive, SharePoint, Confluence) at query time, before passing content to the LLM. AWS says this closes security gaps caused by stale or incorrectly mapped permissions between sync cycles. Mondelēz International, with over 35,000 employees, is cited as a customer using this approach.
GitHub Security Lab built an open-source 'Taskflow Agent' that uses custom AI prompt workflows to audit code for vulnerabilities, and used it to find and report over 24 vulnerabilities in Android applications. Two detailed examples show the agent finding a location-tracking flaw in the OsmAnd navigation app and an account-takeover chain in the Wikipedia Android app via a deeplink parsing bug. The team notes LLMs are strong at finding complex logic vulnerabilities and understand API behavior well, but struggle to correctly judge severity and often produce false positives, so findings still require human review. The taskflows are open source and can be run on any GitHub repository via a Copilot-powered codespace script, though running them consumes premium model requests and can take hours.