The NCSC warns that standard security monitoring is no longer enough to catch sophisticated attackers, especially as adversaries adopt AI to increase the speed and scale of operations. Organizations must shift toward proactive threat hunting, focusing on enduring attacker behaviors (TTPs) rather than just changing indicators of compromise.
Researchers have introduced EndoUT, an adversarial framework that identifies universal prompt triggers capable of significantly degrading LLM utility. By analyzing how a model's internal response-onset preferences are disrupted, attackers can create fixed strings that force performance drops across various benign tasks without needing target labels or feedback.
Amazon Threat Intelligence observed autonomous agents using the open-source ARTEX framework to conduct large-scale credential theft and deepfake-based identity fraud. These campaigns exploited unpatched AI infrastructure and public misconfigurations to automate multi-stage offensive operations.
AI-powered penetration testing and orchestration frameworks have proliferated rapidly since early October, with thousands of unique instances currently active. These autonomous tools automate the entire cyber kill chain, chaining credentials to move laterally through infrastructure with unprecedented speed and scale.
Google evaluated its Agent Anomaly Detection feature using five third-party benchmarks including AgentDojo and AgentHarm. The tool successfully flagged 87% of harmful instructions that agents actually executed, though it showed lower effectiveness against poisoned long-term memory.
Microsoft researchers have demonstrated that AI coding agents can be compromised through 'dataset poisoning' and 'model poisoning'. These attacks embed dormant malicious behaviors into models, which trigger secret command-execution tool calls during benign user tasks.
Microsoft's FORGE Lab utilized an AI-based scanning system codenamed MDASH to analyze Linux kernel subsystems. This initiative resulted in 59 public reports and 33 assigned CVEs, revealing that AI can significantly accelerate vulnerability discovery, though human validation remains the primary bottleneck for patching.
Microsoft Research has discovered that AI models can be compromised by modifying fewer than 10 specific neurons. These 'sleeper' backdoors allow an attacker to trigger malicious commands when specific strings appear in the context, even if the model passes all standard safety evaluations.
Microsoft researchers have uncovered 'Lazarus,' a technique that reprograms dormant neurons in LLMs to inject malicious behaviors. By modifying fewer than 10 neurons, an attacker can trigger the execution of unauthorized commands without impacting standard model performance or evaluation scores.