Orca Security built Discovery AI, an Amazon Bedrock-based agent that turns plain-English security questions into structured queries against its Sonar system, which tracks over 900 cloud resource types. Rather than relying on one large model with the full schema stuffed into every prompt, the production version splits the work across nine specialized stages and multiple foundation models. The result: dramatically lower cost, faster responses, and better accuracy on complex queries, now running live since March 2026.
AWS detailed three kernel-level optimizations for Mixture-of-Experts (MoE) model serving on Hopper GPUs, implemented in collaboration with the vLLM community and shipped in Amazon SageMaker AI's LMI container. The changes target the inefficiencies of fused MoE computation during low-batch decode, which previously left Tensor Cores underutilized. Combined, the optimizations deliver up to 10% higher throughput and up to 9% faster time-to-first-token (TTFT).
NVIDIA has released the full Run:ai platform as open source, adding it as a foundation of the NVIDIA DSX AI Factory Platform for AI workload and GPU orchestration on Kubernetes. The release includes four modular components — KAI Scheduler, GPU Fractioning Operator, KAI Resource Management, and Workload Map — that can be adopted together or independently. Eight ecosystem partners, including Crusoe, Mirantis, Nebius, OpenNebula Systems, Rafay, Saturn Cloud, Spectro Cloud, and vCluster, are integrating the platform into their own offerings.
IBM Research used a coordinated multi-agent 'agent factory' to explore hardware design optimizations for a quantum error-correction decoder, comparing proprietary and open frontier models under the same 100-hypothesis search budget. The open-model configuration, run on-premises via IBM's llm-d distributed inference framework, achieved a 52x speedup over baseline for about $26 in inference cost, versus $299 for a proprietary-model configuration that reached a higher 204x speedup. The study highlights that cache-aware routing and efficient serving (98% prefix-cache hit rate, ~$0.11 per million tokens) made the open-model approach dramatically cheaper while still finding valid, compact hardware designs.
Apple ML researchers published a NeurIPS paper introducing SELFCOMPACT, a scaffold that lets language model agents decide for themselves when and how to compact their own accumulated context, rather than relying on fixed-interval summarization triggered by a token count. It combines a compaction tool the model can call with a lightweight rubric telling it when to fire (a sub-task is resolved) and when to hold off (mid-derivation or stuck). Tested on six benchmarks and seven models, it matched or beat fixed-interval summarization while using far fewer tokens.
Amazon Web Services researchers published a method called 'priming' that converts pretrained Transformer models into hybrid architectures mixing attention and state space model (SSM) layers, reusing existing weights instead of retraining from scratch. The approach cuts pretraining costs by over 99% and lets a 32-billion-parameter hybrid model match its source Transformer's quality while decoding up to twice as fast. Amazon tested three SSM types and released an open-source model zoo, training code, and serving tools under Apache 2.0.
At the OCP Global Summit, NVIDIA contributed its Vera Rubin rack and compute tray designs to the open MGX architecture and announced a series of partnerships covering AI factory power, cooling and networking standards. Partners include hyperscalers such as Meta, Google, Microsoft and AMD, plus Cisco and Visionbay. The announcements cover rack design specs (MGX 1.2), new open-source software for managing AI data centers (DSX OS components), grid resilience standards, an 800VDC power architecture, new Ethernet switching (Spectrum-6) and a new optical transceiver standard (USFP) with Cisco.
On 12 October 2026 GitLab shipped versions 19.4.2, 19.3.4 and 19.2.8, closing 24 security holes in self-managed CE/EE. The headline fix is CVE-2026-97229, a CVSS 10.0 bug in the CI/CD regex compiler where weak expression validation causes an integer overflow, letting an unauthenticated attacker craft a CI/CD configuration that executes code on the server. CERT-EU is pushing organisations to patch immediately, with internet-facing GitLab instances first in line.
Mistral AI has released Voxtral Mini 4B Realtime Arabic, a streaming speech-to-text model fine-tuned for Arabic dialects, Modern Standard Arabic, and code-switching between languages. The 4.4-billion-parameter model processes 16 kHz audio in real time with a configurable transcription delay, achieving an 8.82% average Character Error Rate across seven Arabic benchmarks at a 480ms delay — close to the offline Voxtral Transcribe Arabic model's 7.91% CER. It was co-developed with Morocco's digital transition ministry as part of a sovereign AI partnership and is released under Apache 2.0.
Anthropic has introduced a beta option on its Claude Platform that allows a Managed Agents agent to construct its own workflow for large, multi-part jobs, such as going through hundreds of documents. Instead of handling everything in one pass, the agent splits the task into phases, delegates pieces across multiple sub-agents, and merges their output into a single result. The job is handed off to the server, which executes it asynchronously and reports progress through a stream of events.
AWS published a joint engineering write-up with Postman describing how Agent Mode, Postman's AI-native interface for API testing and documentation, was built to run in production at scale. Rather than model quality, the team found that tool sprawl and missing context were the biggest obstacles to reliable agent behavior. The post details architectural patterns including dynamic tool scoping, schema-based query access, dedicated context handlers, and how Amazon Bedrock provides model flexibility, cross-Region inference, data residency controls, and prompt caching.
NVIDIA described a workflow built into Megatron Core that makes large-scale pretraining bitwise deterministic, meaning independent or checkpoint-resumed training runs follow the exact same numerical trajectory. Using tensor fingerprinting across training phases, modules, operations and kernels, engineers can trace nondeterminism down to a specific kernel and fix it. On a trillion-parameter Nemotron model running on 2,432 GPUs, optimizations brought the performance cost of enforcing determinism (the 'determinism tax') down to about 2%, while keeping bitwise-identical results over 800 training steps.
AWS published a case study on Amazon Bedrock AgentCore payments, a managed feature that lets AI agents autonomously pay for services like model inference, one request at a time, using the x402 payment protocol. Incarna used it to let its agents pay BlockRun, a multi-provider inference router, for each individual model call, settling in USDC on the Base blockchain. AWS says Incarna cut integration time from a scoped two to three months down to three days and about 200 lines of code. During the beta, agents processed over 1,000 payments ranging from $0.001 to $0.05 per call.
Google introduced AQuA (Ambient Quality Agent), a tool that runs continuously beside production AI agents inside a Google Cloud project to find failures that don't show up in logs or health checks, such as skipped validation steps or dropped context between sub-agents. It samples production session traces, grades them against a checklist, clusters recurring failure patterns, verifies clusters against full transcripts, and tracks them over time as new, recurring, or resolved. On request, it can also trace a failure back to the exact line of code or prompt responsible, using an immutable source snapshot captured at deploy time.
Google Cloud announced the Gemini agent, a unified agent that combines chat, knowledge work, content creation, and coding into one interface accessible across devices and channels. It integrates directly inside Gmail, Docs, Sheets, Slides, Chat, and Calendar, connects to enterprise tools and databases via MCP and a tools registry, and orchestrates across multiple models — including Google's Gemini family and Anthropic's Claude — to balance quality and cost. Google also detailed security/governance features, cost controls like Smart Routing and spend caps, and shared customer results from companies like BNP Paribas, Bradesco, and Orange Spain.
Google has released the Developer Knowledge API, a structured, machine-readable source for Google Cloud, Firebase and Android documentation aimed at AI agents and developer tooling. Instead of scraping web pages or relying on an LLM's training cutoff, agents and CLIs can now query fresh, Markdown-formatted docs through several interfaces: a gcloud CLI surface, an installable agent skill, client libraries, and a browser-based API explorer. The underlying index is refreshed frequently so retrieved answers stay close to the latest published documentation.
AWS describes a new two-stage access control architecture for Retrieval Augmented Generation (RAG) in Amazon Quick and Amazon Bedrock Knowledge Bases. Instead of relying only on periodically synced access control lists (ACLs), the system now verifies permissions in real time against the authoritative data source (e.g. Google Drive, SharePoint, Confluence) at query time, before passing content to the LLM. AWS says this closes security gaps caused by stale or incorrectly mapped permissions between sync cycles. Mondelēz International, with over 35,000 employees, is cited as a customer using this approach.
Anthropic has launched Claude Haiku 5.5 (claude-haiku-5-5), positioned as its most capable Haiku model for high-volume, latency-sensitive work. It supports a 1 million token context window, up to 128k max output tokens, and adaptive thinking controlled via a new effort parameter. The model is available on the Claude API, Amazon Bedrock, Claude Platform on AWS, Google Cloud, and Microsoft Foundry. Anthropic warns that code written for the previous Haiku 4.5 model may break on the new version.
Cloudflare built an AI agent system for its Managed Defense security service to handle the flood of alerts that overwhelm human analysts. Instead of one general-purpose agent analyzing everything, the system separates deterministic data collection from model-based reasoning and runs four specialist agents in parallel before a synthesis agent combines findings. The company says this reduces hallucinations and makes investigations auditable and reproducible.
Cisco Talos reports that coordinated groups of autonomous AI agents have already struck real-world targets, pointing to prior incidents at Hugging Face, DSEWiki and RubyGems. Talos argues these look more like noisy, high-volume penetration tests than disciplined red-team operations, but expects agents to get quieter and more persistent as attackers tune them for stealth instead of speed. The post lays out a defensive playbook built around rehearsed incident response, assume-breach testing, agent-specific tabletop drills, phishing-resistant MFA everywhere, and much deeper internal monitoring.
Deepgram has expanded its medical-specialized speech model, Nova-3 Medical, from English-only to 10 languages including Spanish, German, Hindi, Japanese and Russian, with automatic code switching in both batch and streaming modes. On a 115-hour curated medical audio test set, the multilingual medical model cut word error rate by 25-30% and entity error rate (drugs, doses, conditions) by 37-40% compared to Deepgram's general-purpose multilingual model. It also beat competing models from ElevenLabs and Microsoft on average word error rate across all 10 languages.
Apple researchers, with National University of Singapore collaborators, published a paper on RISED, a new training framework for LLM agents that must learn across many different interactive environments at once. Instead of relying only on scalar reward signals, RISED uses an LLM judge to tag each training rollout with rubrics describing its behaviour, then uses these rubric tags to select training data and to supply extra supervision. The authors report RISED achieves the highest average success rate across environments compared to existing approaches, ranking first or second in every tested environment.
Anthropic has merged its Project Glasswing and Cyber Verification Program into a single, expanded CVP with three access tiers: Defense Access, Red Team Access, and Specialized Access. Each tier unlocks progressively fewer safety blocks on cyber-related tasks in Claude Opus 5.5, Claude Sonnet 5.5, and Claude Mythos 5.1 for vetted security organizations. Anthropic also published benchmark results and vulnerability-discovery numbers from the earlier Glasswing program to justify the expansion.
AssemblyAI introduced the Sync API, a new transport for transcribing short audio clips: one HTTP POST request returns a finished Universal-3.5 Pro transcript in the same response, at roughly 134ms median latency. It fills the gap between the Async API (submit-and-poll, 5-6 seconds of added latency) and the Realtime API (WebSocket, built for ongoing sessions), targeting workloads like dictation, voice-agent turn transcription, IVR, and push-to-talk. Clips from 80ms to 2 minutes and up to 40MB are supported, with word error rate of 1.59% on short-form audio. Pricing is $0.45/hr, the same rate as Universal-3.5 Pro Realtime.