Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.
Amazon has added OpenFold3-preview to SageMaker JumpStart, allowing users to deploy models for predicting 3D structures of proteins, DNA, RNA, and ligands. The implementation utilizes asynchronous inference endpoints to handle long-running predictions while supporting cost-efficient autoscaling and scale-to-zero capabilities.
Amazon Threat Intelligence observed autonomous agents using the open-source ARTEX framework to conduct large-scale credential theft and deepfake-based identity fraud. These campaigns exploited unpatched AI infrastructure and public misconfigurations to automate multi-stage offensive operations.
Amazon has released SGLang-Neuron, a plugin allowing developers to run large-scale AI models on AWS Trainium hardware using the standard SGLang interface. This integration enables native PyTorch execution and supports advanced features like PD disaggregation over EFA for optimized serving.
Amazon has released a next-generation runtime for Bedrock AgentCore designed to handle complex, long-running AI agent workloads. The update brings hardware-isolated environments with faster startup times, increased compute capacity, and improved cost efficiency through usage-based billing.
Amazon introduced a pattern for securing multi-tenant AI agents by ensuring that RAG search queries are scoped to specific users. The solution uses ACL-aware knowledge bases combined with a request interceptor in the AgentCore Gateway to deterministically inject verified user identities into tool calls, preventing LLMs or prompt injections from accessing unauthorized data.
Amazon introduced a framework for identifying silent data corruption (SDC) in distributed training, where faulty hardware returns incorrect math without triggering standard error logs. By integrating three custom checks—gradient sanity checks, ring replay audits, and weight fingerprinting—into PyTorch DDP training loops, you can identify, isolate, and replace failing nodes.
Amazon now offers a direct Web Search API for Bedrock AgentCore, enabling developers to perform web searches via standard AWS SDKs and CLI. This bypasses the need for the AgentCore Gateway, simplifying the process for custom agent loops and non-agent applications that require real-time information.
AWS has published a guide on creating an event-driven architecture to automatically sync Model Context Protocol (MCP) tool schemas with the AWS Agent Registry. Using AWS CloudTrail, EventBridge, and Lambda, this pipeline detects runtime changes and updates the registry whenever an MCP server's tool schema evolves.
Amazon has released the Universal Agent Evaluation Framework (UAEF), an open-source tool designed to standardize the evaluation of AI agents. It uses adapters to normalize execution traces from various frameworks like LangChain and LangGraph into a single format, enabling consistent measurement across 36 metrics and 7 quality dimensions.
Amazon has enabled usage-based software metering for bidirectional streaming models on SageMaker AI. Previously, software charges for long-running streaming sessions were difficult to capture, as they could not be reconciled with simple HTTP response headers. Model providers can now report usage incrementally via a dedicated metadata WebSocket connection.
Amazon Bedrock AgentCore now includes a comprehensive catalog of built-in, third-party, and custom evaluators to monitor agent behavior in production. The platform allows you to run metrics from DeepEval and AutoEval in a managed environment, supporting on-demand, online, and batch evaluation workflows.
Moonshot AI has introduced Kimi K3.1 Pro Highspeed, a new model on Amazon Bedrock optimized for long-horizon agentic tasks and coding. The model delivers 2–3 times faster output than the standard version and includes configurable reasoning, tool calling, and support for explicit prompt caching to optimize costs.
Amazon introduced Mitra-v2, a tabular foundation model trained entirely on synthetic data. This version improves upon its predecessor by scaling the pretraining data size and introducing a hybrid structural causal model prior to better reflect real-world data relationships.
Amazon has expanded the capabilities of the AgenticRetrieveStream API, allowing developers to specify the iteration level for knowledge base requests. You can now choose between zero, one, or multiple retrieval steps to balance speed, cost, and complexity per request.
Amazon introduced a seven-layer reference architecture to move AI agent applications from initial prototypes to production-ready systems. The framework emphasizes a modular, pluggable design using stable contracts between layers such as data, inference, orchestration, and security.
Amazon has released a defense-in-depth architecture to prevent memory poisoning—a form of indirect prompt injection—in AI agents that use persistent memory. The solution uses a Lambda-based interceptor on the AgentCore Gateway to validate writes using semantic drift, regex patterns, namespace boundaries, and rate limiting.