Skip to content
Sunday, 22 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

#AWS — 35 articles ✕

Automation· Important· 🧪 Worth Testing

Amazon launches Global Inference Gateway for cross-region LLM load balancing

Amazon has introduced the Global Inference Gateway for SageMaker HyperPod, enabling a single endpoint to route requests across multiple clusters and AWS Regions. The gateway manages traffic based on real-time health and load signals like KV cache utilization and queue depth, automating cross-region failover.

AWS Machine Learning
Automation· Important· 🧪 Worth Testing

Amazon launches verifiable AI-driven document extraction

Amazon Textract Insights now provides generative AI capabilities that extract structured data from documents while offering confidence scores and page-level grounding. It supports processing mixed-document packets, splitting them automatically, and matching them to predefined or custom blueprints.

AWS Machine Learning
Cyber Security· Important· 🧪 Worth Testing

Enforce least-privilege for AI agents with new AWS GetScopedCredentials API

AWS has launched the GetScopedCredentials API, allowing you to dynamically reduce the permissions of temporary credentials. This enables you to provide AI agents or sub-agents with only the access they strictly require for a specific task, rather than granting them the full scope of the parent session.

AWS Security
Cyber Security· Important· 🧪 Worth Testing

Google extends Agent Anomaly Detection to cross-cloud deployments

Google has expanded its Agent Anomaly Detection service to support agents running outside Google Cloud, such as those on AWS Lambda or Microsoft Foundry. The service uses telemetry and logs to identify behavioral drift, unauthorized tool usage, and resource exhaustion without needing access to the runtime environment.

Google Developers
Agents· Important· 🧪 Worth Testing

Enabling private identity verification for Amazon Bedrock agents

Amazon Bedrock AgentCore Identity now permits agents to authenticate against internal identity providers using private certificate authorities (CAs). This update removes the need for public endpoints when your organization self-hosts services like Keycloak or PingFederate within a VPC.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Kimi Code CLI adds native Amazon Bedrock authentication

Moonshot AI has updated the Kimi Code CLI to v2.7.0, introducing a native Amazon Bedrock provider. This allows developers to authenticate using standard AWS credential chains and SSO instead of managing separate, long-lived API keys.

AWS Machine Learning
Automation· Important· 🧪 Worth Testing

Amazon SageMaker introduces native cross-Region inference routing

Amazon SageMaker AI now supports native cross-Region inference routing, allowing you to automatically shift traffic to healthy endpoints in different regions during capacity shortages. This feature manages failover, health monitoring, and traffic recovery without requiring custom code on the critical request path.

AWS Machine Learning
Voice AI· Important· 🧪 Worth Testing

Amazon Polly adds native voice cloning capabilities

Amazon Polly has introduced a new voice cloning feature that builds synthetic voices from as little as two to ten minutes of speaker audio. This tool is now available through a gated release for seven languages and integrates directly with existing AWS cloud workflows for enhanced security and brand consistency.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Amazon Bedrock AgentCore updates include built-in tools and lifecycle hooks

Amazon Bedrock AgentCore has upgraded its underlying harness to the Strands framework. This update introduces built-in capabilities like web retrieval, task planning, and automatic context management, alongside new lifecycle hooks for deterministic control over agent execution.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Secure Private API Access for Amazon Bedrock AgentCore via Centralized Inspection

Amazon has published a reference architecture for connecting Bedrock AgentCore to private REST APIs and MCP servers in restricted network environments. By utilizing a VPC Lattice resource gateway placed in a dedicated network-account VPC, traffic between agents and internal tools is forced through a central inspection firewall.

AWS Machine Learning
Automation· Important· 🧪 Worth Testing

Optimizing large JSON workloads for AI agents

AWS details three strategies to manage massive JSON payloads (20MB+) in AI agents, achieving up to 71% fewer tokens and 80% lower latency. The approach involves offloading state to Amazon S3, paginating large tool results, and compacting dictionary outputs.

AWS Machine Learning
Cyber Security· Important· 🧪 Worth Testing

Secure Architecture Patterns for Amazon Bedrock AgentCore Runtime

Amazon has published a security guide for exposing AI agents via Bedrock AgentCore Runtime, emphasizing the need for robust ingress controls. The guide details how to prevent cross-tenant leakage and privilege escalation using identity propagation and layered authorization.

AWS Security
Automation· Important· 🧪 Worth Testing

Amazon launches integrated AI data preparation tools for SageMaker

Amazon has introduced new AI-driven data preparation capabilities within SageMaker to streamline the creation and maintenance of high-quality training and evaluation datasets. These features include auto-labeling, synthetic data generation, and automated data quality checks, controllable via Python SDK or AI-ML coding agents.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Scaling LLM Inference with NVIDIA Dynamo on SageMaker HyperPod

AWS now provides managed support for NVIDIA Dynamo within SageMaker HyperPod, simplifying the deployment of large-scale language models. This update introduces multi-node inference, allowing teams to run models that exceed single-GPU memory through disaggregated prefill and decode worker pools.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Amazon SageMaker AI introduces KV cache-aware routing for LLMs

Amazon SageMaker AI has launched a new 'KV_AWARE' routing strategy that directs LLM inference requests to instances based on their actual KV cache state rather than just prompt headers. This optimizes multi-turn conversations and long-context workloads by ensuring requests land where relevant data is already cached.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Amazon Bedrock introduces automated memory for agentic applications

Amazon Bedrock has launched a new memory-aware capability for AgenticRetrieveStream. This feature automates the storage, extraction, and retrieval of user-specific facts and conversation histories, allowing agents to provide context-aware responses while maintaining strict document-level access control.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Optimizing coding agent costs on Amazon Bedrock with NVIDIA NeMo Switchyard

Amazon has released a reference architecture that integrates the NVIDIA NeMo Switchyard library with LiteLLM to dynamically route coding agent requests between different models on Bedrock. By using stage or random routing, you can shift traffic between high-capability and high-efficiency models to balance performance and cost.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

AWS launches SGLang support for Trainium chips

Amazon has released SGLang-Neuron, a plugin allowing developers to run large-scale AI models on AWS Trainium hardware using the standard SGLang interface. This integration enables native PyTorch execution and supports advanced features like PD disaggregation over EFA for optimized serving.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

AWS Updates Bedrock AgentCore Runtime for Faster, More Efficient AI Agents

Amazon has released a next-generation runtime for Bedrock AgentCore designed to handle complex, long-running AI agent workloads. The update brings hardware-isolated environments with faster startup times, increased compute capacity, and improved cost efficiency through usage-based billing.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Implementing Secure Fine-Grained Access Control in Amazon Bedrock Managed Knowledge Bases

Amazon introduced a pattern for securing multi-tenant AI agents by ensuring that RAG search queries are scoped to specific users. The solution uses ACL-aware knowledge bases combined with a request interceptor in the AgentCore Gateway to deterministically inject verified user identities into tool calls, preventing LLMs or prompt injections from accessing unauthorized data.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Direct Web Search Access Added to Amazon Bedrock AgentCore

Amazon now offers a direct Web Search API for Bedrock AgentCore, enabling developers to perform web searches via standard AWS SDKs and CLI. This bypasses the need for the AgentCore Gateway, simplifying the process for custom agent loops and non-agent applications that require real-time information.

AWS Machine Learning
Business· Important· 🧪 Worth Testing

AWS adds usage-based billing for SageMaker bidirectional streaming

Amazon has enabled usage-based software metering for bidirectional streaming models on SageMaker AI. Previously, software charges for long-running streaming sessions were difficult to capture, as they could not be reconciled with simple HTTP response headers. Model providers can now report usage incrementally via a dedicated metadata WebSocket connection.

AWS Machine Learning
Cyber Security· Important· 🧪 Worth Testing

Mitigating memory poisoning in Amazon Bedrock AgentCore

Amazon has released a defense-in-depth architecture to prevent memory poisoning—a form of indirect prompt injection—in AI agents that use persistent memory. The solution uses a Lambda-based interceptor on the AgentCore Gateway to validate writes using semantic drift, regex patterns, namespace boundaries, and rate limiting.

AWS Security