Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

“Inference” — 82 articles ✕

Agents· Important· 🧪 Worth Testing

Cohere study: well-organized agent teams beat solo coding agents at a fraction of the cost

Cohere built a controlled testbed to study how teams of coding agents should be organized, testing where work is delegated, how leads wait on workers, which models play which role, team size, and communication patterns. On ProgramBench, well-organized teams outperformed single agents by up to ~10 percentage points but at 3–7x higher cost. The key finding: delegating only exploration and planning to workers matched the performance of delegating all stages (implementation and verification too) at half the cost, and a strong lead paired with 16 cheap planning workers reached 61.8% reward versus 63.2% for an all-strong-model team, cutting cost from $510 to $155.

Cohere
Cyber Security· Important· 🧪 Worth Testing

GitHub swaps LLM-based secret scanner for a lightweight ModernBERT classifier

GitHub replaced its LLM-based pipeline for detecting generic secrets (like passwords and API keys) with a fine-tuned ModernBERT classifier combined with regex candidate generation. The new two-stage system improved detection accuracy while cutting scan time and serving costs dramatically, and it's now fast enough to run during push protection, not just after code is committed.

GitHub
Models· Important· 🧪 Worth Testing

Liquid AI's new open-weight model runs agentic reasoning locally with just 2B active parameters

Liquid AI has published LFM2.5-24B-A2B, a mixture-of-experts model with 24B total parameters but only 2B active per token, designed to run reasoning agents on local hardware. The release expands the context window to 131K tokens, doubles the vocabulary size, and was trained on roughly double the pretraining data of its predecessor. On agentic and tool-use benchmarks the model performs on par with or better than models that have about 50% more parameters, while delivering fast inference speeds on both consumer and data-center hardware.

Hugging Face
Research· 🧪 Worth Testing

AWS open-sources MoE kernel optimizations for vLLM, cuts latency and boosts throughput on H200

AWS detailed three kernel-level optimizations for Mixture-of-Experts (MoE) model serving on Hopper GPUs, implemented in collaboration with the vLLM community and shipped in Amazon SageMaker AI's LMI container. The changes target the inefficiencies of fused MoE computation during low-batch decode, which previously left Tensor Cores underutilized. Combined, the optimizations deliver up to 10% higher throughput and up to 9% faster time-to-first-token (TTFT).

AWS Machine Learning
Business· Important· 🧪 Worth Testing

NVIDIA Open-Sources Run:ai GPU Orchestration Platform

NVIDIA has released the full Run:ai platform as open source, adding it as a foundation of the NVIDIA DSX AI Factory Platform for AI workload and GPU orchestration on Kubernetes. The release includes four modular components — KAI Scheduler, GPU Fractioning Operator, KAI Resource Management, and Workload Map — that can be adopted together or independently. Eight ecosystem partners, including Crusoe, Mirantis, Nebius, OpenNebula Systems, Rafay, Saturn Cloud, Spectro Cloud, and vCluster, are integrating the platform into their own offerings.

NVIDIA Developer
Research· Important· 🧪 Worth Testing

Amazon's 'Priming' Turns Pretrained Transformers Into Efficient Hybrid Models for Under 1% of Training Cost

Amazon Web Services researchers published a method called 'priming' that converts pretrained Transformer models into hybrid architectures mixing attention and state space model (SSM) layers, reusing existing weights instead of retraining from scratch. The approach cuts pretraining costs by over 99% and lets a 32-billion-parameter hybrid model match its source Transformer's quality while decoding up to twice as fast. Amazon tested three SSM types and released an open-source model zoo, training code, and serving tools under Apache 2.0.

Amazon Science
Agents· Important· 🧪 Worth Testing

AWS and Postman detail how Agent Mode scales AI agents to 40 million developers on Amazon Bedrock

AWS published a joint engineering write-up with Postman describing how Agent Mode, Postman's AI-native interface for API testing and documentation, was built to run in production at scale. Rather than model quality, the team found that tool sprawl and missing context were the biggest obstacles to reliable agent behavior. The post details architectural patterns including dynamic tool scoping, schema-based query access, dedicated context handlers, and how Amazon Bedrock provides model flexibility, cross-Region inference, data residency controls, and prompt caching.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Google Open-Sources ML Drift, a New GPU Engine for On-Device AI Inference

Google released ML Drift, an open-source, cross-platform GPU compute engine for on-device ML inference, replacing the legacy TFLite GPU delegate. It unifies shader handling across OpenGL ES, OpenCL, Metal and WebGPU, adds 5D tensor support, and introduces stage-aware optimizations for LLM prefill/decode. It is already running in production in Chrome, YouTube Shorts, Google Photos, Meet and partner apps from Adobe and Snap.

Google Developers
Cyber Security· Important· 🧪 Worth Testing

Cloudflare deploys multi-agent AI harness to triage security alerts at scale

Cloudflare built an AI agent system for its Managed Defense security service to handle the flood of alerts that overwhelm human analysts. Instead of one general-purpose agent analyzing everything, the system separates deterministic data collection from model-based reasoning and runs four specialist agents in parallel before a synthesis agent combines findings. The company says this reduces hallucinations and makes investigations auditable and reproducible.

Cloudflare Security
Models· Important· 🧪 Worth Testing

GLM 5.3 (753B MoE) from Z.ai launches on Amazon Bedrock with strong coding and security benchmarks

Z.ai's GLM 5.3, a 753-billion-parameter mixture-of-experts model optimized for coding and long-horizon agentic tasks, is now available as a fully managed model on Amazon Bedrock. It builds on GLM 5 with improved coding benchmark results, standout cybersecurity capabilities (CyberGym score of 84.5), and deeper Bedrock integration including OpenAI-compatible APIs, prompt caching, cross-Region inference and service tiers. AWS also demonstrates using GLM 5.3 with the open-source Strix agent for authorized penetration testing of your own applications.

AWS Machine Learning