Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

“LLM” — 81 articles ✕

Voice AI· 🧪 Worth Testing

Small Fine-Tuned Model Learns to Follow New Regulated Call Scripts Without Retraining

Researchers describe a system called FlowSpec that converts a creditor's legal call procedure into machine-readable instructions, tool restrictions, training signals and test cases for a voice agent. A 9-billion-parameter model was trained on calls covering nearly 300 randomly generated procedures, then tested on four procedures it had never encountered, including one entirely held-out family of scripts, to see whether compliance behavior transfers.

arXiv cs.CL
Cyber Security· Important· 🧪 Worth Testing

GitHub swaps LLM-based secret scanner for a lightweight ModernBERT classifier

GitHub replaced its LLM-based pipeline for detecting generic secrets (like passwords and API keys) with a fine-tuned ModernBERT classifier combined with regex candidate generation. The new two-stage system improved detection accuracy while cutting scan time and serving costs dramatically, and it's now fast enough to run during push protection, not just after code is committed.

GitHub
Models· Important· 🧪 Worth Testing

Liquid AI's new open-weight model runs agentic reasoning locally with just 2B active parameters

Liquid AI has published LFM2.5-24B-A2B, a mixture-of-experts model with 24B total parameters but only 2B active per token, designed to run reasoning agents on local hardware. The release expands the context window to 131K tokens, doubles the vocabulary size, and was trained on roughly double the pretraining data of its predecessor. On agentic and tool-use benchmarks the model performs on par with or better than models that have about 50% more parameters, while delivering fast inference speeds on both consumer and data-center hardware.

Hugging Face
Agents· Important· 🧪 Worth Testing

Orca Security cuts natural-language query costs 90% using a staged Bedrock agent pipeline

Orca Security built Discovery AI, an Amazon Bedrock-based agent that turns plain-English security questions into structured queries against its Sonar system, which tracks over 900 cloud resource types. Rather than relying on one large model with the full schema stuffed into every prompt, the production version splits the work across nine specialized stages and multiple foundation models. The result: dramatically lower cost, faster responses, and better accuracy on complex queries, now running live since March 2026.

AWS Machine Learning
Research· 🧪 Worth Testing

AWS open-sources MoE kernel optimizations for vLLM, cuts latency and boosts throughput on H200

AWS detailed three kernel-level optimizations for Mixture-of-Experts (MoE) model serving on Hopper GPUs, implemented in collaboration with the vLLM community and shipped in Amazon SageMaker AI's LMI container. The changes target the inefficiencies of fused MoE computation during low-batch decode, which previously left Tensor Cores underutilized. Combined, the optimizations deliver up to 10% higher throughput and up to 9% faster time-to-first-token (TTFT).

AWS Machine Learning
Business· Important· 🧪 Worth Testing

NVIDIA Open-Sources Run:ai GPU Orchestration Platform

NVIDIA has released the full Run:ai platform as open source, adding it as a foundation of the NVIDIA DSX AI Factory Platform for AI workload and GPU orchestration on Kubernetes. The release includes four modular components — KAI Scheduler, GPU Fractioning Operator, KAI Resource Management, and Workload Map — that can be adopted together or independently. Eight ecosystem partners, including Crusoe, Mirantis, Nebius, OpenNebula Systems, Rafay, Saturn Cloud, Spectro Cloud, and vCluster, are integrating the platform into their own offerings.

NVIDIA Developer
Research· Important

IBM shows open-model AI agents can cut chip-design search costs by over 11x

IBM Research used a coordinated multi-agent 'agent factory' to explore hardware design optimizations for a quantum error-correction decoder, comparing proprietary and open frontier models under the same 100-hypothesis search budget. The open-model configuration, run on-premises via IBM's llm-d distributed inference framework, achieved a 52x speedup over baseline for about $26 in inference cost, versus $299 for a proprietary-model configuration that reached a higher 204x speedup. The study highlights that cache-aware routing and efficient serving (98% prefix-cache hit rate, ~$0.11 per million tokens) made the open-model approach dramatically cheaper while still finding valid, compact hardware designs.

IBM Research
Research· Important· 🧪 Worth Testing

Amazon's 'Priming' Turns Pretrained Transformers Into Efficient Hybrid Models for Under 1% of Training Cost

Amazon Web Services researchers published a method called 'priming' that converts pretrained Transformer models into hybrid architectures mixing attention and state space model (SSM) layers, reusing existing weights instead of retraining from scratch. The approach cuts pretraining costs by over 99% and lets a 32-billion-parameter hybrid model match its source Transformer's quality while decoding up to twice as fast. Amazon tested three SSM types and released an open-source model zoo, training code, and serving tools under Apache 2.0.

Amazon Science

NVIDIA and Princeton Cut Decoding Bottlenecks in Hybrid SSM Models

NVIDIA, working with Princeton's Dao AI Lab, built ReplaySSM, a new way to store state in hybrid models that mix state-space (SSM) layers with attention layers. Instead of rewriting the entire state on every token, the method keeps a periodic checkpoint plus a short list of recent inputs, splitting the job of producing output from the job of updating memory. The result is roughly half the memory traffic, decode kernels running up to 1.80x faster at scale, and speculative decoding throughput more than doubling on 120B-class models, all while keeping accuracy close to full precision. The method already ships inside TensorRT-LLM, vLLM, and FlashInfer, and is running in production for GLM-5.3-Flash and Kimi-K3.

NVIDIA Developer