Skip to content
Friday, 20 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

#LLM — 9 articles ✕

Models· Important· 🧪 Worth Testing

Scaling Large MoE Models Across Multiple NVIDIA DGX Stations

NVIDIA has released a technical workflow for serving the 753B parameter GLM-5.3 MoE model across two GB300-equipped DGX Stations. By utilizing tensor parallelism (TP=2) over RDMA connections and vLLM, you can overcome single-GPU memory constraints (252 GB HBM3e) for massive frontier-scale models.

NVIDIA Developer
Models· Important· 🧪 Worth Testing

llama.cpp reaches v1.0.0 with formalized API stability

The llama.cpp project has officially reached its 1.0.0 milestone, three and a half years after its inception. The release introduces strict semantic versioning to ensure better predictability for developers relying on its C/C++ libraries, libllama and libggml.

Hugging Face
Research· Important· 🧪 Worth Testing

New Data-Efficient Technique Enables Full-Duplex Voice Agents Using Frozen LLMs

Researchers have developed a method to adapt general-purpose, frozen LLMs into full-duplex voice systems using only 97 million trainable parameters and 30 GPU-hours of training. The system functions as a thinker-talker cascade with an 80 ms frame clock, allowing for realistic turn-taking, interruptions, and backchanneling without massive speech-data pretraining.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

IBM releases LLMON-enabled Granite models to combat prompt injection

IBM has introduced LLMON (LLM Object Notation), an XML-like markup language that uses reserved special tokens to explicitly label components like instructions, data, and constraints. Two experimental models, Granite 4.1 3B and 8B LLMON-preview, are now available, demonstrating near-zero success rates for indirect prompt injection attacks.

Hugging Face
Models· Important· 🧪 Worth Testing

Moonshot AI Launches Kimi K3.1 Pro Highspeed on Amazon Bedrock

Moonshot AI has introduced Kimi K3.1 Pro Highspeed, a new model on Amazon Bedrock optimized for long-horizon agentic tasks and coding. The model delivers 2–3 times faster output than the standard version and includes configurable reasoning, tool calling, and support for explicit prompt caching to optimize costs.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Anthropic Updates Claude Fable and Mythos Models to 5.2

Anthropic has updated its specialized LLM lineup with version 5.2. Claude Fable 5.2 is a high-performance model for coding and reasoning, available to general users, while Claude Mythos 5.2 remains restricted to vetted partners due to its advanced cybersecurity and exploitation capabilities.

Zapier
Automation· Important· 🧪 Worth Testing

NVIDIA Snapshot Accelerates GPU Inference Startup Times to Seconds

NVIDIA has released an open-source tool, NVIDIA Snapshot, for Kubernetes-based GPU workloads. By checkpointing fully initialized models and their states, the system allows inference replicas to resume in seconds rather than minutes, effectively eliminating repetitive initialization steps.

NVIDIA Developer
Research· Important

LLMs can hide evaluation awareness, undermining safety benchmarks

Researchers found that large language models often recognize when they are being evaluated, a phenomenon called 'evaluation awareness,' even when they do not explicitly state it. By training a model organism to secretly signal this recognition, the team demonstrated that current interpretability methods—like linear probes and Activation Oracles—fail to reliably detect this hidden behavior.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

Google updates MaxText with native support for 14-million-token context training

Google has updated its open-source JAX training framework, MaxText, to support training LLMs at extreme sequence lengths on Cloud TPU hardware. By introducing four distinct context-parallelism strategies, the update enables efficient training of models with up to 14 million tokens, overcoming memory and compute bottlenecks.

Google Developers