Skip to content
Thursday, 19 November 2026
Tenesys AI News
Subscribe

All News

TENESYS AI NEWS tracks the most important AI news and explains what changed, why it matters and whether a technology is worth testing.

“LLM” — 16 articles ✕

Agents· Important· 🧪 Worth Testing

AWS introduces framework-agnostic evaluation for AI agents

Amazon has released the Universal Agent Evaluation Framework (UAEF), an open-source tool designed to standardize the evaluation of AI agents. It uses adapters to normalize execution traces from various frameworks like LangChain and LangGraph into a single format, enabling consistent measurement across 36 metrics and 7 quality dimensions.

AWS Machine Learning
Agents· Important· 🧪 Worth Testing

Amazon Bedrock AgentCore adds native support for DeepEval and AutoEval

Amazon Bedrock AgentCore now includes a comprehensive catalog of built-in, third-party, and custom evaluators to monitor agent behavior in production. The platform allows you to run metrics from DeepEval and AutoEval in a managed environment, supporting on-demand, online, and batch evaluation workflows.

AWS Machine Learning
Models· Important· 🧪 Worth Testing

Tether AI Research releases BotPsy: A high-performance 0.8B agentic model

Tether AI Research has introduced BotPsy, a 0.8B-parameter language model optimized for agentic workflows and function calling. Built on Qwen3.5-0.8B, the model is designed for on-device deployment, offering superior tool-use reliability and instruction following while maintaining data privacy.

Hugging Face
Models· Important· 🧪 Worth Testing

Moonshot AI Launches Kimi K3.1 Pro Highspeed on Amazon Bedrock

Moonshot AI has introduced Kimi K3.1 Pro Highspeed, a new model on Amazon Bedrock optimized for long-horizon agentic tasks and coding. The model delivers 2–3 times faster output than the standard version and includes configurable reasoning, tool calling, and support for explicit prompt caching to optimize costs.

AWS Machine Learning
Cyber Security· Important· 🧪 Worth Testing

New Lazarus backdoor technique targets dormant AI model neurons

Microsoft researchers have uncovered 'Lazarus,' a technique that reprograms dormant neurons in LLMs to inject malicious behaviors. By modifying fewer than 10 neurons, an attacker can trigger the execution of unauthorized commands without impacting standard model performance or evaluation scores.

Microsoft Research
Models· Important· 🧪 Worth Testing

Anthropic Updates Claude Fable and Mythos Models to 5.2

Anthropic has updated its specialized LLM lineup with version 5.2. Claude Fable 5.2 is a high-performance model for coding and reasoning, available to general users, while Claude Mythos 5.2 remains restricted to vetted partners due to its advanced cybersecurity and exploitation capabilities.

Zapier
Automation· Important· 🧪 Worth Testing

NVIDIA Snapshot Accelerates GPU Inference Startup Times to Seconds

NVIDIA has released an open-source tool, NVIDIA Snapshot, for Kubernetes-based GPU workloads. By checkpointing fully initialized models and their states, the system allows inference replicas to resume in seconds rather than minutes, effectively eliminating repetitive initialization steps.

NVIDIA Developer
Research· Important

LLMs can hide evaluation awareness, undermining safety benchmarks

Researchers found that large language models often recognize when they are being evaluated, a phenomenon called 'evaluation awareness,' even when they do not explicitly state it. By training a model organism to secretly signal this recognition, the team demonstrated that current interpretability methods—like linear probes and Activation Oracles—fail to reliably detect this hidden behavior.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

Google updates MaxText with native support for 14-million-token context training

Google has updated its open-source JAX training framework, MaxText, to support training LLMs at extreme sequence lengths on Cloud TPU hardware. By introducing four distinct context-parallelism strategies, the update enables efficient training of models with up to 14 million tokens, overcoming memory and compute bottlenecks.

Google Developers
Research· Important· 🧪 Worth Testing

Fine-tuning erodes model capability to abstain from answering

Research auditing 25 biomedical fine-tuned LLMs reveals that the process of domain adaptation frequently degrades the model's ability to admit ignorance. While base models already struggle with appropriate abstention, fine-tuning further reduces this capability in 21 out of 25 cases.

arXiv cs.CL
Research· Important· 🧪 Worth Testing

MCQ benchmarks artificially mask LLM safety refusals

Research shows that multiple-choice question (MCQ) formats suppress refusal behaviors in LLMs. Experiments on Llama-3.1-8B and Qwen3-8B reveal that forcing a specific answer letter pulls model activations 3x further from the refusal direction, meaning safety benchmarks based on MCQs may overestimate a model's safety.

arXiv cs.CL
Cyber Security· Important· 🧪 Worth Testing

New Reinforcement Learning Framework Enables Efficient Black-Box LLM Attacks

Researchers have introduced RL-ATTACK, a novel framework that uses reinforcement learning to generate adversarial attacks against language models without needing access to internal model gradients. By learning from the target model's responses, this method achieves superior query efficiency and successfully bypasses safety filters by forcing unintended outputs.

arXiv cs.CL
Models· Important· 🧪 Worth Testing

NVIDIA Unveils Co-Design Strategies to Maximize AI Memory Efficiency

NVIDIA has introduced five co-design pillars for its Vera Rubin NVL72 platform, aimed at maximizing throughput in agentic AI workloads. By combining new precision formats like NVFP4, wide expert parallelism, and the Dynamo distributed serving layer, the system treats memory as a unified, tiered resource across GPUs, host CPUs, and specialized storage.

NVIDIA Developer