Skip to content
Friday, 20 November 2026
Tenesys AI News
Subscribe

AI Research

Research papers, benchmarks, architectures, reasoning and training methods.

#Evaluation — 5 articles ✕

Research· 🧪 Worth Testing

New Benchmark Reveals Retrieval Accuracy Doesn't Equal Long-Context Memory

A new research paper introduces the Simple Retrieval-Reconstruction Memory (SRRM) benchmark to better evaluate long-context performance in Small Language Models (SLMs). Findings show that as context length increases, a model's ability to reconstruct information degrades much faster than its ability to retrieve specific facts, proving that standard retrieval tests are insufficient for measuring true memory.

arXiv cs.CL
Research· Important· 🧪 Worth Testing

Google releases benchmark for engineering AI agents

Google has introduced Physical-Engineering's Last Exam (PLE), a new benchmark designed to test AI agents' capabilities in mechanical, electrical, civil, and structural engineering. Unlike standard textbook tests, PLE requires agents to process large project folders, including CAD drawings and building codes, to produce compliant, safe deliverables.

Google Cloud AI
Research· Important· 🧪 Worth Testing

New Metric Improves Reliability of LLM Agents via Consistency Training

Researchers introduced Recursive Semantic Divergence (RSD), an unsupervised metric that measures and penalizes inconsistency in LLM agent trajectories. By applying RSD as a reward signal during fine-tuning, models exhibit significantly more stable behavior and higher success rates across tool-use benchmarks.

arXiv cs.CL

Amazon has its internal AI safety tests independently reviewed by nonprofit AVERI

Amazon partnered with the independent nonprofit AVERI to audit the quality of its own internal safety-evaluation datasets for its AI models, not just the models' outputs. AVERI reviewed a random, anonymized sample of safety-test prompts covering areas like harmful content, cybersecurity, privacy and copyright. The review confirmed strong topical coverage, diverse testing methods and low contamination risk, but flagged gaps in multilingual coverage and multistep adversarial testing. Amazon responded with four concrete changes to its evaluation process.

Amazon Science
Research· Important· 🧪 Worth Testing

GitHub opens up ReviewBench to standardize how AI code reviewers get graded

GitHub has published ReviewBench, a research-preview benchmark designed to compare AI code review agents on a common, auditable standard. The dataset draws on 219 real public pull requests across 19 languages and 187 repositories, chosen to mirror the language and size distribution found across 103.9 million GitHub pull requests. Ground truth comes from a blended pool of human reviewers, static analysis tools, and multiple frontier LLMs, cross-checked by senior engineers who agreed with the benchmark's labels 96.6% of the time. GitHub says it has already used ReviewBench internally to track its own Copilot code review (CCR) product, and that offline benchmark movement reliably predicted the direction of later production A/B tests.

GitHub