Researchers have identified that the upstream construction of target hidden states significantly impacts the quality of LLM knowledge updates. By implementing an L1 regularization method to prune extraneous components of knowledge vectors, this approach reduces interference during parameter editing, allowing for more precise knowledge injection.
Researchers introduced SLATE, a benchmark for evaluating long-horizon, large-scale API selection in enterprise software environments. Unlike current benchmarks, it forces models to navigate roughly 1,000 tools to complete complex tasks.
Apple researchers have unveiled an online training infrastructure for mobile UI agents that utilizes a two-part architecture to split navigational logic from visual interpretation. By employing step-level feedback provided by an LLM-as-a-Judge and a novel value estimation technique known as GiGPPO, these agents demonstrate significantly better adaptability than static models trained on pre-recorded sequences.
AWS released a push-based NIXL connector for vLLM that changes how key-value (KV) cache data moves between prefill and decode instances in disaggregated LLM serving. Instead of the decode instance pulling KV blocks after prefill finishes, the decode instance registers its target memory in advance and the prefill instance writes the KV data directly once ready, moving coordination work off the critical path. Benchmarked on a 1-prefill/1-decode Qwen3-32B deployment using EC2 P5en instances with EFA, push mode delivered up to 3x better time-to-first-token (TTFT) and up to 30% better time-per-output-token (TPOT) than the default pull mode, especially under high request rates.
Apple ML researchers published a NeurIPS paper introducing SELFCOMPACT, a scaffold that lets language model agents decide for themselves when and how to compact their own accumulated context, rather than relying on fixed-interval summarization triggered by a token count. It combines a compaction tool the model can call with a lightweight rubric telling it when to fire (a sub-task is resolved) and when to hold off (mid-derivation or stuck). Tested on six benchmarks and seven models, it matched or beat fixed-interval summarization while using far fewer tokens.
Amazon Web Services researchers published a method called 'priming' that converts pretrained Transformer models into hybrid architectures mixing attention and state space model (SSM) layers, reusing existing weights instead of retraining from scratch. The approach cuts pretraining costs by over 99% and lets a 32-billion-parameter hybrid model match its source Transformer's quality while decoding up to twice as fast. Amazon tested three SSM types and released an open-source model zoo, training code, and serving tools under Apache 2.0.
GitHub has published ReviewBench, a research-preview benchmark designed to compare AI code review agents on a common, auditable standard. The dataset draws on 219 real public pull requests across 19 languages and 187 repositories, chosen to mirror the language and size distribution found across 103.9 million GitHub pull requests. Ground truth comes from a blended pool of human reviewers, static analysis tools, and multiple frontier LLMs, cross-checked by senior engineers who agreed with the benchmark's labels 96.6% of the time. GitHub says it has already used ReviewBench internally to track its own Copilot code review (CCR) product, and that offline benchmark movement reliably predicted the direction of later production A/B tests.