Researchers have introduced a 'full-block estimator' to optimize the alignment of Masked Diffusion Language Models (MDLMs). By evaluating every block exactly once during training, this approach removes the variance associated with random block sampling.
Researchers have developed a method to adapt general-purpose, frozen LLMs into full-duplex voice systems using only 97 million trainable parameters and 30 GPU-hours of training. The system functions as a thinker-talker cascade with an 80 ms frame clock, allowing for realistic turn-taking, interruptions, and backchanneling without massive speech-data pretraining.
Researchers have identified that the upstream construction of target hidden states significantly impacts the quality of LLM knowledge updates. By implementing an L1 regularization method to prune extraneous components of knowledge vectors, this approach reduces interference during parameter editing, allowing for more precise knowledge injection.
Researchers have proposed SELD, a training-free technique to identify 'silent evidence loss' in long-context compression. This occurs when key supporting information is removed, leaving an answer technically correct but unsupported, which poses risks for systems relying on context reuse.
Researchers have proposed FFN-Perturbed Self-Distillation (FPD) to address the challenge of removing sensitive information from Multimodal Large Language Models (MLLMs). The approach minimizes utility degradation by using the original teacher distribution as a reference while perturbing specific FFN activations associated with private data.
Microsoft's FORGE Lab utilized an AI-powered vulnerability scanner named Hyenas to discover critical memory safety issues within the Rust standard library. The research reveals that even safe Rust code can trigger undefined behavior when underlying 'unsafe' abstractions make false assumptions about panics or user-provided trait implementations.
Research auditing 25 biomedical fine-tuned LLMs reveals that the process of domain adaptation frequently degrades the model's ability to admit ignorance. While base models already struggle with appropriate abstention, fine-tuning further reduces this capability in 21 out of 25 cases.
Recent research shows that commercial AI text humanizers, designed to bypass AI detectors, frequently alter or drop essential facts like names, numbers, and dates. Across 11 tested tools, 35-65% of documents containing factual details suffered from errors during the re-writing process.
Apple researchers have unveiled an online training infrastructure for mobile UI agents that utilizes a two-part architecture to split navigational logic from visual interpretation. By employing step-level feedback provided by an LLM-as-a-Judge and a novel value estimation technique known as GiGPPO, these agents demonstrate significantly better adaptability than static models trained on pre-recorded sequences.
Recent research reveals that language models fail to adapt to evolving user preferences, instead defaulting to 'exploit-first' behavior. While models can identify the correct strategy in multiple-choice scenarios, they show a 35-46% drop in calibration during open-ended generation, persistently over-relying on stale historical data.
Researchers have proposed 'Artifact Distillation,' a method where frontier models externalize their reasoning into an 'artifact bank.' Smaller models query this bank at inference time to improve performance without requiring expensive model retraining or gradient updates.
Recent research demonstrates that current security monitors often fail by confusing injection exposure with an agent's actual commitment to perform an unsafe action. The author proposes a double-stratified evaluation method that separates exposure from behavior, significantly improving the ability to predict unsafe tool calls up to two steps in advance.
Researchers have proposed LOTUS, a framework for hallucination detection that uses multilinear low-rank decomposition to extract signals from hidden LLM layers. By analyzing peak activations and cross-layer patterns, the method identifies incorrect responses more effectively than existing pooling-based techniques.