Research· 🧪 Worth Testing
New FPD Method Enhances Privacy Unlearning in Multimodal Models
Researchers have proposed FFN-Perturbed Self-Distillation (FPD) to address the challenge of removing sensitive information from Multimodal Large Language Models (MLLMs). The approach minimizes utility degradation by using the original teacher distribution as a reference while perturbing specific FFN activations associated with private data.