- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces ModULE, a mixture-of-experts (MoE) framework designed to localize the impact of future machine unlearning requests. The framework integrates four learning objectives: routing concentration, gated-mass balancing, expert-representation differentiation, and route separation. The authors evaluate class-level and domain-level unlearning across PACS, OfficeHome, CIFAR-100, and Tiny-ImageNet.
Critical strengths
When deletion requests target known groups, such as classes or domains, encouraging group-dependent expert pathways during training offers a compelling alternative to global updates. The theoretical analysis in Lemma 1 remains appropriately bounded by its stated assumptions, providing a formal explanation for why localized updates can preserve exact predictions on the retain set. Furthermore, the paper compares ModULE against several full-model and MoE-based unlearning baselines, evaluating performance across forget accuracy (FA), retain accuracy (RA), test accuracy (TA), and membership-inference attack (MIA) metrics.
Critical weaknesses
(1) The proposed method combines several distinct objectives and introduces multiple hyperparameters, raising concerns regarding its practicality and generalizability. (2) Given the framework's complexity, thorough ablation studies are essential to isolate the impact of each individual component on performance. However, all ablation studies have been deferred to the Appendix, and the paper lacks an ablation evaluating the individual learning objectives introduced in Section 3.3. (3) It remains unclear whether the method is applicable to random unlearning. Although the authors state that they evaluate ModULE in this setting, no experimental results for random unlearning are provided. (4) It remains unclear what evidence demonstrates that forgotten information cannot be readily recovered from the frozen backbone, prediction head, or non-selected experts. (5) The evaluation results fail to establish clear superiority over strong baselines, and the ablation studies do not offer practical guidance on how to tune critical hyperparameters.
Questions for authors
Please see the weaknesses.