- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies multimodal machine unlearning and identifies the limitations of existing works, behavioral forgetting and the inconsistency of unlearning across textual and visual identity cues. The paper develops RouteMask which selectively updates MLP gate rows using attribution-guided masks and presents the empirical evaluation across two VLMs (LLaVA-1.5 and Qwen2.5-VL) and two benchmarks (MLLMU-Bench and S-MLLMUn).
Critical strengths
S1. The paper focuses on both factual knowledge and cross-modal identity access.
S2. The proposed method appears compelling as it edits only MLP gate rows within layers identified by the mechanistic investigation.
Critical weaknesses
W1. The authors argue that existing methods primarily change what a model says rather than what it knows. However, the developed RouteMask also optimizes behavioral objectives, including changes in answer probabilities and desired forgetting responses. Restricting parameter updates does not necessarily establish that the underlying identity information has been eliminated. The model may still retain forgotten facts in representations or parameter regions not modified by RouteMask.
W2. More datasets such as FIUBench should be included in the evaluation. The paper also needs to discuss whether the proposed approach could generalize to other settings than forgetting personal facts associated with identities that can be referenced through names or photographs.
Questions for authors
W1 and W2 in the above weakness section.
Thank you for your rebuttal, which has largely addressed some of my concerns. I will raise my score to 3.