- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates why knowledge edits become ineffective after subsequent downstream fine-tuning. Through layer-wise restoration, subspace analysis, and attention-based attribution, the authors argue that fine-tuning primarily disrupts the readout circuitry of edited knowledge rather than erasing the edit signal itself. Motivated by these findings, the paper proposes Layer-wise Model Interpolation (LMI), which selectively interpolates between edited and fine-tuned model weights to recover edited knowledge while preserving downstream adaptation. Experiments across multiple models, editing methods, and fine-tuning settings demonstrate substantial improvements in edit retention.
Critical strengths
-
The paper presents a clear and coherent research story. It starts from the practical problem of edit degradation after fine-tuning, investigates the underlying mechanism from an information-flow perspective, and proposes a corresponding recovery method.
-
Some of the mechanistic findings are insightful. In particular, the observation that fine-tuning primarily disrupts the deep editing and adjacent post-editing layers, rather than simply erasing the original edit signals, provides an interesting perspective on model-editing robustness.
Critical weaknesses
-
The generality of the readout-circuitry hypothesis and LMI remains insufficiently validated. The paper only studies MEMIT and AlphaEdit, which both edit similar early MLP layers (L3–8/L4–8). However, other effective editing methods, such as RLEdit, UltraEdit, and LocFT-BF, employ different editing mechanisms and can operate on different modules or layer locations. It remains unclear whether the identified readout circuitry would still lie in the deep-editing and adjacent post-editing regions under these methods, and whether LMI would remain effective.
-
The fine-tuning setup remains insufficiently representative of realistic downstream adaptation. The main experiments still rely on 10-epoch, MLP-only fine-tuning over 1,000 ZsRE examples, often achieving nearly 100% training accuracy but relatively low test accuracy. Although the authors have added more realistic settings, including NQ-open and full-parameter fine-tuning, these evaluations are less comprehensive. In particular, Table 2 reports edit accuracy without downstream task performance, making it difficult to assess whether LMI truly preserves both edited knowledge and downstream capabilities under these settings.
Questions for authors
Question
Could the authors provide a more comprehensive evaluation of general capability preservation? Table 3 only evaluates full-scale MEMIT editing followed by ZsRE fine-tuning, reporting MMLU on Llama-3 and LAMBADA on GPT-J. Extending this evaluation to other editing methods, models, and downstream settings would provide stronger evidence that LMI preserves general capabilities.
Suggestion
I recognize that a comprehensive evaluation of this pipeline is computationally expensive, as it involves model editing, downstream fine-tuning, recovery, and general task evaluations. Nevertheless, I believe that at least one carefully controlled end-to-end experiment with a more representative downstream adaptation setting and a different editing paradigm would substantially strengthen the paper's conclusions.
Despite these remaining concerns, I appreciate the clear research motivation, coherent analysis, and potentially insightful mechanistic findings. I therefore lean toward Weak Accept, while encouraging the authors to further strengthen the experimental evidence and clarify the scope and generality of their conclusions.
3 comments
Thank you for your response. The additional complete end-to-end experiment on LocFT-BF addresses most of my concerns. I encourage the authors to further strengthen the experimental evaluation in the revised version, for example, by considering a broader range of downstream tasks beyond MMLU.
Thank you very much for your positive feedback and for taking the time to review our response. We are glad that the additional end-to-end experiment on LocFT-BF addresses most of your concerns.
We fully agree with your suggestion. In the revised version, we will strengthen the experimental evaluation by including a broader range of downstream tasks beyond MMLU, to further verify the generality of our findings.
Thank you again for your constructive comments, which have helped us improve the paper.
We appreciate the reviewer's comments on the coherence of the research narrative and are pleased that they found our mechanistic perspective on model-editing robustness insightful. We also thank the reviewer for the constructive comment on more comprehensive experiments. In response, we add a complete end-to-end experiment (LocFT-BF edit → Dolly instruction tuning → LMI → evaluation of edit retention, downstream performance and general capability), covering a new downstream task and a new editing method.
Setup. Llama-3-8B, Full scale (about 20.9K CounterFact edits). LocFT-BF is a different paradigm from MEMIT: fine-tuning-based editing that updates only the MLP output matrix of L22. The downstream stage is full-parameter instruction tuning on Dolly-15K (lr 3e-5, 3 epochs). The LMI (μ, σ) are selected by EA × Tr on a random 10% of the edits, and ES / EA are reported on the remaining 90%. Tr / Te are response-token accuracies on the Dolly training / held-out split. ROUGE-L is computed on the held-out split and measures downstream generation quality. MMLU is 5-shot.
LocFT-BF and Dolly fine-tuning
Instruction tuning improves held-out performance (Te 50.6 → 58.0, ROUGE-L 19.5 → 35.4), so the task is learned rather than memorised. The edits nevertheless collapse (EA 99.7 → 58.6), and LMI recovers 92% of the drop. Its ROUGE-L (36.5 vs. 35.4) and MMLU (62.5 vs. 61.3) are not below those of the fine-tuned model. LocFT-BF edits L22 and the selected LMI centre is L24, consistent with our finding that the readout band lies just downstream of the edit layers.