- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates module-level plasticity and stability in transformers from a continual learning perspective, focusing on declarative and procedural learning. The authors demonstrate that MLPs exhibit greater plasticity for declarative memorization, whereas attention projections are more effective at acquiring procedural skills. Importantly, they find that cross-task stability does not simply mirror plasticity: modules with similar learning capabilities can exhibit substantially different degrees of forgetting. Through targeted reset-and-recovery experiments, the authors suggest that declarative knowledge is preferentially stored in MLPs, while attention projections also contribute to accessing this knowledge. In particular, updating value-output (VO) projections can substantially impair declarative memory retention, despite their relatively limited role in storing such information. These findings are demonstrated through controlled synthetic experiments with a small transformer and further examined on realistic tasks using a pretrained language model.
Critical strengths
- Well-controlled experiments and interpretable findings. The paper employs a carefully controlled synthetic setting that enables systematic comparisons of plasticity and stability across transformer modules and task families. The experiments are repeated across three random seeds to improve the reliability of the results. While some observations are consistent with established intuitions about the functional roles of attention and MLP layers, the empirical evidence connecting these roles to different plasticity–stability dynamics is valuable. In particular, the asymmetric forgetting behaviors of QK and VO provide an interesting perspective on the distinction between information storage and access.
- Validation beyond synthetic settings. The authors complement their controlled synthetic experiments with evaluations on realistic procedural and declarative tasks using a pretrained language model. The observation of similar module-level asymmetries across these settings strengthens the empirical relevance of the findings beyond the synthetic testbed.
Critical weaknesses
-
Limited evidence of generalizability to larger models. The controlled synthetic experiments are conducted on a 25M-parameter transformer, while the realistic experiments use only Qwen2.5-0.5B. Although the consistency of the findings across synthetic and realistic settings is encouraging, it remains unclear whether the observed module-level plasticity-stability dynamics generalize to larger, more capable pretrained LLMs. This limits the broader applicability of the conclusions, particularly given the potential differences in how knowledge and computational functions are distributed across model scales.
-
Incomplete causal explanation of the observed stability asymmetry. While the reset-and-recovery experiments provide useful evidence about the functional roles of different transformer modules, they do not fully establish the causal mechanism underlying the observed forgetting patterns. In particular, the substantially lower declarative retention after VO updates compared with QK updates could arise either because VO plays a more critical role in accessing stored information or because its access-related functions are more vulnerable to procedural adaptation. The current experiments do not clearly distinguish these explanations, leaving the proposed connection between functional roles and stability only partially substantiated.
Questions for authors
-
Interpretation of reverse-direction stability. While the paper provides evidence that updating VO can interfere with accessing declarative knowledge stored in MLPs, the reverse relationship is less clear. Figure 2(d) shows that updating MLPs also substantially degrades previously learned procedural skills, with sequence-level BFS accuracy dropping to zero across all configurations. How should this observation be reconciled with the claim that procedural skills are primarily implemented in attention projections? Does the relatively higher token-level accuracy after MLP updates indicate preservation of procedural knowledge, or merely less severe degradation compared with updating attention?
-
Intra-task-family stability. The paper focuses on cross-task-family stability, measuring declarative memory retention after procedural learning and procedural skill retention after declarative learning. I wonder whether the observed module-level asymmetries also hold within the same task family. For example, how much of the previously learned BFS skill is retained after learning DFS, and how much existing declarative memory is preserved after acquiring new declarative information? Such experiments could help clarify whether the observed stability patterns are specific to interference between declarative and procedural learning or reflect more general module-level properties of continual learning.