- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper presents an empirical study of removing sequentially trained, source-specific modules from a language model. Using synthetic biographies, it trains separate residual modules while freezing the backbone and previously trained modules, and varies whether earlier modules remain active during subsequent training. The experiments examine effects on retained-source accuracy, module-level dropout, dependency-based cascade deletion, the composition of independently trained modules, and subsequent learning. The paper reports that parameter isolation does not ensure functional independence, that dropout can reduce deletion damage at additional training cost, and that deletion can reduce subsequent fitting effort in some tested settings.
Critical strengths
- A relevant and clearly presented practical question. Understanding how module removal affects knowledge associated with retained sources is important for modular unlearning and continual learning. I appreciate the authors' focus on the distinction between assigning separate parameters to sources and ensuring that their learned computations remain independent. This is a worthwhile issue to investigate, and the presentation makes the experimental setup easy to follow.
Critical weaknesses
-
The central empirical contribution would benefit from a more focused explanation. The practical motivation is reasonable, but I found it difficult to identify the specific unresolved question that the study answers relative to existing modular approaches. Degradation after removing a module that was active during training is a plausible consequence of functional dependence, even when its parameters were frozen. The effects of module-level dropout, the difficulty of combining independently trained modules, and changes in subsequent fitting effort are also plausible under changes to the active computation. Empirical evidence about these effects can still be valuable. To make that value clearer, I encourage the authors to identify one or two central findings and explain what their measurements establish about the conditions, magnitude, or practical trade-offs of these effects. At present, this connection is not developed enough for me to see a substantial contribution beyond the qualitative observations.
-
Additional validation is needed to establish practical relevance. The synthetic biographies and internal comparisons provide a controlled setting for studying module dependence. However, the evaluation does not include comparisons with established modular learning or unlearning methods on an existing benchmark or real-data task, and the principal evaluation ranks candidate answers to questions seen during training. This leaves uncertainty about how broadly the findings apply. I appreciate that the authors acknowledge these limitations. A focused comparison with a relevant existing method on an established benchmark or real-data task would help establish whether the key findings persist in a more representative setting. This evidence is important to my assessment of the empirical contribution; addressing the concern would require additional evaluation as well as clearer discussion.
Questions for authors
Clarification requests:
- Could the authors state the central research question more explicitly and identify the one or two findings they consider the main contribution? It would help to explain what these results add to existing understanding and how they could inform the design or evaluation of modular systems.
- Could the authors clarify how the internal experimental conditions relate to existing modular learning or unlearning methods, and which conclusions they expect to extend beyond the tested architecture and synthetic-data protocol? Any available evidence supporting that scope would be helpful.
Suggested additional validation: I encourage a focused evaluation of the main finding using a relevant existing method and an established benchmark or real-data task. This would materially affect my assessment by connecting the controlled observations to practical modular systems. It is a request for additional empirical support, separate from the clarification questions above.
2 comments
Thank you for the clarifications and additional real experiments. My main concern about the limited contribution beyond expected observations remains unresolved. I maintain my score.
Response to Reviewer Vkxx
Thank you. We added the established-method experiment you requested and will focus the paper on what happens to retained tasks when sequentially trained modules are removed.
Central question and findings. We ask when a source-specific module can be removed without damaging retained tasks. Two findings organize the revision. First, separate frozen parameters do not ensure functional independence; our additional few-shot transfer experiment (separate follow-up comment) also shows that this dependence can accompany a useful accuracy advantage. Second, the effectiveness and cost of protection depend on the setting: dropout substantially reduces damage on the disjoint benchmark, but provides only partial protection in the related-task transfer experiment. We do not claim that co-adaptation or dropout robustness is new.
Progressive Prompts. Using the released T5-large implementation with residual prompt reparameterization, we ran DBpedia -> Amazon -> Yahoo -> AG News (16 training examples per class, three seeds, held-out test subsets), with earlier prompts and the backbone frozen. We fixed the acquisition threshold (intact accuracy at least chance + 15 points) and the deletion comparisons before seeing the first deletion results. Changes in percentage points, mean +/- sample SD:
Both methods acquired Yahoo and AG News in all three seeds. Dropout kept the observed changes on these tasks small at a cost of about 0.7 points of intact accuracy, but it never acquired Amazon. We do not read this as a guarantee: three-seed uncertainty is wide, and retained utility does not show that the deleted task was forgotten.
Retraining reference. Retraining tasks 2-4 with matched data and initialization acquired Amazon in all seeds. Gaps to retraining (Yahoo / AG News) were -1.7 / +0.6 intact and -4.9 / -6.5 after masking for the published method, and -2.3 / -0.1 intact and -2.8 / +0.1 after masking for dropout. These gaps reflect the original training context as well as removal.
Output format. Deletion sometimes caused T5 to emit sentinel tokens instead of labels. Under exploratory label-likelihood ranking, two-prompt AG News losses ranged from -0.3 to -46.5 points across seeds. Ranking changes the decision rule, so it cannot cleanly separate formatting failures from classification failures.
Reproduction and selection history. Four-task intact accuracy was 70.2 +/- 2.1 (dropout: 68.5 +/- 1.4), versus 75.2 for this order in Progressive Prompts Table 1(a). We used a fixed training budget and differ in other disclosed details, so this is not an exact reproduction. The released sampler fixes the Amazon, Yahoo and AG News training subsets and all test subsets across seeds, so the SDs exclude that resampling. We chose the LayerNorm variant after earlier no-LayerNorm development runs; the appendix will report those runs separately without pooling, and we will release code, logs and per-seed results.