- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates whether the capacity of a pretrained LLM can be reorganized so that broadly useful computation remains in a shared backbone while specialized knowledge is moved into external memory modules. The authors propose Knowledge Offloading (KOFF), which jointly or sequentially learns a structured pruning mask and domain-specific recovery modules implemented as LoRA adapters and learned key-value caches. Experiments on four LLMs ranging from 3B to 14B show that attaching matched memory modules substantially reduces the perplexity increase caused by pruning and often improves MMLU performance over pruning-only. Additional analyses suggest that the memory modules are domain-specific, with language-specific neurons preferentially removed while language-neutral neurons largely remain in the backbone.
Critical strengths
- The paper presents a well-motivated framework for reorganizing pretrained LLM capacity. KOFF combines a shared sparse backbone with swappable domain-specific memory modules and explores both joint and sequential optimization. This provides a practical approach to separating shared computation from domain-specific adaptation.
- The experimental evaluation provides encouraging results across multiple settings. KOFF consistently reduces the perplexity increase caused by pruning across Llama and Qwen models. The ablations support the benefits of LoRA and KV memories. The memory-swapping and neuron-level analyses provide further evidence of domain specialization.
Critical weaknesses
-
The central knowledge-offloading claim is insufficiently established. The improvements over pruning-only and the memory-swapping results provide evidence of performance recovery and domain-specific behavior of the memory modules, but do not clearly establish that specialized knowledge has been relocated from the backbone to external modules.
-
The preservation of general capabilities is not consistently demonstrated. Although KOFF reduces perplexity across different settings, it substantially degrades Global MMLU performance on the instruction-tuned model compared with pruning-only (Table 2). This raises concerns about whether the proposed decomposition effectively preserves general capabilities while offloading specialized knowledge.
Questions for authors
- The paper reports that language-specific neurons are preferentially removed from the backbone. Does the pruning-only baseline exhibit a similar pattern, or is this specific to KOFF?
- In Table 2, KOFF substantially reduces Global MMLU performance on the instruction-tuned model compared with pruning-only. Can the authors clarify whether this degradation results from the raw-text distillation objective or the proposed decomposition itself?
- The experiments evaluate models with matched domain-specific modules (Section 4), while inference relies on a learned router (Section 3). Can the authors report the end-to-end performance of KOFF when memory modules are selected by the learned router rather than using ground-truth domain labels?
- KOFF trains six domain-specific memory modules, but the paper does not clarify how a module is selected for each MMLU question. Are the reported MMLU results based on the learned router, a predefined domain mapping, or oracle module selection?
3 comments
Response part 2/2
Q3 / Q4: "Are the reported MMLU results based on the learned router, a predefined domain mapping, or oracle module selection?"
The MMLU results in the submission use a predefined mapping from each MMLU subject to one of the six topic domains (available in the released code). For Global MMLU, the question's language determines the module. We have now evaluated KOFF end-to-end with the learned router selecting the module for every input (Llama-3.1-8B base, 20% sparsity):
| PPL (gold) | PPL (router) | MMLU (predefined) | MMLU (router) | |
|---|---|---|---|---|
| KOFF: joint, languages | 10.90 | 10.85 | 0.537 | 0.536 |
| KOFF: joint, topics | 8.12 | 8.06 | 0.602 | 0.600 |
| KOFF: sequential, languages | 11.95 | 11.93 | 0.534 | 0.534 |
| KOFF: sequential, topics | 9.13 | 9.12 | 0.592 | 0.590 |
Using the router instead of gold labels thus has no meaningful effect on downstream performance. We added these results to Table 7, L701 and clarified module selection in Section 4 (L259-261).
Response to the Authors' Rebuttal
Thank you for the detailed response.
My questions have been largely addressed. I had hoped that the paper could show that specialized knowledge is actually transferred from the backbone to the external modules. That would be a very valuable result. However, the revision now defines knowledge offloading as a functional decomposition and no longer claims such a transfer. With this definition, the contribution is closer to structured pruning with domain-specific recovery modules. I do not have any additional questions.
I will raise my score.
We thank the reviewer for the thoughtful review and address the points below.
Response part 1/2
W1: "The central knowledge-offloading claim is insufficiently established."
We agree that our terminology should be more precise. By knowledge offloading we mean a functional decomposition: a smaller shared backbone complemented by domain-specific external modules that recover the capacity removed by pruning. Pruning followed by domain-specific recovery is therefore not an alternative explanation of our results; it is how offloading is implemented. We do not claim to identify and physically transfer individual facts or representations. We now state this explicitly (Section 3.1) and replaced "relocation" throughout.
What distinguishes this from generic recovery is that the decomposition is specialized on both sides:
The modules hold domain-specific capacity. Mismatched modules perform much worse than matched ones (Fig. 3, 4), and six domain modules outperform a single shared module trained on pooled data under the same pipeline (perplexity 8.12 vs. 9.44 on topics and 10.90 vs. 11.35 on languages; Global MMLU 0.537 vs. 0.519; Table 1).
The backbone retains domain-general neurons more selectively when the mask is trained jointly with memory modules. Compared with pruning-only (same sparsity target, no modules), the joint mask has a 1.22x higher normalized pruning rate for the most language-specific fifth of the active pool, but only 0.55x for the most language-general fifth. For topics, the corresponding ratios are 1.18x and 0.48x (see point 3). The difference is driven mainly by stronger protection of general neurons. Post-hoc recovery cannot produce this difference in the mask, since a prune-then-recover pipeline fixes the mask before any module exists.
W2 / Q2: "Can the authors clarify whether this degradation results from the raw-text distillation objective or the proposed decomposition itself?"
The degradation is not entirely surprising: we start with an instruction-tuned model but train the modules using token-level distillation on raw text rather than instruction data (including the model's own generations). This objective does not explicitly target the preservation of instruction-following capabilities. In practice, we envision either performing the decomposition before instruction post-training, or incorporating instruction data in decomposition learning.
More broadly, across our 10 model/partition settings (Table 9), the better KOFF variant improves over pruning-only on (Global) MMLU in 8, is on par in one (0.598 vs. 0.599), and is worse only in this instruct/language setting, while improving perplexity in all of them.
Q1: "Does the pruning-only baseline exhibit a similar pattern, or is this specific to KOFF?"
We ran the requested comparison on Llama-3.1-8B, using 6000 articles per domain for LAPE's entropy estimation and matched pruning-only masks at 20% sparsity. We compare the masks on the same active neuron pool, ranked by LAPE entropy from most domain-specific to most domain-general.
The new analysis shows that joint training produces a much more selective mask than pruning-only. In the language setting, pruning-only is relatively flat across the specificity range: it prunes domain-specific neurons at 1.1-1.2x its average rate within the active pool and the most domain-general ones at 0.7-0.8x. KOFF: joint has a steeper profile: 1.3-1.4x for domain-specific neurons and only 0.2-0.3x for the most domain-general ones.
Comparing the same neurons and normalizing each mask by its own average pruning rate within the pool, KOFF: joint has a 1.22x (95% CI: [1.18, 1.27]) higher rate than pruning-only in the most specific fifth and a 0.55x [0.49, 0.60] rate in the most general fifth. The corresponding ratios for topics are 1.18x and 0.48x. We revised Section 6 accordingly, including the pruning-only control.