- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SIFT, a framework for boundary-free online continual learning in large language models. The backbone remains frozen, while a collection of soft-prompt modules is organized into mature and provisional modules. Incoming examples are routed according to source-representation similarity. When an example cannot be safely assigned to a mature module, a provisional branch inherits its parent prompt and adapts independently. Once the branch has accumulated sufficient evidence, SIFT combines a radius-based semantic compatibility check with a functional validation step on a retained sentinel set to decide whether the branch should be merged or maintained separately. Experiments on six NLP datasets and four Llama/Qwen backbones show improvements over several continual-learning baselines, particularly in final accuracy and backward transfer.
Critical strengths
-
The paper addresses a relevant problem in online continual learning: semantic similarity alone does not guarantee that two data regions can safely share adaptation parameters. The distinction between semantic compatibility and functional compatibility is meaningful, and the provisional-module mechanism provides a clear way to isolate potentially interfering updates before deciding whether to merge them.
-
The proposed framework is evaluated on heterogeneous NLP tasks and multiple instruction-tuned backbones. The ablation study supports the contribution of provisional modules, parent-prompt initialization, and functional validation. The comparison with shared-prompt and shared-adapter baselines also illustrates the potential value of isolating updates rather than continually overwriting a single adaptation state.
Critical weaknesses
-
The robustness of the main empirical conclusions is not sufficiently established. The main results are reported as point estimates without clearly presenting uncertainty across random seeds or alternative stream orders. Moreover, the gains vary considerably across backbones: the improvement over F2OCL is substantial on Llama-3.2-1B-Instruct but only 0.15 percentage points in final accuracy on Llama-3.2-3B-Instruct. Since the benchmark consists of a single-pass stream of six heterogeneous datasets, it is important to establish whether the reported gains persist under different stream orders and random initializations.
-
The resource budget and the claim of operating without replay need clearer qualification. The implementation reserves up to 384 mature modules and 128 provisional modules, each with a 100-token soft prompt, and retains a global budget of 384 sentinel examples for functional validation. Although the sentinels are not used for gradient updates, the method still stores historical examples and incurs additional validation and module-management costs. The paper does not sufficiently establish how these costs compare with the memory, trainable-parameter, and inference budgets of the baselines. Parameter- or memory-matched comparisons, together with latency and storage measurements, would help determine whether the performance gains justify the additional capacity.
Questions for authors
-
Are the main results stable across multiple random seeds and alternative dataset orders? In particular, could the authors report uncertainty estimates for the final-accuracy differences, given the small improvement on Llama-3.2-3B-Instruct?
-
How do the total trainable parameters, prompt-storage requirements, sentinel memory, and inference overhead compare with those of the baselines? Since SIFT retains historical examples for functional validation, could the authors clarify the precise meaning of the claim that the method operates without replay and provide comparisons under matched resource budgets?
-
How sensitive are the results to the maximum number of mature modules, the provisional-module capacity, and the sentinel budget? Would a smaller module budget preserve most of the reported performance gains?
Dear Reviewer Uznc,
Please carefully review the authors' rebuttal and respond to each of your concerns. If any concerns remain unresolved, clearly specify what is missing and request concrete clarifications or additional evidence.
Bests,
Your AC.