- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper reformulates continual learning in LLMs as increasing model competence over time and proposes a unified evaluation framework covering domain shift, factual updates, temporal drift, and agentic accumulation. The authors compare existing adaptation methods, including supervised fine-tuning, reinforcement learning, prompt optimization, and context compression. The results highlight the strengths and limitations of different update mechanisms across these settings.
Critical strengths
- The paper covers diverse continual learning settings and evaluates a broad range of adaptation methods.
- The empirical comparisons provide an overview of the trade-offs among existing adaptation methods under different types of distributional changes.
Critical weaknesses
- Limited conceptual novelty. The proposed competence-based formulation and space/time taxonomy appear to overlap with prior work, including Continual Learning of Large Language Models: A Comprehensive Survey (Shi et al., ACM CSUR, 2025) and Towards Lifelong Learning of Large Language Models: A Survey (Zheng et al., ACM CSUR, 2025). These surveys already cover adaptation across time and domains, knowledge acquisition, and parametric/non-parametric learning. A clearer distinction from these established perspectives would help highlight the conceptual contribution of the proposed framework.
- Limited novelty of empirical findings. Several key findings appear consistent with known properties of existing methods, such as SDFT's ability to mitigate forgetting (Shenfeld et al., Self-Distillation Enables Continual Learning, 2026), the instability of RL under noisy rewards, and the stability–plasticity trade-off. While comparing these methods across different settings is useful, further analysis of why certain methods succeed or fail would strengthen the empirical contribution. For instance, the observation that SDFT performs well under domain shift but struggles with factual updates appears consistent with the known stability–plasticity trade-off. It would be helpful to clarify what additional insights emerge from these comparisons.
Questions for authors
Minor suggestions for improvement:
- Figure 1, Table 1, and the surrounding text are somewhat crowded and could be simplified to improve readability.
- The description in Lines 93–103 could be clarified, as the authors initially introduce two sub-regimes but subsequently refer to a third sub-regime.
Response to Reviewer Qaty
Thank you for the review and the presentation suggestions.
W1: Overlap with Shi et al. (2025) and Zheng et al. (2025). Both surveys discuss adaptation over time and across domains, as well as parametric and non-parametric learning, and we will cite and discuss them. The taxonomy is not our main contribution. The surveys categorize existing work (vertical vs. horizontal continuity in Shi et al., internal vs. external knowledge in Zheng et al.) but do not compare methods experimentally. Our framework is an evaluation protocol, with a common update operator U_k, a fixed per-stage budget, and a shared stage sequence, so that a prompt edit, a full-weight update, and a KV-cache adapter can be compared directly. We also split the time axis into slow noisy drift, discrete fact change, and agentic accumulation, each with its own metric (e.g., the stable-fact probe for catastrophic memorizing). The experiments show that these regimes favor different mechanisms, which the surveys do not establish.
W2: Findings consistent with known properties; why methods succeed or fail. Some results agree with prior work, which we take as a consistency check. Others do not follow from the individual papers (see the general response): prompt optimization forgets the most and does not transfer forward, compression is stable but learns little, the best weight-update method changes with the regime, and accuracy and PnL disagree on 10-K. The paper gives mechanism-level explanations for these results, which we will collect into a dedicated analysis subsection:
The stability-plasticity trade-off names the tension. Our results show where each mechanism falls on it in each regime, and that this position is not fixed for a given method.
Minor. We will simplify Fig. 1 and Table 1, and rewrite lines 93-103 so that all three time sub-regimes (slow drift, discrete fact change, agentic accumulation) are introduced up front.
We would appreciate it if the reviewer could tell us whether this addresses the novelty concern, and if not, which specific comparison or result would.