- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes an exemplar-free class-incremental learning framework designed to maintain reliable class statistics as pretrained representations evolve during continual adaptation. The method combines shrinkage-controlled low-rank mean alignment, which estimates representation drift from paired before/after features and reduces unreliable corrections using split-fit disagreement, with a regularized Gaussian classifier that combines class-specific, pooled and spherical class covariance estimates. Experiments on four ten-task benchmarks show improvements when integrated with E2-LoRA, SLCA, and TUNA.
Critical strengths
- The method motivation is clear. The paper identifies a practical problem in exemplar-free class-incremental learning with evolving representations: stored old-class statistics become stale as the feature space changes, while old samples are unavailable for recomputation. The method design closely follows the two motivating questions: i) split-fit shrinkage determines how much an estimated mean correction should be trusted, and ii) regularized Gaussian classification determines how much historical class-specific covariance structure should be retained for prediction.
- The experimental evaluation is thorough. The paper reports results on four class-incremental benchmarks and demonstrates integration with multiple methods, including E2-LoRA, SLCA, and TUNA. The evaluation further includes matched host comparisons, component and mean-update ablations, analyses of the shrinkage and covariance designs, and experiments with longer task sequences.
Critical weaknesses
- The experimental role and applicability of SLARC are not sufficiently clear. SLARC is presented as a plug-and-play framework, but it actually operates on top of a host continual-learning method with evolving representations. Table 2 reports SLARC component variants under E2-LoRA, while Table 1 applies SLARC only to SLCA, TUNA, and E2-LoRA. The paper should clearly state what properties a host method must satisfy for SLARC to be applicable, and explain why it is not integrated with other strong baselines such as SSIAT or RanPAC. Clarifying the compatibility conditions would make the scope of the plug-and-play claim much clearer.
- The plug-and-play claim could be better supported. SLARC is evaluated with SLCA, TUNA, and E2-LoRA, but the closest drift-estimation method, SLDC, is not reproduced as a complete matched baseline. Although SLDC is discussed in the main text and its sample-count shrinkage rule is evaluated in Appendix S6.6, the appendix explicitly states that this does not reproduce the full SLDC pipeline. A matched comparison with SLDC under the same setting would better clarify the advantage of the proposed low-rank alignment and split-fit shrinkage.
Reference: [1] Xuan Rao, Simian Xu, Zheng Li, Bo Zhao, Derong Liu, Mingming Ha, and Cesare Alippi. Compensating distribution drifts in continual learning with pre-trained vision transformers. In AAAI, 2026.
Questions for authors
Questions asked in the weakness section.
Dear Reviewer 4L61,
Thank you again for your encouraging assessment and constructive suggestions. We have expanded our experiments and clarified the applicability of SLARC to different continual-learning methods, along with its relationship to SLDC.
We hope these additions have addressed the points you raised. Whenever convenient, we would appreciate any further feedback you may have. If there is anything else we can clarify, we would be very happy to do so.
Thank you for your consideration.
The Authors