- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+2)
Read review
Paper summary
This paper proposes a new architecture-based approach for class-incremental learning, PSCAD. The strategy treats accumulated task parameters as a dynamical system and refines it via CANN-experimental dynamics.
Critical strengths
- the architecture-based strategy is an interesting approach for continual learning.
- the presentation of this paper is fine.
Critical weaknesses
-
My main concern lies in the experiment of this paper which does not appear to be rigorous and carefully designed. Experiments are conducted with a single random seed where no standard deviations are reported.
-
PROL by Ma'sum et al is proposed for online continual learning (single-pass). How do you guarantee the fairness of the comparison? You need to compare it under a single pass learning mode as well.
-
It is not clear whether your approach utilizes a pretrained network or not. This should be clearly explained. It is mentioned that SD-LoRA is the main competitor. Do you develop your method based on it? If so, the novelty of your approach should be explained.
Questions for authors
Please answer the three major concerns.
3 comments
Follow-up on Our Rebuttal
Dear Reviewer,
Thank you again for your time and constructive feedback. We have posted our responses and updated the manuscript with additional experiments and clarifications addressing your concerns.
We would appreciate your feedback on whether these additions resolve your main concerns. If any issues remain, we would be happy to clarify them. If you find that your concerns have been addressed, we would be grateful if you could reconsider your assessment and rating accordingly.
Thank you for considering our response.
My comments have been addressed. I agree to increase my score to weak accept.
Response to Reviewer CqtA
Thank you for recognizing the value of PSCAD and our theoretical analysis. We address your concerns about the theoretical analysis, experimental evidence and implementation details below. Table numbers refer to the revised manuscript.
Table 1. Results on ImageNet-R. Values are mean ± standard deviation.
2.Comparison with PROL. Thank you for pointing out this protocol mismatch. We agree that PROL targets single-pass online continual learning, whereas our experiments use multiple training epochs per task. The data-access constraints differ, making the original comparison inappropriate. We have therefore removed PROL from the main comparison table and withdrawn the associated comparative claims.
3.Pretrained backbone and novelty beyond SD-LoRA. We use a pretrained ViT-B/16, initialized from an ImageNet-21K checkpoint further fine-tuned on ImageNet-1K, as specified in Section 5.1. PSCAD is built on SD-LoRA, which provides the task-specific parameter-learning stage. Our contribution is an additional parameter-space consolidation mechanism: accumulated task parameters are treated as interacting dynamical states and refined through affinity-weighted interactions, adaptation, and Hopfield memory retrieval, then combined with their original values through residual connections. The memory is learned from the current-task loss by differentiating through consolidation, without storing or replaying historical training examples.
The novelty therefore lies in explicitly reorganizing previously learned task parameters through a memory-guided dynamical process, beyond the task-specific learning provided by SD-LoRA. We further characterize this process through continuous-time and discrete-time energy-dissipation analyses under stated conditions. The reproduced SD-LoRA comparisons and component ablations evaluate the contribution of this additional consolidation mechanism.