- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper studies how to preserve access to previously learned knowledge when a representation changes in exemplar-free continual learning. It proposes address migration, which learns a linear map from updated activations to previous memory coordinates using current unlabeled inputs, combined with a wake–sleep schedule and geometric regularization. Theoretical analysis characterizes recovery conditions and routing stability. Experiments mainly on Split CIFAR-100 show that guided migration mitigates accuracy loss caused by projection updates, although it does not outperform the frozen-projection configuration.
Critical strengths
The paper addresses a relevant failure mechanism in continual learning: representation changes can invalidate routing to previously learned experts. It proposes an exemplar-free alignment approach supported by theoretical analysis of recovery conditions and routing stability.
Critical weaknesses
- The experiments support address migration as a partial repair mechanism for projection drift, but do not yet establish a practical advantage for continual learning. For example, as the SSL frontend is trained beforehand on the entire CIFAR-100 training split without labels; it therefore has access to future classes’ input distribution. Pretraining on all future classes limits the applicability of this work to the continual-learning settings where future data is unavailable.
- Frozen projection obtains 0.281+- 0.010 final accuracy, which is still higher than 0.273 +-0.011 guided migration proposed by the paper.
- Three seeds provide limited evidence for the reported effect sizes.
- The evaluation is limited to Split CIFAR-100 and domain-incremental MNIST, providing insufficient evidence of the method’s generalizability. More comprehensive ablation studies are needed.
- The paper’s presentation requires substantial clarification, for example, the abstract introduces numerous architectural terms before explaining their relationships.
Questions for authors
Please address the comments listed in the critical weaknesses.