- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper addresses exemplar-free class-incremental learning. The key idea is to use a task-shared affine transformation to compensate for feature-space drift. Therefore, it updates the means and covariances without replaying old samples. The paper provides a theoretical analysis of affine matching and derives error bounds. Building on this idea, the authors propose Recoverable Feature Learning with Affine Compensation (ReFAC), which combines projected distillation and within-class covariance matching to preserve recoverable information while allowing the representation to adapt to new classes. Experiments show that the proposed affine compensation can replace the statistics update mechanisms of several existing EFCIL methods while largely preserving or improving their performance.
Critical strengths
- The representation in EFCIL is continuously evolving, while only statistics are retained for the historical classes. This mismatch is indeed important.
- Shared affine compensation provides a simple and direct way to alleviate this mismatch.
- The paper provides an analysis of the error bounds. The theoretical results are intuitive and consistent with expectations.
- The experimental evaluation is fairly comprehensive. Replacing the memory update with the proposed affine update in four existing methods demonstrates that the proposed approach is not effective only for a particular framework.
Critical weaknesses
Theorem 1 serves as the starting point of the proposed method, but its theoretical result is arguably too general in terms of applicability. This generality may also limit the effectiveness of the proposed approach for specific machine learning tasks. This concern is also reflected in the experimental results, where the proposed method does not appear to push the performance to a clearly new level. Nevertheless, I think that the current contribution is sufficient to warrant acceptance.
Questions for authors
Here are some suggestions regarding the presentation of the paper:
-
Since the paper focuses on addressing a problem in incremental learning, its primary audience will likely come from the incremental learning community. Therefore, I suggest that the authors provide a broader review of incremental learning methods in the related work section, rather than focusing primarily on exemplar-free replay methods. For example, the authors may consider discussing different lines of research, such as manifold-based approaches, e.g., [Reducing Class-wise Confusion for Incremental Learning with Disentangled Manifolds], and compression-based approaches, e.g., [Prompt-Based Exemplar Super-Compression and Regeneration for Class-Incremental Learning], among others. In addition, providing more discussion of the advantages and limitations of different technical approaches, rather than simply describing existing works, would make the paper more accessible to newcomers and better highlight the unique position of the proposed work within the field.
-
The authors provide an analysis of the error bounds in the paper. I suggest briefly discussing the practical implications of these theoretical results. This would make the theoretical analysis more accessible and helpful to readers who are less familiar with the theoretical aspects.