- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies how well frozen representations can handle new classes without updating the feature extractor and introduces a new metric called Expansion Capacity to evaluate this ability. The authors also propose a memory-efficient method combining shared whitening and low-rank covariance information, with experiments on several datasets showing competitive performance while using much less memory.
Critical strengths
-
The paper studies a meaningful problem: how many new classes a frozen feature extractor can support without further training. This is an important question for continual learning, especially when retraining a model is expensive.
-
The authors conduct extensive experiments on different datasets and backbone architectures. The results show that their method achieves competitive performance while using much less memory. The authors also provide detailed ablation studies to support their findings.
Critical weaknesses
-
The paper does not seem to follow the standard ICLR template. For example, the title and font style look different from typical ICLR papers. I suggest the authors check the official template and fix the formatting issues.
-
The paper is quite difficult to read, including the introduction. Even after carefully reading the introduction, I still find it hard to understand the main motivation and the key contributions of this work. The paper contains too much text and technical detail but very few figures to help readers understand the main ideas. I think the authors should improve the writing and add some illustrations, especially a framework figure to explain how the proposed method works. This would make the paper much easier to follow.
Questions for authors
Could the authors explain the main motivation and contributions more clearly? I found the Introduction difficult to follow, and I think a more intuitive explanation of the problem and the proposed method would help.
Could the authors provide more details about the computational cost of the proposed method? In particular, how does its training and inference efficiency compare with existing methods under similar memory budgets?