- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
DyCoG is an interpretable model for class-incremental learning. It preserves samples from previous phases to use for training in future phases. It uses an LLM to add new concepts to the concept bank and refine them. It also employs a gating mechanism to find relevant concepts for each image among all available concepts. It avoids using a gradient-based classifier and instead uses an RLDA classifier based on image-concept similarities.
Critical strengths
The paper addresses two fundamental problems:
- Interpretability: The ability to provide explanations for the model's classification decisions.
- Class-incremental learning: The ability to distinguish new classes while preserving classification performance on previously learned classes.
Critical weaknesses
Unfair comparison in Table1
DyCoG uses the training data from all past classes, while most of the compared methods are exemplar-free, such as CI-CBM, CLG-CBM, etc. These methods do not preserve any samples from previous classes/stages. It is obvious that having access to previous classes makes it much easier to preserve their classification performance. The main challenge in CIL is to learn to distinguish new classes with previous classes without access to the previous samples. This issue also affects the comparisons in Tables 2 and 3, and Figure 5 as well and leads to a false conclusion that DyCoG benefits from more incremental stages while other methods do not. The reason for this might not be the DyCoG architecture and methodology but could instead be due to DyCoG using all previous samples.
Questions for authors
- Does your method support the case where you do not retain any samples from previous classes? If yes, those results should be compared with other exemplar-free methods, and you can have another table to compare with methods that preserve a pool of previous samples. This will make the comparison fair.
- What is the difference between applying your method incrementally and training an interpretable classifier using all seen samples?
- While you mentioned that your method avoids gradient-based classifier training, your gating network is trained using gradient descent at each stage. Can you clarify this?