- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper proposes a new method for class-incremental semantic segmentation (CISS). The algorithm has two phases: Phase I (the “what”) learns a multi-label classifier that detects which classes are present; Phase II (the “where”) activates the corresponding class-specific binary segmenters. Part of the paper is dedicated to proving a parameter-level guarantee against catastrophic forgetting. The method obtains good results on standard CISS datasets.
Critical strengths
- Breaking up the task in a 'what' part (which can suffer forgetting) and an isolated 'where' part that will not suffer forgetting seems a reasonable idea.
- The paper reports good results on standard datasets PASCAL and ADE20K.
Critical weaknesses
-
The presentation of the paper is not good and needs to be improved significantly. Figure 1, does not show a new identified problem, the mathematical 3.1 and 3.2 (on zero-forgetting) are only of little importance to the method (and the reader is unsure about their purpose because they are not well introduced). It would be better to directly start with the method, and later use a (small part) of the math to support the working of the method (although I am yet to be convinced about any relation of the math with the method).
-
The results method should include newer works [a][b] also I think it would be important to show for all method on which backbone the method is based.
-
The method uses much larger network SigLIP2 than other methods (that is probably also why the paper also reports higher joint performance). It would be good to include results in the tables based on only the ResNet101.
[a] Continual Gaussian Mixture Distribution Modeling for Class Incremental Semantic Segmentation, NeurIPS 2025 [b] Learning Yourself: Class-Incremental Semantic Segmentation with Language-Inspired Bootstrapped Disentanglement, ICCV 2025
Questions for authors
I think the improvement to the presentation of the paper needs a new submission. The method obtains good results but comparison should be with more recent state-of-the-art and clearly state required pretrained networks (preferably in the Table). The main architectural idea is good and could lead to a publication in the future; the math requires a clearer link with the method.
See weaknesses.
- Normally zero forgetting in parameter isolation methods is only obtained in task incremental methods. Can the authors explain why they can claim it ? The multi-label classifier would still suffer forgetting (new heads can obtain higher scores than previous ones on old data).
Minor
- some of the citations are in the wrong format (cite vs citep)
- also explain SPI the first time you use it in introduction. I am not sure if HAT is a strict parameter isolation method since it can have soft attention masks.