- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes CoMove, a class-incremental learning method that jointly addresses teacher-reference mismatch caused by progressive ETF expansion and insufficient supervision support under limited replay. CoMove updates teacher references through spherical transport and integrates peer, prototype, and teacher supervision through a common objective with shared negative competition. Their contributions are allocated according to class composition and replay support. The paper establishes exact prototype alignment and old-label ranking preservation. Across three datasets and two replay budgets, CoMove achieves the highest mean final Class-IL accuracy in all six main comparisons, exceeding the best baseline in each setting by an average of 4.69 percentage points. The evaluation also includes exemplar-free experiments and component ablations.
Critical strengths
-
CoMove improves accuracy across all six main comparisons and substantially reduces forgetting on CIFAR-100 and TinyImageNet. Using the same supervision-allocation rule across datasets and replay budgets adds practical value.
-
The exact characterization of inherited-prototype displacement, together with teacher transport that requires no additional map fitting, provides a clear and verifiable explanation of how teacher references can be aligned with the expanded classifier geometry.
Critical weaknesses
-
Möbius transport is theoretically, but I am not yet convinced that its additional geometric properties are important to CoMove’s empirical success. The simpler normalized affine transport performs comparably or better in several settings, and removing pooling does not consistently degrade performance. Furthermore, each core ablation uses only a single paired run, limiting the evidence supporting the necessity of these designs.
-
The threshold in the replay coverage rule, , lacks sufficient justification, and the paper does not report a sensitivity analysis. In particular, when an old class has only one replay example, all positive prototype and peer supervision weight is transferred to the teacher. However, sparse replay support does not necessarily imply that the teacher is reliable.
-
The introduction’s overall motivation is understandable, but the transition from general class-incremental learning to progressive ETF classifiers does not adequately explain why this framework is chosen. The transition from geometric transport to supervision allocation also needs a clearer connection to the motivating problems, making the necessity of the core designs less intuitive.
-
The related work largely enumerates methods and describes local differences. It does not sufficiently synthesize the remaining research gaps or explain how addressing these gaps motivates the significance of the proposed method.
-
The high-level workflow is clear, but Sections 4.2–4.3 combine several objective-design mechanisms in a dense presentation. The lack of a step-by-step explanation makes their necessity, interactions, and individual contributions difficult to understand.
-
The manuscript contains numerous typesetting and layout issues. For example, the caption of Figure 2 exhibits abnormal interword spacing, the bold run-in heading around line 290 is awkwardly broken rather than starting as a new paragraph, and there are conspicuously large vertical gaps between paragraphs in several places. The authors should carefully proofread the manuscript line by line and correct these presentation issues, as they significantly detract from the professionalism and readability of the paper.
Questions for authors
-
What motivates choosing as the threshold in the replay coverage rule?
-
Under matched initial-task training, initialization, and replay protocols, how much of CoMove’s improvement over ProNC remains? This would help distinguish gains due to initialization changes from those due to the proposed incremental-learning mechanisms.
2 comments
Response to N6xX (Part 2/2): Replay coverage and presentation
1. On the coverage threshold (Weakness 2; Question 1)
The reviewer asks why coverage uses and requests a sensitivity analysis.
scales support with competing classes and the ETF simplex rank. With class- examples in the merged dataset, we use \rho_i=\min\left\\{1,\frac{n_{y_i}-1}{K-1}\right\\}. This gives zero coverage for a singleton and full coverage at . The rank motivates the scale, without guaranteeing statistical sufficiency or feature diversity (Section 4.3).
We varied only the denominator over three paired seeds, at buffer 200 (Table 7). Class-IL mean ± sample SD (%):
| Threshold | C100 FAA ↑ | C100 FF ↓ | Tiny FAA ↑ | Tiny FF ↓ |
|---|---|---|---|---|
| 47.93 ± 0.64 | 18.67 ± 0.36 | 33.56 ± 0.62 | 7.94 ± 0.27 | |
| 48.69 ± 0.93 | 19.58 ± 0.50 | 34.09 ± 0.62 | 7.75 ± 0.36 | |
| 49.08 ± 0.99 | 20.44 ± 0.62 | 33.56 ± 0.39 | 7.93 ± 0.39 |
All mean FAA changes are below one point. Doubling the threshold raises C100 FAA and FF; the default has the best Tiny FAA and FF. By comparison, disabling transfer costs 5.14 ± 0.53 / 1.80 ± 0.22 FAA points on C100/Tiny. This supports a shared default with a modest sensitivity trade-off.
2. On singleton classes (Weakness 2)
The reviewer notes that sparse replay does not guarantee teacher reliability.
We agree: coverage measures available support and leaves teacher reliability unmodeled. At zero coverage, prototype negatives still provide label-conditioned competition, although teacher errors can be inherited.
Retaining full prototype attraction and transferring only peer weight lowers Tiny/200 FAA by 1.08 ± 0.16 points and raises FF by 1.22 ± 0.95 over three paired seeds (Table 13). Each old class has one exemplar at the last transition. This supports the allocation in that setting; teacher reliability remains a limitation, now discussed in Appendix C.1.2.
3. On motivation (Weakness 3)
The reviewer asks why progressive ETF classifiers are chosen and how transport connects to allocation.
The revised introduction explains that progressive ETFs preserve equal-norm, equiangular targets as classes arrive. Expansion moves these targets while replay support shrinks: transport corrects the reference; allocation adjusts its influence.
4. On related work (Weakness 4)
The reviewer asks for a synthesis of research gaps in the related work.
Section 2 now synthesizes the gap: replay and distillation preserve past information, while ETF expansion moves its targets. CoMove connects these changes through analytic alignment and support-dependent allocation. We distinguish this from learned drift compensation and replay selection.
5. On method clarity (Weakness 5)
The reviewer finds the mechanisms in Sections 4.2–4.3 too densely presented.
We now explain the mechanisms in order: relations, shared negatives, pooling, source responses, then allocation. Each subsection opens with its purpose; Figure 1 follows the same transport–objective–allocation structure. The ablations separate their effects.
6. On typesetting (Weakness 6)
The reviewer identifies typesetting and spacing issues.
Corrected: Figure 2's caption spacing, the run-in heading around submitted line 290, and excess manual vertical spacing. We also adjusted and visually checked the wrapped tables and paragraph endings.
Response to N6xX (Part 1/2): Component evidence and initial-task training
We thank Reviewer N6xX for the feedback. We now report three-seed component ablations (Table 4) and controls from ProNC's initial-task training.
1. On teacher transport (Weakness 1)
The reviewer questions the empirical benefit of Möbius over normalized affine and requests repeated ablations.
Both continuations reduce forgetting, with comparable accuracy. Across three paired seeds in all six settings, normalized affine changes mean FAA by -0.22 to +0.25 points relative to Möbius. Both lower FF in all 18 pairs with raw teacher, which retains small FAA advantages on C100/500 and Tiny/500 (Table 5).
Both extend the same affine prototype map and coincide at inherited prototypes. Möbius adds tangent-angle preservation at comparable cost, motivating its use with similarity-based supervision. We agree that these results do not establish an accuracy benefit from conformality. General response 3/4, point 1 gives the formulas and timings.
On C10/200, transport's FAA benefit is 1.83 ± 0.39 points larger with CoMove responses than with logistic responses, positive on all three seeds (Table 16). This supports their joint use in this setting.
2. On pooling (Weakness 1)
The reviewer also notes that removing pooling does not consistently degrade performance.
The repeated results confirm a modest, dataset-dependent effect. Pooling adds 0.55 ± 0.36 / 0.28 ± 0.31 FAA points on C10 at buffers 200/500 (paired mean ± sample SD); C100/Tiny changes range from -0.21 to +0.05. The unpooled objective remains competitive. Table 20 and General response 4/4, point 2 give all pooling results; Table 10 covers every component and both evaluation protocols.
3. On initial-task training and initialization (Question 2)
The reviewer asks how much improvement over ProNC remains when initial-task training, initialization and replay are matched.
The gains persist: +3.51–8.34 FAA points over published ProNC in all six settings. The main comparison already shares the backbone, schedule, augmentation and replay policy. It differs in initial-task training: ProNC fits an ETF to learned features; CoMove trains toward a fixed ETF.
We now retain ProNC's learned encoder, fitted ETF and replay buffer, changing only the incremental objective. Across three seeds, full CoMove also lowers FF by 8.27–32.31 points (Tables 6 and 25). With raw references, FAA gains remain 3.61–8.61 points. Accuracy is comparable to or higher than with our own birth: the gains do not rely on that procedure. General response 2/4, point 2 details the control.