- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SPA addresses exemplar-free class-incremental learning with CLIP by combining global classification with attribute-guided local alignment. GPT-generated class attributes guide top-K patch selection, followed by optimal transport between selected patches and attribute embeddings. Task-specific projectors and global Gaussian feature replay support incremental adaptation. Experiments across nine datasets show consistent improvements, with additional analyses of shared semantic priors, class-order robustness, forgetting, and computational cost.
Critical strengths
-
Broad empirical validation. SPA consistently outperforms the evaluated baselines across nine datasets and two initial-class settings using the same CLIP backbone, supporting its effectiveness across diverse recognition tasks.
-
Useful controls and practical evaluation. Comparisons using identical GPT-generated attributes across five seeds help distinguish SPA’s gains from stronger semantic priors. Inference latency, memory, and scalability analyses further support its practical relevance.
Critical weaknesses
The contribution beyond closely related methods remains insufficiently established. Although PLOT and GalLoP are cited, their methodological differences from SPA are not examined in depth, and their local mechanisms are not compared under matched semantics, projectors, and calibration. Figure 4a provides only a stepwise ablation on Aircraft, without mathematically defining the “simple matching” baseline. Table 4 controls semantic priors but does not resolve this mechanism-level comparison. ENGINE, a directly relevant method using GPT-generated descriptions for CLIP-based incremental learning, is also cited but not evaluated. The results establish SPA as an effective combination, but provide insufficient evidence of its advance over the closest approaches.
Questions for authors
-
Under identical GPT attributes, global branches, projectors, and Gaussian calibration, how does SPA compare with alternatives using PLOT-style set-based OT or GalLoP-style semantic top-K matching? Please define the “simple matching” baseline in Figure 4a and explain the omission of ENGINE.
-
Does the local branch use temperature scaling or CLIP’s logit scale? Does Equation (15) combine pre-softmax scores or probabilities? Is (R_c(x)) constructed separately for each candidate class during both training and inference? Please provide implementation-consistent equations and pseudocode, clarifying why Algorithm 1 specifies only (T_y).
-
New projectors in Equation (8) change the aggregated representations of old-class inputs, while Gaussian replay is applied only to the global branch. How well does the local branch retain old-class performance? Please report its standalone old-class accuracy and separately ablate projector expansion and Gaussian calibration. Table 5 evaluates the fused model, leaving their individual contributions unclear.
Dear Reviewer,
Thank you again for your time and constructive review. In our previous responses, we have clarified SPA's differences from existing methods, its forgetting mitigation mechanisms, and key implementation details. We have also provided additional ablation studies and experimental comparisons to further address your concerns.
As the discussion phase is drawing to a close, we would greatly appreciate it if you could kindly revisit our detailed rebuttals and let us know whether these clarifications and additional experimental results have addressed your concerns. We remain fully available for any further clarification.
Thank you very much for your time and consideration.