- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes DiSCIL, which replaces task-specific module routing in CLIP-based class-incremental learning with additive representation composition based on the distributive property of CLIP’s inner-product classifier. It further introduces a two-teacher LoRA consolidation strategy to merge historical and current LoRAs into a single module for task-agnostic inference.
Critical strengths
The observation that CLIP’s visual features are more crowded than textual anchors is intuitive and provides a reasonable rationale for freezing the text space and adapting only the visual encoder.
Critical weaknesses
1)The distributive property in Eq. (3) holds for any linear inner product and does not by itself justify treating task-specific modules as “complementary contributions” rather than competing candidates. Eq. (4) is only an ideal selectivity condition, not a proven property. 2)The proposed framework largely combines existing ideas: textual anchors, LoRA, supervised contrastive learning, negative similarity suppression, prototype-initialized cosine classifiers, and two-teacher distillation. 3)Table 1 shows DiSCIL is not consistently superior, especially on Aircraft and Cars, where TPPT-V achieves better Last accuracy. Yet the paper claims “strong and consistent” performance. Only Avg and Last are reported.
Questions for authors
As the weakness.