- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Knowledge-Informed Controllable Augmentation (KICA) for few-shot class-incremental learning, inspired by the idea of augmenting samples for each novel class. Specifically, it first class-specific attribute sets from WordNet, Visual Genome, and an LLM, and then translates this information into structured instructions for background, attribute, and viewpoint editing. A pretrained image editor generates additional examples from the few-shot support images, which are subsequently used by existing FSCIL methods without modifying their architectures or objectives. Experimental results show that KICA can further improve their FSCIL performance.
Critical strengths
-
The idea of generating novel samples for each class is reasonable.
-
KICA exhibits consistent improvements over the original downstream methods. Table 1 reports higher final-session accuracy in all nine method–dataset combinations. Some improvements over plain image editing are substantial, particularly for BiMC on CIFAR-100 and CUB, suggesting that the proposed guidance can make synthetic augmentation more useful.
-
The experiments are extensive and sufficient to show the efficacy of KICA.
Critical weaknesses
-
The overall pipeline—constructing textual descriptions, converting them into editing instructions, and augmenting real images with a pretrained generator—seems incremental. For example, ALIA already uses vision and language models to construct descriptions and perform language-guided image editing for data augmentation [1]. The potentially distinctive contribution may be the integration of external class knowledge in KICA. [1] Dunlap, Lisa, et al. "Diversify your vision datasets with automatic diffusion-based augmentation." Advances in neural information processing systems 36 (2023): 79024-79034.
-
Section 3.2 aggregates attributes at the class level, but an attribute associated with a class is not necessarily a valid replacement for every instance. Valid variations may depend on other attributes or biological factors, especially for fine-grained bird categories. A simple union of attribute values does not capture these dependencies, and textual preservation instructions do not guarantee that the image editor respects them. This matters because all generated images retain their original labels and are used without filtering.
-
The paper states that results are averaged over repeated runs with paired seeds, but does not report the number of runs or uncertainty estimates. This is consequential because several gains over plain image editing are relatively small—for example, CLOSER’s final-accuracy improvements are approximately 0.7 percentage points across the three datasets, while BiMC improves by 0.2 points on miniImageNet. Reporting variability across support-set sampling and generation seeds would clarify their robustness. Table 4 also reports substantial preprocessing costs: approximately 20 hours for 800 images and 66.7 hours for 2,000 images on an A800 GPU, with roughly 76 GB of GPU memory usage. Although inference remains unchanged, these costs matter when new classes arrive incrementally. A generation-budget ablation would help establish how much of the improvement can be retained at a lower cost.
Questions for authors
- How much improvement remains when the plain editing baseline uses exactly the same operation-specific templates and preservation constraints as KICA, but without the external attribute base?
- What are the individual contributions of WordNet, Visual Genome, and LLM-derived attributes? Does the combined system outperform an LLM-only variant?
- What fraction of generated images preserve the original fine-grained label, particularly for attribute edits on CUB?
- How do the gains divide between novel-class recognition and retention of previously learned classes?