- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces SH-Prompt, which incorporates hierarchical semantic relationships into prompt-based Few-Shot Class-Incremental Learning (FSCIL). Building on SEC-Prompt, the method uses an LLM to partition classes into semantic superclasses. It injects superclass-shared prompts into deeper Transformer layers while keeping instance-level prompts in shallower layers, with both types optimized via superclass-guided loss terms ( and ). On CIFAR-100, ImageNet-R, and CUB-200, SH-Prompt shows modest improvements over SEC-Prompt and ASP, and includes robustness studies of partitioning strategies, superclass counts, and LLM backbones.
Critical strengths
Sharing superclass prompts across semantically related classes enables novel classes to reuse shared base-class representations, effectively easing the few-shot learning bottleneck. The key-similarity-based retrieval design is intuitive and practical, supporting the motivation.
Critical weaknesses
-
Across Tables 1–3, the proposed method yields modest improvements over the strongest baseline, with average accuracy gains of only 0.5%, 1.4%, and 0.4% on CIFAR-100, ImageNet-R, and CUB-200, respectively. On CUB-200, harmonic accuracy (HAcc) improves by only 0.1%, while Performance Drop (PD) worsens from 3.3 to 3.8, highlighting an inconsistent trade-off across metrics. Furthermore, Table 5 shows that LLM-based grouping outperforms visual prototype-based grouping by a negligible 0.3% in average accuracy, with no gain in HAcc and worse PD. These results are insufficient to confirm whether these subtle gains are statistically meaningful or merely artifacts of variance.
-
In Table 4, introducing superclass prompts simultaneously increases model capacity and adds deeper prompt tokens compared to the SEC-Prompt baseline. The current ablation fails to disentangle the benefit of semantic hierarchy from that of increased capacity. The authors should include a capacity-matched baseline—such as a random grouping strategy with an identical number and distribution of groups inserted at the same layer positions.
-
There are noticeable inconsistencies both between the reported metrics and prior literature and internally within the manuscript. First, the baseline performance for SEC-Prompt diverges from the values reported in its original paper; the authors should clarify the exact reproduction setup or source for these numbers. Second, internal numerical discrepancies are present. For instance, in Table 1, the arithmetic mean of the per-session accuracies for the proposed method is ~89.71%, whereas the reported average is 89.5%. Additionally, for the full pipeline on ImageNet-R, Session 4 accuracy is stated as 79.1% in Tables 2 and 4 but drops to 78.1% in Tables 5, 6, and 7. The authors need to recheck and revise.
Questions for authors
-
Discrepancies exist between the per-session accuracies and the reported average accuracies for LGSP and Ours in Table 1, and for Ours in Table 2. The authors should carefully recheck and revise these values. Furthermore, while the paper notes adherence to SEC-Prompt's protocols, could the authors clarify whether they directly cited the SEC-Prompt baseline numbers from the literature or reproduced them? If reproduced, were SEC-Prompt and the proposed method evaluated on identical few-shot sample splits, and what exact training hyperparameters were used?
-
To isolate the genuine contribution of LLM-derived superclass semantics, could the authors provide a controlled comparison between semantic grouping and random grouping? Matching the random baseline in parameter count, number of clusters, and prompt insertion layers would clarify whether the observed gains stem from semantic relationships or from increased prompt capacity.
-
Could the authors provide the exact superclass partitions and detailed implementation settings? For instance, 1) the explicit class-to-superclass mappings for each benchmark dataset and 2) the incremental assignment of novel classes to superclasses at each session.
-
The definition and calculation of Performance Drop (PD) are ambiguous. While Appendix B defines PD as the accuracy degradation on base classes before and after incremental training, the values reported in the tables appear to reflect the overall accuracy delta between the first and final sessions. Could the authors clarify this formulation and how they derived the reported numbers?
3 comments
Q3: There are noticeable inconsistencies both between the reported metrics and prior literature and internally within the manuscript. First, the baseline performance for SEC-Prompt diverges from the values reported in its original paper; the authors should clarify the exact reproduction setup or source for these numbers. Second, internal numerical discrepancies are present. For instance, in Table 1, the arithmetic mean of the per-session accuracies for the proposed method is ~89.71%, whereas the reported average is 89.5%. Additionally, for the full pipeline on ImageNet-R, Session 4 accuracy is stated as 79.1% in Tables 2 and 4 but drops to 78.1% in Tables 5, 6, and 7. The authors need to recheck and revise.
A3: We will carefully recheck the per-session accuracies and average accuracies in Tables, and correct the identified errors in the revised paper.
Q4: Discrepancies exist between the per-session accuracies and the reported average accuracies for LGSP and Ours in Table 1, and for Ours in Table 2. The authors should carefully recheck and revise these values. Furthermore, while the paper notes adherence to SEC-Prompt's protocols, could the authors clarify whether they directly cited the SEC-Prompt baseline numbers from the literature or reproduced them? If reproduced, were SEC-Prompt and the proposed method evaluated on identical few-shot sample splits, and what exact training hyperparameters were used?
A4: We will carefully recheck the per-session accuracies and average accuracies in the tables and correct the identified errors in the revised paper. Regarding the SEC-Prompt baseline, we reproduced it locally rather than directly citing the results reported in the original paper. Our reproduction followed the data settings and experimental protocols of the original SEC-Prompt paper. However, to ensure a fair comparison with ours, we set the random seed to 1 for both methods during reproduction. Apart from these adjustments, the remaining training configurations followed the original SEC-Prompt implementation. We will also clarify in the revised paper which baseline results are obtained through our own reproductions.
Q5: The definition and calculation of Performance Drop (PD) are ambiguous. While Appendix B defines PD as the accuracy degradation on base classes before and after incremental training, the values reported in the tables appear to reflect the overall accuracy delta between the first and final sessions. Could the authors clarify this formulation and how they derived the reported numbers?
A5: The PD values reported in our tables are calculated as the difference between the overall accuracy immediately after base training and that after all incremental sessions. We acknowledge that the definition in Appendix was inaccurate and will revise the corresponding formulation to clarify the calculation of PD.
Q6: Could the authors provide the exact superclass partitions and detailed implementation settings? For instance, 1) the explicit class-to-superclass mappings for each benchmark dataset and 2) the incremental assignment of novel classes to superclasses at each session.
A6: We provide the complete class-to-superclass mappings for all benchmark datasets. These details will be included in the appendix.
# Base-class-to-superclass mappings
CIFAR-100 :
[0, 53, 57],
[1, 30, 32, 55],
[26, 45],
[3, 15, 19, 21, 31, 42, 43],
[4, 34, 36, 38, 50],
[27, 29, 44],
[6, 7, 14, 18, 24],
[2, 11, 35, 46],
[5, 20, 25],
[9, 10, 16, 28],
[22, 39, 40],
[8, 13, 41, 48, 58],
[12, 17, 37],
[23, 33, 49],
[47, 51, 52, 54, 56, 59],
ImageNet-R :
[0, 1, 2, 3],
[35, 36, 37],
[23, 24, 25, 31, 32, 33, 34],
[4, 5, 19],
[6, 7, 20, 21, 22],
[8, 9],
[10, 11, 12],
[13, 14, 15],
[16, 17, 18],
[27, 28],
[29, 30, 89],
[80, 81, 82, 83, 84, 85, 86, 87, 88],
[38, 39, 47, 48, 49, 50, 59, 63, 64, 67],
[40, 41, 42, 43, 44, 45],
[51, 52, 53, 68],
[46, 54, 55, 56, 57, 58, 60, 61, 62, 65, 66],
[72, 73, 74, 75, 76, 77],
[69, 70, 71, 78, 79],
[26, 90, 91, 92, 93, 94],
[95, 96, 97, 98, 99]
CUB200 :
[0, 1, 2, 4, 5, 6, 7, 22, 23, 24, 43, 44, 57, 99],
[58, 59, 60, 61, 62, 63, 64, 65, 70, 71, 83],
[45, 49, 50, 51, 52, 85, 86, 88, 89],
[66, 67, 68, 69],
[78, 79, 80, 81, 82],
[35],
[36, 37, 38, 39, 40, 41, 42, 76, 77, 84],
[28, 29, 72, 73, 74, 92],
[27, 93],
[17, 18, 90],
[13, 14, 15, 16, 33, 34, 46, 47, 53, 54, 55, 56],
[20, 75],
[19],
[98],
[8, 9, 10, 11, 12, 25, 26, 48, 87, 94, 95, 96, 97],
[3, 21, 30, 31, 32, 91]
# Complete class-to-superclass mappings
CIFAR-100 :
[0, 53, 57, 83],
[1, 30, 32, 55, 67, 72, 73, 91, 95],
[26, 45, 77],
[3, 15, 19, 21, 31, 42, 43, 88, 97],
[4, 34, 36, 38, 50, 63, 64, 65, 66, 74, 75, 80],
[27, 29, 44, 78, 93],
[6, 7, 14, 18, 24, 79, 99],
[2, 11, 35, 46, 98],
[5, 20, 25, 84, 94],
[9, 10, 16, 28, 61],
[22, 39, 40, 86, 87],
[8, 13, 41, 48, 58, 69, 81, 85, 89, 90],
[12, 17, 37, 68, 76],
[23, 33, 49, 60, 71],
[47, 51, 52, 54, 56, 59, 62, 70, 82, 92, 96]
ImageNet-R :
[0, 1, 2, 3, 109, 110, 111],
[35, 36, 37, 120, 130, 155, 161, 168, 197, 198],
[23, 24, 25, 31, 32, 33, 34],
[4, 5, 19],
[6, 7, 20, 21, 22, 112, 115, 123, 124, 125, 128, 133, 134, 135, 137, 142, 143, 146, 147, 149, 150, 152, 158, 159, 167, 172, 174],
[8, 9, 114, 129, 138, 140, 141, 144, 151, 153, 156, 162, 175],
[10, 11, 12, 182, 183, 186],
[13, 14, 15],
[16, 17, 18, 122, 165],
[27, 28, 119, 121, 126, 127, 173, 176, 177, 178, 179, 180, 181, 184, 185, 187, 188, 189, 190, 191, 192, 193, 194, 195],
[29, 30, 89, 118, 157, 163, 170],
[80, 81, 82, 83, 84, 85, 86, 87, 88],
[38, 39, 47, 48, 49, 50, 59, 63, 64, 67],
[40, 41, 42, 43, 44, 45],
[51, 52, 53, 68],
[46, 54, 55, 56, 57, 58, 60, 61, 62, 65, 66],
[72, 73, 74, 75, 76, 77],
[69, 70, 71, 78, 79, 101, 102, 108],
[26, 90, 91, 92, 93, 94, 199],
[95, 96, 97, 98, 99, 100, 103, 104, 105, 106, 107, 113, 116, 117, 131, 132, 136, 139, 145, 148, 154, 160, 164, 166, 169, 171, 196]
CUB200 :
[0, 1, 2, 4, 5, 6, 7, 22, 23, 24, 43, 44, 57, 99, 100, 105],
[58, 59, 60, 61, 62, 63, 64, 65, 70, 71, 83, 140, 141, 142, 143, 144, 145, 146],
[45, 49, 50, 51, 52, 85, 86, 88, 89],
[66, 67, 68, 69],
[78, 79, 80, 81, 82],
[35, 186, 187, 188, 189, 190, 191],
[36, 37, 38, 39, 40, 41, 42, 76, 77, 84, 101, 102, 103, 134, 135, 136, 137],
[28, 29, 72, 73, 74, 92, 106, 107, 110, 111],
[27, 93, 192, 193, 194, 195, 196, 197, 198],
[17, 18, 90, 148, 149, 184, 185],
[13, 14, 15, 16, 33, 34, 46, 47, 53, 54, 55, 56, 138, 139],
[20, 75, 112, 113, 114, 115, 116, 117, 118, 119, 120, 121, 122, 123, 124, 125, 126, 127, 128, 129, 130, 131, 132, 147],
[19, 157, 158, 159, 160, 161, 162, 163, 164, 165, 166, 167, 168, 169, 170, 171, 172, 173, 174, 175, 176, 177, 178, 179, 180, 181, 182, 183, 199],
[98, 108, 150, 151, 152, 153, 154, 155, 156],
[8, 9, 10, 11, 12, 25, 26, 48, 87, 94, 95, 96, 97, 133],
[3, 21, 30, 31, 32, 91, 104, 109]
We sincerely hope that our revisions and clarifications adequately address your concerns. We would be happy to provide further clarification if needed.
Thanks for your careful and valuable comments. We will explain your concerns point by point.
Q1: Across Tables 1–3, the proposed method yields modest improvements over the strongest baseline, with average accuracy gains of only 0.5%, 1.4%, and 0.4% on CIFAR-100, ImageNet-R, and CUB-200, respectively. On CUB-200, harmonic accuracy (HAcc) improves by only 0.1%, while Performance Drop (PD) worsens from 3.3 to 3.8, highlighting an inconsistent trade-off across metrics. Furthermore, Table 5 shows that LLM-based grouping outperforms visual prototype-based grouping by a negligible 0.3% in average accuracy, with no gain in HAcc and worse PD. These results are insufficient to confirm whether these subtle gains are statistically meaningful or merely artifacts of variance.
A1: We agree that the modest performance improvements reported in the original experiments warrant further statistical validation. To investigate whether these gains are consistent across different random initializations, we conduct additional experiments with five random seeds on all three benchmark datasets. We report the mean and standard deviation of each metric and paired t-test results. The results show that SH-Prompt consistently improves Aavg over the strongest baseline across all three datasets, with gains of 0.56%, 0.44%, and 1.44% on CIFAR-100, CUB-200, and ImageNet-R, respectively. All three improvements are supported by paired t-tests (p < 0.01). HAcc also improves across all three datasets. Regarding PD, SH-Prompt achieves significant reductions on CIFAR-100 and ImageNet-R, whereas a slight increase is observed on CUB-200. As discussed in the paper, this may be related to the characteristics of CUB-200, where all categories belong to the bird class and already share substantial visual and semantic similarities. Consequently, superclass-level semantic grouping may provide relatively limited additional benefits for this fine-grained dataset, which may partly explain the lack of improvement in PD. Overall, these results provide statistical evidence that the improvements in Aavg are consistent across random seeds rather than merely arising from random variation. We will incorporate the corresponding results and statistical analysis into the revised paper. CIFAR-100 :
ImageNet-R :
CUB200 :
Q2: The authors should include a capacity-matched baseline—such as a random grouping strategy with an identical number and distribution of groups inserted at the same layer positions.
A2: To investigate whether the performance gain comes from the additional prompt capacity or the proposed hierarchical semantic modeling, we conduct an additional controlled experiment using randomly constructed superclass groups. Specifically, we keep the number of superclasses, prompt configuration, and training settings identical to those of SH-Prompt, while randomly assigning fine-grained classes to superclasses. As shown in the new results on ImageNet-R, the random grouping strategy achieves only marginal improvements over SEC-Prompt, increasing Aavg and HAcc by 0.2% and 0.4%, respectively. In contrast, SH-Prompt achieves improvements of 1.2% in Aavg and 1.6% in HAcc over random grouping, while also reducing PD by 0.8%. These results suggest that the performance gains cannot be attributed merely to the increased prompt capacity. Instead, organizing prompts according to meaningful superclass relationships plays an important role in improving the effectiveness of prompt learning. We will add this controlled experiment and the corresponding analysis to the revised paper.