- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates training-free few-shot image classification using vision-language models. The authors analyze the mixing of visual and textual class prototypes from a bias–variance perspective, arguing that incorporating textual prototypes can reduce the estimation variance of visual prototypes in few-shot settings. Based on this analysis, the authors propose constructing a task-semantic subspace using the principal components obtained from SVD of textual prototypes. Visual prototypes are projected into this subspace before being mixed with textual prototypes. To compensate for potentially discriminative visual information lost during projection, the authors further introduce a Mahalanobis-based image classifier using within-class covariance estimation. The predictions from the two classifiers are then combined through weighted score fusion. Experiments are conducted on 15 datasets and multiple vision-language models, demonstrating competitive average classification accuracy across different few-shot settings.
Critical strengths
-
The research problem is practically relevant. Effectively leveraging a small number of labeled images and textual semantics for classification without updating pretrained vision-language models is a meaningful research problem. The proposed method requires no additional gradient-based training and is relatively simple to implement, making it potentially useful in practical applications.
-
The experiments cover a broad range of settings and demonstrate competitive performance. The authors evaluate their method on 15 datasets, across different numbers of shots and multiple vision-language models, with comparisons against representative methods such as GDA, APE, and ProKeR. The results show improvements in average classification accuracy, particularly in the 1–4 shot settings.
-
The paper is generally well organized. The method follows a clear progression from bias–variance analysis of prototype estimation to semantic subspace projection and dual-classifier fusion. The overall approach is intuitive and relatively easy to understand and implement.
Critical weaknesses
- Limited methodological novelty
The proposed method primarily combines established techniques, including SVD-based feature projection, visual-textual prototype mixing, Mahalanobis classification, and classifier fusion. In particular, GDA (ICLR 2024) has already explored a closely related framework combining a text-based classifier with an LDA-based visual classifier.
The main distinction of this work lies in projecting visual features into a text-derived subspace before prototype mixing. However, the paper does not sufficiently demonstrate what fundamentally new methodological insights this combination provides beyond existing approaches.
- Insufficient justification of the motivation and methodology
The paper identifies cross-modal misalignment as an important motivation. However, the proposed text-guided projection does not explicitly model or optimize cross-modal alignment, and the paper provides limited evidence that it actually improves the correspondence between visual and textual representations.
More importantly, the motivation for task-semantic projection is to exclude task-orthogonal components that may interfere with prototype mixing. However, the final method reintroduces the excluded visual information through a Mahalanobis classifier operating on the full feature space.
Although this may be justified by classifier complementarity, it weakens the connection between the original motivation and the final method. The improved performance of the complete system does not necessarily validate the benefit of excluding task-orthogonal components, as the final predictions still rely on the information initially removed. The paper lacks sufficient analysis to distinguish these effects.
- Insufficient experimental analysis and unclear sources of performance gains
The Mahalanobis classifier is already a strong established baseline, and the existing ablations mainly compare different NCM variants. A direct comparison between Mix + Mahalanobis and Proj + Mix + Mahalanobis is needed to isolate the contribution of the proposed semantic projection within the final framework.
- The reliability of the cross-modal alignment metric is insufficiently validated.
The proposed principal-angle-based metric is sensitive to subspace dimensionality, as higher-dimensional subspaces may exhibit larger alignment scores even without stronger semantic correspondence. Since the effective subspace dimensions may vary across datasets with different numbers of classes, the metric may conflate geometric overlap with genuine semantic alignment. More importantly, this metric is also used to determine classifier fusion weights, yet the lack of dimension-controlled experiments or random-subspace baselines leaves the proposed adaptive fusion strategy insufficiently justified.
Questions for authors
- Methodological novelty and contributions beyond existing approaches
The proposed method combines established techniques, including SVD-based feature projection, visual-textual prototype mixing, Mahalanobis classification, and classifier fusion. Moreover, GDA (ICLR 2024) has already explored a closely related framework combining text-based and covariance-based visual classifiers.
Could the authors clarify what constitutes the key methodological novelty of this work beyond the combination of existing techniques? What fundamentally new insights or technical contributions does the proposed method offer compared with prior approaches such as GDA?
- Relationship between semantic projection and the final classifier
The motivation for task-semantic projection is to exclude task-orthogonal components that may interfere with cross-modal prototype mixing. However, the final method reintroduces the excluded visual information through a Mahalanobis classifier operating on the full feature space.
Could the authors clarify how this design is consistent with the original motivation? In particular, how do the performance improvements of the complete system validate the benefit of excluding task-orthogonal components, rather than simply reflecting the gains from combining two classifiers?
- Cross-modal misalignment and the effectiveness of semantic projection
The paper identifies cross-modal misalignment as an important motivation, yet the proposed method primarily projects visual features into a subspace defined by textual prototypes.
Could the authors explain more precisely why this operation is expected to alleviate cross-modal misalignment? Is there direct evidence that the projection improves the semantic correspondence between visual and textual representations?
- Cross-modal alignment metric and adaptive fusion
Given that principal-angle cosine values depend on subspace dimensionality, how do the authors ensure that alignment scores are comparable across datasets with different numbers of classes?
After controlling for subspace dimensionality, does the proposed metric still reliably reflect cross-modal alignment? Does the resulting adaptive fusion strategy consistently outperform simpler fixed-weight fusion approaches?
If the authors can satisfactorily address these concerns with clear explanations and convincing evidence, I would be willing to raise my score accordingly.