- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes Geometry-Aware Dual-Prompting (GADP) for zero-shot sketch-based image retrieval. The authors identify a phenomenon termed "Feature Space Cannibalization," arguing that excessive adaptation to seen classes may reduce the representation capacity available for unseen classes.
To address this issue, the proposed framework combines modality-specific prompts with contrastive alignment, triplet loss, angular-margin regularization, and center regularization. The method aims to improve cross-modal alignment while compacting seen-class representations. Experiments on three benchmark datasets under four evaluation settings report substantial improvements in zero-shot retrieval performance.
Critical strengths
1. Meaningful motivation and reasonable method design.
The paper addresses an important challenge in zero-shot cross-modal retrieval: adapting pretrained representations to seen categories without sacrificing generalization to unseen categories. The idea of encouraging more compact seen-class representations is intuitively reasonable, and the proposed components are designed to support cross-modal alignment and class discrimination.
2. Promising empirical performance.
The method reports substantial improvements across several standard ZS-SBIR benchmarks. The framework is also relatively parameter-efficient, updating only modality-specific prompts and LayerNorm parameters while keeping the main CLIP backbone frozen. These results suggest that the proposed combination of techniques may be practically useful.
Critical weaknesses
1. Insufficient justification of the central geometric claim.
The paper argues that compacting seen-class representations preserves manifold capacity for unseen classes. However, reducing intra-class variance does not necessarily imply that the corresponding classification or confidence regions become smaller. Moreover, the theoretical discussion appears to conflate additive cosine margins with additive angular margins (Eqs. 14–16), and the claimed guarantee of non-zero void volume is not rigorously established.
Since manifold capacity preservation is presented as a central contribution, these issues substantially weaken the theoretical justification of the proposed insight.
2. Limited novelty and insufficient experimental attribution.
Several key components, including modality-specific prompting, contrastive alignment, and angular-margin regularization, are established techniques. Although their combination is reasonable, the methodological novelty is relatively limited.
The paper reports substantial performance gains, but some comparisons involve different CLIP backbone capacities, and the experiments use only a single random seed. Furthermore, the ablation study does not clearly separate the contributions of AM-Softmax and center regularization. Consequently, it remains difficult to determine whether the reported improvements are specifically attributable to the proposed manifold capacity preservation mechanism.
Questions for authors
Q1. Could the authors clarify the theoretical relationship between angular-margin regularization, intra-class compactness, and manifold capacity preservation? In particular, how do Eqs. 14–16 establish a reduction in the occupied regions of seen classes, and under what assumptions is a non-zero void volume guaranteed?
Q2. Could the authors clarify which loss terms are included in the "Capacity Reservation" component in Table 2? Section 5.3 appears inconsistent with Eq. 19 regarding the role of Lcap. How much of the improvement comes from AM-Softmax and center regularization individually?
Q3. Since some competing methods use different CLIP backbones, could the authors clarify which comparisons are directly matched in model capacity? A controlled same-backbone comparison would help establish how much of the reported improvement comes from the proposed method.