- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper primarily investigates the sketch-to-person re-identification task, focusing on addressing the modality gaps between sketches and real photographs, as well as the style variations that arise when different individuals sketch the same target. To this end, the authors propose a retrieval framework based on identity consensus. The SPFC module employs two independent branches to learn, respectively, the shared features across sketches belonging to the same identity and discriminative features for final retrieval; it further utilizes leave-one-out contrastive learning to enhance feature consistency among sketches of the same individual. The GLMA module leverages global features from one modality to guide the aggregation of local features from another modality, thereby improving the matching performance between sketches and photographs. The SACC module utilizes textual description information from the training phase to assist the model in better distinguishing between pedestrians who share similar appearances but belong to different identities. The authors conducted experiments on the Market-Sketch-1K and PKU-Sketch datasets, achieving promising results across single-query, multi-query, and cross-style evaluation settings. Ablation studies also demonstrated that each module contributed to performance improvements. However, the paper currently lacks more direct experimental evidence to quantify the specific contribution of the identity consensus mechanism, and certain configurations in the cross-style experiments require further elaboration
Critical strengths
-
The paper addresses style variations in sketch-based person re-identification. The research objective is clear and has practical relevance.
-
SPFC learns the identity-consensus prototype and retrieval features separately, which helps reduce potential interference from directly fusing different sketches. The ablation results also support the benefits of this design.
-
GLMA and SACC improve the model through cross-modal local feature alignment and hard negative learning, respectively, without introducing additional cross-modal inference overhead.
Critical weaknesses
-
When training with only a single sketch style, the SPFC fusion weight is always 1, preventing the weighting branch from being effectively trained. The paper does not clearly explain how the model learns to handle unseen sketch styles under this setting.
-
SPFC assigns weights mainly based on the features of individual sketches, without explicitly modeling the agreement between different sketches. It remains unclear whether the module actually learns identity consensus.
-
In the PKU-Sketch dataset, each identity has only one sketch, making leave-one-out multi-sketch consensus learning unavailable. Therefore, the performance improvements on this dataset cannot directly demonstrate the effectiveness of the core consensus mechanism.
-
Some experiments could be more comprehensive. The mAP improvement under the single-query setting is relatively small, but no multi-run stability analysis is provided. In addition, the cross-style multi-query experiments lack comparisons with stronger methods such as OLTM.
Questions for authors
-
When the training data consists of only one sketch style, the fusion weight of SPFC remains consistently 1. In such cases, how does the model learn fusion weights for different styles? And how does it handle unseen styles during inference?
-
SPFC primarily assigns weights based on the intrinsic features of each individual sketch; how does the model determine which features constitute shared identity characteristics across different sketches?
-
In the PKU-Sketch dataset, each identity has only one sketch, making multi-sketch consensus learning infeasible. Could the authors further clarify which components primarily contribute to the performance improvement observed on this dataset?
-
The improvement in mAP for the single-query task reported in the paper appears limited; were multiple repeated experiments conducted to verify the robustness of these results?
5 comments
Response to Reviewer–Part 2: PKU-Sketch analysis, stability, and cross-style comparisons
W3 / Q3. How the framework operates on PKU-Sketch.
Thank you for highlighting this distinction. We agree that PKU-Sketch, with one sketch per identity, does not directly evaluate multi-sketch consensus learning. In this setting, the prototype reduces to the individual sketch representation, and the leave-one-out objective is inactive. The remaining framework, however, continues to learn sketch–photo retrieval through complementary supervision.
Specifically, CLIP initialization provides a general representation foundation, while the visual contrastive warm-up establishes an initial sketch–photo alignment. Subsequent identity and cross-modal objectives further refine the retrieval representation. GLMA models local sketch–photo correspondence, while SACC provides training-only semantic supervision to calibrate ambiguous negatives. The remaining prototype-related objectives also retain single-sketch representation consistency and photo alignment. These mechanisms remain applicable without multiple same-identity sketches and jointly support the reported PKU retrieval performance.
PKU-Sketch therefore provides a complementary assessment of the framework’s applicability when multiple sketches are unavailable. We have clarified this experimental scope in Sec. 4.3 and explained the active learning mechanisms in Appendix C.1.
W4 / Q4. Multi-run stability and stronger cross-style comparisons.
Thank you for highlighting the need to verify the modest SQ mAP improvement through repeated experiments. We conducted nine additional independent training runs for each protocol, yielding ten runs per protocol, including the run reported in the main comparison tables. All runs use the same experimental settings as the main paper. We have added the summary statistics and stability analysis in Appendix C.6.
Results are reported as mean ± sample standard deviation (%):
| Protocol | mAP | Rank-1 | Rank-5 | Rank-10 | mINP |
|---|---|---|---|---|---|
| SQ | 41.37 ± 0.16 | 39.85 ± 0.24 | 65.02 ± 0.48 | 75.82 ± 0.38 | 31.22 ± 0.26 |
| MQ | 69.81 ± 0.39 | 74.88 ± 0.58 | 93.98 ± 0.57 | 97.41 ± 0.22 | 56.64 ± 0.74 |
The SQ and MQ mAP values in Table 1, 41.34% and 69.84%, are close to the corresponding ten-run means. SQ mAP ranges from 41.19% to 41.69%, with a standard deviation of 0.16 percentage points. Together with the limited variation in the other retrieval metrics, these results support the run-to-run stability of the reported performance.
We also agree that OLTM provides a strong and relevant text-guided cross-modal alignment baseline. Following your suggestion, we have added its published MQ-training/MQ-testing results to Table C.5, alongside BDG, CGC, and our method. Our method leads on four of the six configurations reported by OLTM, while OLTM leads on the other two. We have also expanded the analysis in Appendix C.3 to discuss how training-style coverage, drawing-specific correlations, and the identity cues preserved in unseen queries may contribute to these differences.
We thank you again for your constructive comments, which have helped us make the evaluation more complete and explain the learning mechanism more clearly. The additional analyses and experiments strengthen the evidence for prototype-based retrieval and its run-to-run stability, while clarifying the role of each evaluation setting. We hope these revisions address your concerns and provide a clearer basis for reassessing the contribution of the work.
Your questions about identity-consensus learning and the single-sketch setting have been helpful in refining our explanation and evaluation of the framework.
In the revised manuscript, we connect the ablation evidence with a new feature-consistency visualization, clarify single-style training and the PKU-Sketch setting, and provide repeated-run statistics and cross-style MQ comparisons with OLTM.
Before the discussion closes, we would be grateful if you could take a look at these additions and let us know whether any concerns remain. We are happy to discuss them further and make appropriate revisions. Thank you again for your thoughtful feedback and time.
Response to Reviewer–Part 1: Unseen-style generalization and identity consensus
Thank you for your careful review and for recognizing the practical relevance of addressing sketch-style variation, the separate prototype and retrieval branches in SPFC, and the complementary roles of GLMA and SACC. In response to your comments, we have clarified the mechanism and scope of consensus learning, added a visualization of cross-style feature consistency and repeated-run statistics, and expanded the cross-style MQ comparisons. We address each concern below.
W1 / Q1. Single-style training and unseen-style generalization.
Thank you for highlighting the need to clarify this setting. We agree that training with only one drawing style provides no observations of differences between styles and therefore cannot directly supervise how different drawing styles should be weighted. Our single-style experiments examine transfer under limited training-style coverage, rather than a dedicated mechanism for learning unseen styles.
In Market-Sketch-1K SQ training, we retain the prototype-based supervision used by the framework. Training preferentially samples same-identity sketches from different styles; when only one original sketch is available, it instead uses independently augmented views of that sketch. Although these views share the same style label, their visual features can differ. Consequently, the prototype weighting branch can still receive training signals, and its normalized weights need not be uniform. The resulting supervision encourages consistency across augmented views, without introducing additional drawing styles.
At inference, an unseen-style sketch is processed by the same visual encoder and retrieval path. Under SQ, its descriptor is directly compared with gallery photo descriptors, so handling the unseen style relies on transfer of the learned visual representation. The encoder is initialized from CLIP and trained with identity and cross-modal supervision; no additional adaptation to the held-out style is performed. Under MQ, the existing fusion branch combines the query features, but its use does not establish that single-style SQ training has learned reliable fusion weights for unseen styles. We have clarified these distinctions in Appendix C.3 and identified reliable aggregation under limited training-style coverage as a direction for future research.
W2 / Q2. How SPFC learns identity consensus.
Thank you for asking us to clarify how consensus is learned. Each sketch is indeed scored from its own visual features and style information, without explicitly computing pairwise agreement. However, the prototype weighting branch is trained through objectives relating multiple same-identity observations. Individual scoring therefore does not imply isolated per-sketch learning.
Specifically, Lintra requires an excluded sketch to identify the prototype constructed from its same-identity peers against other identity prototypes. This jointly trains the visual encoder and prototype scorer to capture evidence that remains predictive of identity across observations. Meanwhile, Lpp aligns the prototype with same-identity photos, and Lrp transfers the prototype constraint to the retrieval descriptor. Thus, shared identity information is learned through cross-sketch consistency and cross-modal identity discrimination, rather than specified by the scoring function alone.
Table 4 provides controlled evidence for this contribution, with warm-up, GLMA, and SACC fixed. With uniform retrieval fusion, Prototype Only improves over Mean Fusion by 2.08 mAP and 2.61 Rank-1 points. Without explicit style conditioning, retaining the prototype branch and its objectives improves over Attention Fusion by 1.58 and 3.17 points, respectively. These comparisons support the benefit of prototype-based supervision beyond learned retrieval weighting or explicit style conditioning.
We have additionally included a visualization and analysis in Appendix D.2. For the illustrated identity, six sketches with visibly different drawing styles exhibit coherent deep representations: all off-diagonal cosine similarities exceed 0.52, with B–C and E–F reaching 0.807 and 0.808. This illustrates cross-style consistency within the same identity in the learned feature space. The figure also shows different prototype and retrieval-fusion weight distributions, complementing the ablations by displaying the two branches’ aggregation behavior.