- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Visual Clue-guided Interactive Retrieval (VCIR) for interactive text-to-image person re-identification. VCIR uses a Visual Clue Extraction module to inspect the current Top-K candidate images together with the initial description and accumulated user feedback. A learned retrieval token collects intent-aligned visual clues, and a linear adapter maps its hidden state into the image-embedding space of a CLIP-based retriever. The resulting continuous query directly re-ranks the gallery at each round, avoiding the information loss of verbalizing all visual details. Training updates clue prompts, a retrieval token, an adapter, and LoRA parameters using per-round image-text contrastive and similarity-distribution-matching losses. Experiments cover Interactive-PEDES, MInterPEDES, and additional standard TIReID datasets.
Critical strengths
-
The proposed continuous retrieval token effectively addresses the information loss caused by verbalizing fine-grained visual details into discrete text. By mapping directly into the CLIP image space, the method elegantly utilizes retrieved candidates as visual evidence in a plug-and-play manner without redundant text encoding.
-
The framework features a well-designed, closed-loop system for multi-round retrieval. It seamlessly integrates continuous visual clues with textual feedback, applies supervision at every interaction step, and supports both chat-based and multimodal interaction formats robustly.
-
The approach is highly parameter-efficient, training only 32.9M parameters while keeping the large vision and language backbones frozen. Furthermore, the paper provides rigorous and comprehensive evaluations across multiple datasets and interaction settings, utilizing trajectory-aware metrics (e.g., BRI) and thorough robustness analyses.
Critical weaknesses
-
According to the introduction, the performance improvement is attributed to how the model "mines intent-aligned visual clues from retrieved candidates." However, Table 1 shows that the performance improvement mainly comes from MLLM query reconstruction and user feedback modeling rather than the proposed VCIR. It would be better to clarify the claim.
-
The proposed method instructs the MLLM to "ignore appearance details in the candidate images that differ from the target person." But current experiments do not directly verify if the model actually filters wrong attributes effectively. Furthermore, regarding the statement that the method avoids "the information loss caused by verbalizing them into discrete text," there is no experimental comparison between the proposed retrieval token and discrete text representations. It would be better to provide a detailed analysis.
Questions for authors
- Appendix C shows that VCIR achieves good results on CUHK-PEDES, ICFG-PEDES, and RSTPReid. However, the compared baselines are limited. It is recommended to include more recent and representative TIReID methods for a fair comparison.
3 comments
Response to the Reviewer cdo5(2/2)
[Q1] VCIR retains the highest mAP across all three datasets with recent baselines included.
Following the reviewer’s suggestion, we expanded the comparison to include HAM [1] and ICL [2] from CVPR 2025, CECA [3] from CVPR 2026, and KPDM [4] from AAAI 2026.
| Method | CUHK-PEDES | ICFG-PEDES | RSTPReid | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| R@1 | R@5 | R@10 | mAP | R@1 | R@5 | R@10 | mAP | R@1 | R@5 | R@10 | mAP | |
| IRRA | 73.38 | 89.93 | 93.71 | 66.10 | 63.46 | 80.25 | 85.82 | 38.06 | 60.20 | 81.30 | 88.20 | 47.17 |
| RDE | 75.94 | 90.14 | 94.12 | 67.56 | 67.68 | 82.47 | 87.36 | 40.06 | 65.35 | 83.95 | 89.90 | 50.88 |
| TBPS-CLIP | 73.54 | 88.19 | 92.35 | 65.38 | 65.05 | 80.34 | 85.47 | 39.83 | 61.95 | 83.55 | 88.75 | 48.26 |
| HAM | 77.71 | 91.42 | 94.57 | 69.68 | 68.24 | 83.30 | 88.15 | 42.30 | 71.69 | 87.85 | 93.30 | 55.19 |
| ICL | 79.06 | 91.26 | 94.72 | 70.44 | 70.05 | 83.35 | 87.91 | 42.70 | 72.55 | 86.60 | 91.30 | 55.19 |
| CECA | 79.65 | 92.35 | 95.27 | 67.07 | 74.32 | 86.33 | 90.00 | 39.56 | 73.45 | 89.80 | 93.45 | 55.44 |
| KPDM | 75.97 | 90.77 | 94.46 | 68.14 | 67.78 | 82.43 | 87.26 | 40.30 | 67.95 | 84.65 | 91.10 | 51.88 |
| VCIR | 85.59 | 94.22 | 96.34 | 79.14 | 69.79 | 81.83 | 86.30 | 45.19 | 76.10 | 89.05 | 92.45 | 61.67 |
VCIR achieves the highest mAP on all three datasets and the highest R@1 on CUHK-PEDES and RSTPReid among the compared methods. CECA achieves higher R@1 on ICFG-PEDES, the Identity-Centric and Fine-Grained Person Description Dataset, which was specifically designed to provide detailed descriptions of identity-related attributes. These detailed initial descriptions leave less scope for additional information through interaction, which can help explain VCIR’s smaller advantage on this dataset. Nevertheless, VCIR achieves 45.19% mAP versus CECA’s 39.56%, demonstrating stronger overall ranking performance. We will update Appendix C with these comparisons and clarify the respective evaluation settings.
We thank the reviewer again for the constructive suggestions, which help us clarify VCIR’s contribution and strengthen the experimental evidence.
[1] Modeling Thousands of Human Annotators for Generalizable Text-to-Image Person Re-identification. CVPR 2025. [2] Human-Centered Interactive Learning via MLLMs for Text-to-Image Person Re-Identification. CVPR 2025. [3] Tackling Alignment Ambiguity in Person Retrieval through Conversational Attribute Mining. CVPR 2026. [4] KPDM: Key Phrase Dynamic Masking for Robust Text-to-Image Person Retrieval. AAAI 2026.
Response to authors
Thank you for the additional clarifications and experiments. These have largely addressed my concerns. I'm willing to keep the score as of 3 (Weak Acceptance).
Response to the Reviewer cdo5(1/2)
We thank the reviewer for recognizing our retrieval token, efficient design, and extensive evaluation. Your suggestions help clarify our contributions and strengthen the evidence. Below, we present additional experiments and corresponding revisions.
[W1] Candidate visual clues provide additional gains beyond MLLM query modeling.
Our claim concerns the additional benefit of extracting visual clues beyond this MLLM baseline, which we will state more clearly.
In Table 1, the baseline already uses the MLLM and accumulated user feedback but receives no candidate images. Compared with this baseline, VCIR improves R@1/mAP/mINP from 77.17%/60.06%/36.29% to 80.08%/70.00%/51.14%, yielding absolute gains of 2.91%/9.94%/14.85%. These gains are particularly pronounced in mAP and mINP, showing that candidate visual clues improve the ranking of relevant images beyond what textual feedback modeling achieves. Moreover, random candidate images yield only 59.91% mAP, compared with 70.00% using retrieved candidates, supporting the importance of relevant visual evidence.
We will revise the introduction to clarify that VCIR “mines intent-aligned visual clues from retrieved candidates to further improve MLLM-based retrieval.”
[W2] VCIR uses feedback effectively under conflicting visual evidence and outperforms explicit descriptions.
We thank the reviewer for identifying these two gaps in the experimental evidence. We address them with a controlled color-conflict experiment and an explicit description baseline.
Conflicting candidate details. We selected 1,318 samples from 1,203 queries in Interactive-PEDES. Each sample contains three non-target candidate images whose specified attribute colors conflict with the user feedback. We compare two settings: before interaction, the model receives the initial description and conflicting candidates; after interaction, it additionally receives a user feedback answer specifying a color inconsistent with all three candidates. Initial retrieval using the frozen pretrained CLIP text encoder provides an additional reference.
With the conflicting candidates unchanged, a single interaction improves R@1/mAP/mINP by 7.36%/5.21%/3.42%, providing behavioral evidence that VCIR uses feedback to improve retrieval despite misleading visual details.
Continuous embeddings versus explicit descriptions. We have added an explicit description baseline that shares VCIR’s model architecture and uses the same MLLM, candidate images, initial description, and user feedback. We modify the final part of the MLLM instruction: "Finally, describe the target person’s appearance in text for text-to-image retrieval." The resulting description is encoded by the pretrained CLIP text encoder. Results on Interactive-PEDES after 5 interaction rounds are reported below.
With the same visual and textual inputs, VCIR improves R@1, mAP, and mINP by 12.66%, 18.23%, and 21.33%, respectively. This comparison supports the advantage of continuous retrieval embeddings over generating explicit descriptions. We will add both experiments and clarify their purposes in Section 4.3.