- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies the more practical unsupervised domain adaptation settings of text-based human retrieval (TBPR), in which the source domain provides paired image-text supervision, while the target domain only contains unmarked images without any human written description. In order to solve the missing target domain text pattern and visual domain transfer, the author proposed STaG, which consists of two components: style-unknown text alignment (SATA) and heterogeneous image memory alignment (HGMA). SATA uses frozen MLLM to generate pseudo-descriptions for source images and target images, and uses descriptions written by source humans to encourage cross-modal representation with unchanged styles. HGMA maintains source image, source text and target image memory, and aggregates cross-domain and intra-domain neighbors to improve target representation, as well as residual gate and confidence perception entropy regularizer. Experiments on CUTR-PEDES, ICFG-PEDES and RSTPReid show that STaG achieves state-of-the-art performance across three benchmarks under this realistic setting
Critical strengths
- The paper studies a meaningful human-annotation-free UDA setting for TBPR, requiring only unlabeled target images.
- SATA and HGMA address complementary challenges of missing cross-modal supervision and visual domain shift.
- The method is evaluated across multiple datasets, transfer settings, backbones, ablations, and robustness analyses.
Critical weaknesses
- The adaptation protocol is insufficiently clarified. It is unclear whether only the target training split is used during adaptation and whether target annotations are involved in hyperparameter or checkpoint selection, which may weaken the human-annotation-free claim.
- Some methodological formulations are not fully rigorous. The SATA objective is inconsistent with the batch-based InfoNCE definition, and several details of HGMA, such as neighborhood definition, residual gating, and CAE, require clearer mathematical justification.
- The claimed mechanisms are not always fully supported by the evidence. In particular, the “style-agnostic” property of SATA and the “confidence-aware” behavior of CAE are only indirectly validated, and several conclusions appear stronger than the corresponding ablation gains.
- Experimental rigor could be improved. The paper does not report multi-run statistics, while some improvements are small; several control experiments also do not completely isolate the intended factors.
- Reproducibility and presentation details remain incomplete. Some hyperparameters, backbone integration details, and training procedures are under-specified, and a few numerical and figure inconsistencies should be corrected.
Questions for authors
- Target-domain protocol: During adaptation, do you use only the target-domain training split, or are validation/test images also involved in pseudo-text generation or training? Are any target-domain annotations used for hyperparameter or checkpoint selection?
- SATA optimization: How is Eq. (5) implemented in practice given that InfoNCE is defined over a mini-batch? When a source image has both a human-written description and a pseudo-description, are these treated as multiple positives, or can they become negatives to each other?
- HGMA training mechanism: Is the HGMA-refined target feature directly used in the target-domain contrastive objective? If HGMA is removed at inference, how is the information learned through graph aggregation transferred back to the retrieval backbone?
- Statistical reliability: Some ablation gains, particularly those from the residual gate and CAE, are relatively small. Could the authors provide results over multiple random seeds or otherwise clarify whether these improvements are larger than normal training variance?