- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies training-free zero-shot composed image retrieval, focusing on comparative modification instructions whose intended target appearance depends on the reference image and is therefore difficult to express as a standalone target description. ITR-CIR first uses an image editing model to generate a visual target hypothesis. It then provides the reference image, modification instruction, and generated image to a multimodal large language model to produce target captions, while prompting the model to disregard editing errors. The final ranking combines retrieval scores from the target captions, generated image, and original query composition using fixed weights. Experiments cover CIRR, FashionIQ, and CIRCO, including semantic-aspect analysis, component ablations, alternative model configurations, and qualitative examples.
Critical strengths
-
A useful diagnosis of comparative instructions. The semantic-aspect statistics establish the practical relevance of comparative instructions, and the paper evaluates different prompting approaches on comparative and other queries using a shared retrieval backbone. Appendix A also validates the automatic auditor against official CIRCO annotations, achieving an F1 score of 87.5 for comparative statements. These results provide empirical support for the motivation.
-
Meaningful improvements over the included baselines. On FashionIQ, average R@10 improves from OSrCIR’s 32.34 to 39.18 with ViT-B/32 and from 33.26 to 39.17 with ViT-L/14. Together with experiments across retrieval backbones and alternative model configurations, these results suggest practical potential for using generated images to assist target-caption generation.
Critical weaknesses
-
Limited advance over the closest prior work. The analysis of comparative instructions is useful, but the added value of the method remains unclear. WISER already handles different modification intents through verification and adaptive fusion, and Paracosm already generates an image before describing it. WISER is mentioned but omitted from the quantitative comparisons. The paper does not establish what its focus on comparative instructions adds over WISER in accuracy or cost.
-
Insufficient validation of the core design. Table 3 varies the fusion branches, while Table 4 tests ITR only in caption-only retrieval. Neither measures the effect of hypothesis-conditioned captions in the full system with the generated images and other branches held fixed. Simply captioning the generated image is also missing as a baseline. ITR-CIR still uses fixed weights to fuse retrieval scores, without accounting for differences in branch reliability across queries, a limitation already discussed by WISER. Finally, Tables 3 and 4 report caption-only CIRCO mAP@5 scores of 29.88 and 25.29, respectively, without explaining the difference.
Questions for authors
-
How does ITR-CIR compare with WISER and Paracosm when using the same generation/reasoning models? Results on comparative and non-comparative queries would help clarify where the proposed design adds value. If the main benefit is efficiency, please include measured query latency, GPU memory usage, and gallery preprocessing costs.
-
How does full-system retrieval compare when target captions are generated without the visual target hypothesis, by simply describing it, or using ITR?
-
Why does caption-only retrieval on CIRCO yield 29.88 mAP@5 in Table 3 but 25.29 in Table 4? Please clarify the settings and report both results under the same configuration.