- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a training-free diffusion prior-driven pseudo target extraction method for zero-shot composed image retrieval. The key motivation of this work is that existing method Paracosm explicitly generates a pseudo target image and re-encoding it with the CLIP image encoder to derive the target embedding. The authors argue that this incur substantial computational overhead. Overall, the motivation is reasonable. The proposed method takes advantage of diffusion-prior with Kandinsky model. Extensive experiments have been conducted on three public datasets. The proposed method cannot outperform Paracosm regarding R@10 and R@50, but it is more efficient than Paracosm.
My major concerns are listed as follows.
-
The authors did not explain why they adopt Kandinsky? Any other options? The authors should provide more experiment results on this choice.
-
Based experiment results in Table 1 and Table 2 as well as the efficiency comparison in Figure 1(b), the proposed method is not more efficient and effective than STiTch. Although Figure 1(b) shows that StiTch performs worse than PPT, this may be due to the dataset choice. On the other datasets, PPT cannot outperform StiTch.
-
Analysis of miu only takes one value miu=0. The sensitive analysis of this hyperparameter is needed.
-
The authors did not explain why the results of Paracosm on FashionIQ is missing. The original paper of Paracosm gives this results. By checking the results on original paper, the proposed method also cannot outperform Paracosm on this benchmark.
Critical strengths
The motivation is clear and good.
Critical weaknesses
-
The authors did not explain why they adopt Kandinsky? Any other options? The authors should provide more experiment results on this choice.
-
Based experiment results in Table 1 and Table 2 as well as the efficiency comparison in Figure 1(b), the proposed method is not more efficient and effective than STiTch. Although Figure 1(b) shows that StiTch performs worse than PPT, this may be due to the dataset choice. On the other datasets, PPT cannot outperform StiTch.
Questions for authors
none