- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates supervised composed image retrieval in the presence of noisy triplet correspondence. The authors propose Flow-CIR, which categorizes training triplets into "reliable" and "suspicious" groups based on query-target similarity. It utilizes reliable triplets to learn a conditional vector field that generates pseudo-target features for suspicious triplets, subsequently performing soft fusion between these generated features and the observed target features. This method applies feature rectification solely during the training phase, while adhering to the standard retrieval pipeline during inference. The authors conducted experiments on the FashionIQ and CIRR datasets using varying levels of synthetic noise and report results regarding component ablation, parameter sensitivity, and qualitative analysis.
Critical strengths
- To address the issue in noisy triplet supervision where "suspicious samples may still contain some useful semantic information," Flow-CIR proposes an active feature correction approach rather than simply discarding or down-weighting such samples; the motivation behind this is quite clear.
- The method performs feature rectification during the training phase and introduces no additional modules or computational steps during inference. The authors conducted experiments across various noise levels and provided component ablation studies as well as parameter sensitivity analyses.
Critical weaknesses
- The fidelity score derived from Equation (6) in the paper evaluates to zero when the normalized similarity is either 0 or 1. Consequently, a sample with the highest query-target similarity could receive the lowest fidelity score and be flagged by the model as a "suspicious sample." This contradicts the paper's explanation that "low similarity implies lower reliability." The authors need to clarify whether the actual implementation aligns with the formula used to calculate the fidelity score.
- The paper specifies the synthetic noise ratio but does not explain how the hyperparameter is selected or whether it is related to . Since determines the number of samples undergoing rectification in each batch, this information is crucial for reproducing the experiments and interpreting the results.
Questions for authors
- Was Equation (6) implemented exactly as presented in the paper? If not, please specify the formula actually used and the corresponding code.
- Please specify the exact value and selection method for , as well as its relationship with the noise ratio .