- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies semantic transition learning and objective conflicts in zero-shot composed image retrieval (ZS-CIR) and proposes the DeCIR framework. The authors use LLM-generated forward and backward edit instructions to separately learn target endpoint alignment and semantic transformation through a dual-branch design, and then merge the two branches into a single adapter via low-rank directions. Experiments on CIRR, CIRCO, FashionIQ, and GeneCIS demonstrate the effectiveness of the proposed method without requiring LLM calls during inference.
Critical strengths
- The motivation is clear and reasonable.
- The experimental evaluation is relatively comprehensive, covering four benchmarks, two backbones, and relevant ablation studies.
- The method is deployment-friendly, requiring only a single retrieval path during inference.
Critical weaknesses
- The proposed method aims to mitigate endpoint shortcuts, but the current experiments mainly rely on retrieval performance and qualitative examples. More direct evidence is needed to demonstrate that the improvements come from better preservation of source image information.
- The contribution of LRDM is not sufficiently isolated, as the comparison with Task Arithmetic involves differences in both parameter sharing during training and the merging strategy. Therefore, the effectiveness of the proposed merging mechanism is not fully validated.
- Although the paper reports results averaged over three runs, standard deviations or confidence intervals are missing from the main comparisons. Given the relatively small gains in some settings, further statistical analysis is needed to establish their significance.
Questions for authors
- Further evaluation with hard negatives that satisfy the modification text but violate the reference image constraints is suggested to verify whether the proposed method better preserves reference image information.
- Comparisons that separately isolate the effects of the shared basis, asymmetric updates, and merging strategy under identical training settings are suggested to better validate their individual contributions.
- Standard deviations or confidence intervals should be reported for the main results and ablation studies to better assess the statistical reliability of the reported improvements.
Response to Reviewer VbRg
We thank the reviewer for the constructive feedback. We address the concerns below.
W1 / Q1: Direct evidence of source-constraint preservation with hard negatives
We directly evaluate the hard negatives suggested by the reviewer using the GeneCIS Change Attribute task. Each query contains 15 candidate images, including nine distractors that satisfy the requested attribute but violate the reference image's object-category constraint.
For each Top-K cutoff, we identify queries where DeCIR retrieves the correct target but endpoint-only fails. Among these queries, we count those where DeCIR reverses the ranking of at least one hard negative that was previously ranked above the correct target.
These results provide direct evidence of improved source-category preservation. Among the queries recovered by DeCIR, 62.7% at Top-5 and 83.3% at Top-10 include a corrected ranking against at least one attribute-matching, category-mismatched hard negative. We will add this label-based analysis and its evaluation protocol to the appendix.
W2 / Q2: Isolating the contributions of LRDM
We conduct a controlled ablation to examine basis sharing and asymmetric updates under identical training settings:
Asymmetric updates are critical to effective shared-basis merging. Under the same shared basis and merging rule, restricting B updates to endpoint alignment improves CIRR Rs@1 from 64.27 to 66.08 and CIRCO mAP@50 from 26.77 to 27.26. These results demonstrate the effectiveness of LRDM's shared-basis parameterization and asymmetric optimization. We will incorporate this ablation and clarify the contributions of each component in Section 3.4.
W3 / Q3: Statistical reliability
We report mean ± standard deviation over three independent training runs on the CIRR and CIRCO validation sets. DeCIR achieves 66.08 ± 0.12 CIRR Rs@1 and 27.26 ± 0.23 CIRCO mAP@50, outperforming endpoint-only training (64.46 ± 0.18 / 24.92 ± 0.21) and joint training (61.09 ± 0.23 / 21.93 ± 0.34).