- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ROTA, a training-free framework for multimodal retrieval under adversarial image perturbations. The method selects transformed image views using retrieval entropy, reconstructs the query representation, augments candidate texts with descriptive views, and applies entropy-weighted optimal transport for retrieval scoring. Experiments cover standard and composed retrieval benchmarks, multiple embedding backbones, and several attack methods. The paper also provides a conditional stability analysis for the OT score.
Critical strengths
A practical framework with substantial reported improvements. ROTA operates without updating model parameters and substantially improves attacked retrieval performance over direct retrieval and the evaluated aggregation baselines. The results across different datasets and backbones suggest that the approach has potential beyond a single retrieval configuration.
Useful component and efficiency analyses. The ablations provide evidence that both query reconstruction and transport matching contribute beyond basic view aggregation. The runtime comparison and large-gallery reranking experiment also help assess the practical trade-off between retrieval performance and computational cost.
Critical weaknesses
Robustness against attacks targeting the complete defense is not sufficiently established. The main attacks optimize the backbone retrieval objective rather than explicitly targeting ROTA’s final ranking. The supplementary EOT/BPDA experiment is a useful addition, but its description emphasizes attacks on original and augmented representations without clearly establishing whether the complete selection, reconstruction, weighting, and OT scoring pipeline is attacked. The limited attack configuration and lack of convergence evidence leave uncertainty about the strength of the evaluation. Since adversarial robustness is the central claim, this distinction materially affects the interpretation of the reported gains.
The distinctive contribution over closely related view-based methods needs stronger validation. The paper builds on established augmentation, confidence weighting, text enrichment, and transport matching ideas, and explicitly identifies AWT as closely related. However, a direct comparison with AWT or a carefully adapted counterpart is missing. Although the component ablations are informative, comparisons with simpler confidence-weighted similarity aggregation using identical views would better establish the specific value of transport alignment. The theoretical result concerns fixed views and transport marginals, so it provides limited support for the stability of the adaptive pipeline itself.
Questions for authors
- Does the adaptive attack directly optimize ROTA’s final retrieval scores, including its view selection, reconstruction, entropy weighting, and transport matching? Please clarify which components are differentiated through or approximated.
- Do the improvements persist under stronger adaptive optimization with additional iterations, restarts, and stochastic samples? Please report the worst performance across the evaluated attacks rather than considering each attack independently.
- How does ROTA compare with an adapted AWT baseline and confidence-weighted similarity aggregation when all methods use the same image views, text descriptions, and computational budget?
- For composed retrieval, are image-conditioned text descriptions generated from the attacked visual input? Please clarify the information available to the defense and whether query-dependent description generation is included in the reported computational cost.