- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper presents an adversarial attack for RAG-based systems in the Remote Sensing domain. They introduce a method of generating plausible clouds and haze in remote-sensing imagery that trips the retriever component to shift towards more weather-related context, thus shifting also the answers in the same direction. The method consists of an optimization over several parameters that control clouds and haze appearance, and is validated via comparison with un-optimized version or more simplistic noise.
Critical strengths
None
Critical weaknesses
- The plausibility of the generated weather artifacts is not supported. On the contrary, in the appendix E2 they show 21 out of 30 humans correctly judged a modified image as being digitally altered.
- The introduced attack does not produce an unintended effect. The attack introduces weather patterns, and the retriever shifts towards weather documents. Same for the generator. The attack would be consequential if we could use the method to elicit information that contradicts conditions on the ground.
- The RAG setup is forced. Usually RAG is used to inject external knowledge that could help answer the user query. Here, in all 7 datasets used for evaluation, all the data needed for the answer is supplied by the user: the image. It is not clear how adding other items from the same dataset can improve the downstream generation, because queries always target the associated image. Furthermore, the retrieved evidence (Eq 3) does not depend on the query, only on the image (i.e. the same context is retrieved regardless of the user asking about land cover or disaster mapping). This further limits the formulation as RAG.
Questions for authors
- Can you please clarify the W@5 metric and what role it has? Is it a coincidence that on Sample100 top W@5 corresponds to 303 / 700? Is that how Sample303 dataset was constructed?
- Are there cases where the response or the retrieved context is actually adversarial, not just weather-related ?