- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces JOLT, a joint text–image search framework designed to disrupt the grounding process in multimodal models with observable intermediate localization outputs. JOLT exploits the localization feedback exposed by the model to iteratively modify both the input question and the image, aiming to shift the predicted grounding regions and ultimately reduce answer accuracy. Experiments on six Visual-CoT dataset subsets show that JOLT reduces average answer accuracy from 70.2% to 29.0%, outperforming several baseline search strategies. The paper addresses an interesting problem at the intersection of multimodal robustness and agentic interaction with intermediate model outputs. However, the current evaluation does not sufficiently isolate the contributions of question modification, image perturbation, and their interaction, nor does it establish that the observed degradation is primarily caused by disrupting the grounding process rather than changing the effective task. These limitations weaken the evidence for the paper’s central insight and restrict the generalizability of its conclusions.
Critical strengths
- An interesting and potentially important research question. The paper investigates whether observable intermediate localization outputs can become an attack surface in multimodal systems. Rather than focusing solely on perturbing the final input–output mapping, it considers how feedback from intermediate states can be exploited to guide an iterative attack. This is a meaningful direction for understanding the robustness of multimodal systems that expose intermediate predictions.
- A unified framework for jointly optimizing text and image inputs. JOLT formulates the attack as a joint search problem, using localization feedback to guide modifications to both the question and the image. The framework offers a systematic way to investigate interactions between textual and visual inputs rather than treating them as independent attack channels.
- Empirical evidence that feedback-guided search can degrade task performance. The experiments show substantial reductions in answer accuracy compared with clean inputs and several baseline search strategies. The paper also includes cross-model experiments and analyses relating localization displacement to answer accuracy, providing initial evidence that the proposed approach can affect downstream model behavior.
Critical weaknesses
- Insufficient evidence that the attack preserves the original task semantics. This is the most important concern. JOLT jointly modifies the question and the image, but the paper does not adequately disentangle the effects of these two components. In particular, it remains unclear whether the accuracy degradation is caused by disruption of the grounding process or by changes to the original task introduced through question rewriting and image perturbation. The perplexity and embedding-similarity analyses are insufficient to establish semantic preservation: linguistic fluency and embedding similarity do not guarantee that the relevant entities, attributes, relations, or answer conditions remain unchanged. The paper should include controlled ablations that separately evaluate question rewriting, image perturbation, and their joint effect, ideally supplemented by human verification of task preservation.
- The central mechanism and its causal contribution are not sufficiently established. JOLT optimizes geometric differences between predicted and reference bounding boxes, whereas its ultimate objective is to induce incorrect answers. These objectives are not equivalent. The paper's own results indicate that substantial localization disruption does not necessarily lead to incorrect answers, and that incorrect answers can occur even when localization remains relatively accurate. Consequently, the experiments demonstrate that grounding feedback can guide a search procedure that degrades answer accuracy, but they do not fully establish that disruption of the intermediate grounding state is the primary cause of the degradation. Further analysis is needed to connect changes in localization to downstream answer failures and to determine whether the proposed intermediate-state attack mechanism provides benefits beyond those of ordinary input perturbations.
- Limited evaluation scope weakens the generality of the conclusions. The main experiments focus on one Visual-CoT model and six related dataset subsets. The additional experiments cover a small number of other models and use different datasets and sample sizes. This provides preliminary evidence of transferability but is insufficient to establish that the vulnerability generalizes broadly across contemporary multimodal models and reasoning settings. Evaluation on more recent models and more diverse benchmarks would strengthen the paper. It would also be important to distinguish models that expose explicit localization outputs from those that do not, since the proposed attack depends on access to such intermediate feedback.
Questions for authors
See the weaknesses.