- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates when vision-language models (VLMs) still need to access an image while generating answers and how this dependence changes as relevant visual information becomes available. The authors use attention knockout to block direct access to image tokens at different stages of processing, while preserving previously computed internal states. The paper suggests that both previously acquired visual information and the content of generated reasoning influence when direct image access is needed.
Critical strengths
The paper addresses an interesting and important question about how VLMs use visual information during reasoning. I appreciate its careful experimental design, which uses several complementary interventions rather than relying only on attention scores. I particularly liked the finding that even with identical generated text, the model's dependence on direct image access can differ depending on whether it had access to the image earlier.
Critical weaknesses
My main concern is whether the experiments provide a sufficiently clear explanation of how visual information is retained and used inside the model. Attention knockout blocks direct access to image tokens, but it does not remove visual information already stored in the previously computed hidden states. Therefore, a model that continues to answer correctly after knockout may still be relying on visual information acquired earlier. Although the authors acknowledge this limitation, the experiments do not directly identify what information is retained in these internal states or how it contributes to the answer.
Questions for authors
How can you distinguish whether reduced image dependence is caused by the model expressing the required visual information in text, or simply by the model having already processed enough information to determine its answer?
The attention-knockout experiments preserve previously computed hidden states, which may already contain substantial visual information. Have the authors considered using activation patching or contrastive hidden-state analysis to investigate what visual information is retained in these states? For example, comparing and selectively replacing question-token representations obtained with and without image access could help identify whether the model has already encoded the required visual attributes or computed the answer before generation. Such an analysis might provide a stronger mechanistic explanation for why direct image access becomes less important at certain stages.
Discussion phase will end on Nov 18
Dear Reviewers,
This is a kind reminder that discussion phase will end on Nov. 18. As the authors have provided the rebuttal, could you please check authors' rebuttal and update your thoughts? Your early feedback would make the discussion more smooth and informative.
Thank you.
AC