- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The authors are trying to understand at what point information in the network of an LLM effects its answer by replacing internal states taken during answering with states from a model processing the same image. They find that copying hidden states associated that are associated with the question text can correct errors even when copying information from the strongly attended image region does not help. They test across several different modifications of the original image, such as color, and against random replacements.
Critical strengths
- Compared to other prior work I have seen, they provide more ablations (such as the text length, multiple choice, different types of transfer) on which specific states contain the correct information and can causally effect the answer.
Critical weaknesses
- The writing is unclear and extremely difficult to follow, so much so that is obscures the point of the paper
- The abstract is confusing and non-specific; it doesn't define terms such as "spatial grounding" (L13), spatial pointer (L16), and the graph and its parameters of S, W, C, R (L22), etc. It is very difficult to understand the contribution here and this must be entirely rewritten.
- The introduction writing is disjointed and sounds very LLM-like; many details are introduced and not explained, but they are vital to understanding it's flow. This in itself is not a disqualifier, but I find it very difficult to understand ("can look at... and still give the wrong answer" (L39); "Spatial attention, probing... establish where a fact is. A causal... changes the output." (L45-46, "the carrier’s content tracks the donor. " (L93); "Restoration establishes that a state.. and semantic interchange establishes which content a state actually carries" (L85)). Jargon is made up and not explained well )(e.g.,"donor", "carrier" are barely defined on L52-78).
- Nonsense sentences in the main body (e.g., "Attention maps and activation patches each expose one facet of a VLM’s visual computation, but neither certifies the path this paper follows" (L148): what do you mean by certify the path that this paper follows?)
- The statements in the experimental setup are not well defined and are also opaque. E.g: "A deterministic 200-pair diagnostic set changes one answer-determining visual fact while preserving the remaining layout and prompt" (L254)- I do not know what this means
- I found it incredibly difficult to understand what the experiments were actually testing
- The analysis lacks substantial insight
- For instance, what is the takeaway? Salazar et al. (Pathways of Visual Information Flow in Vision-Language Models) already have similar findings about...
- While the paper does appear to have more controls than prior work, I don't see them motivated or unified anywhere (e.g., they test the changing the answer format. Was there reason to believe this would be significantly different? or which attributes transfer well. They find that color does not(L464–466) but do not adequately explore why this is)
- In general, the paper appears to be more of an assortment of semi-related results than a unified narrative.
Questions for authors
- Are the photos actually matched, and if so, how do you source these photos with only a single difference? (Are they edited?) Or are they just extremely similar photos, but the one attribute is not the only difference?
- There is a lot of related work you did not contextualize or mention, such as "The Narrow Gate: Localized Image-Text Communication in Native Multimodal Models" (serra et al, 2025) and "Linear Mechanisms for Spatiotemporal Reasoning in Vision Language Models" (Kang et al) that seem to do materially similar things to your work- what is the difference?
- Can you describe in more detail how you transplant the states? Is it the activations, and at what point? I assume it is the activation stream after some layer, but I think it would be helpful if this was defined precisely.
- What exactly is Figure 1 trying to show? On the left, is the spatial pointer still referring to the same image as the mug with the cat? What are the dotted diagrams in the middle in a, b and c? Do they represent token positions?