- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies whether visual information in VLMs is transferred into text hidden states, rather than only being used to compute the current answer. The authors use answer-matched image pairs and activation patching to test whether text states contain information about unasked objects. They also examine how visual and text states influence the generated answer and how model performance changes when these states are zeroed out. The results suggest that text states can carry visual information beyond the current answer. However, this does not necessarily mean that visual tokens can be safely removed or that the model can use this information to answer new questions.
Critical strengths
-
The paper addresses an interesting question by distinguishing visual information transfer from simply computing the current answer. It also makes a useful distinction between content transfer, answer control, and visual token removal.
-
The answer-matched donor patching experiment is well motivated. By keeping the question and answer fixed while changing other objects in the image, it provides evidence that text states contain information beyond the current answer. The results across multiple models and additional controls strengthen this finding.
-
The paper also reports negative results, such as the reversed recovery order on TextVQA and the failure of the second-question experiment. These results help clarify the limitations of visual-to-text transfer.
Critical weaknesses
-
In [1], they have already studied cross-modal information flow, while [2] showed that query tokens can carry image information. The answer-matched donor experiment provides additional evidence, but the paper does not offer much new understanding of how this transfer happens.
-
The main experiment focuses on object presence using COCO annotations and a trained probe. This shows that some object information can be decoded from text states, but it is unclear how much other visual information is retained. The second-question experiment also shows that the VLM cannot easily use this information to answer new questions.
-
Visual and text tokens have different attention contexts, so the stronger effect of text patching may partly come from their positions rather than information transfer alone. The authors discuss this issue, but it still limits the interpretation of the carrier handoff.
[1] Zhang, Z., Yadav, S., Han, F., and Shutova, E. (2025). Cross-modal Information Flow in Multimodal Large Language Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 19781–19791. https://openaccess.thecvf.com/content/CVPR2025/html/Zhang_Cross-modal_Information_Flow_in_Multimodal_Large_Language_Models_CVPR_2025_paper.html
[2] Kaduri, O., Bagon, S., and Dekel, T. (2025). What's in the Image? A Deep-Dive into the Vision of Vision Language Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14549–14558. https://openaccess.thecvf.com/content/CVPR2025/html/Kaduri_Whats_in_the_Image_A_Deep-Dive_into_the_Vision_of_CVPR_2025_paper.html
Questions for authors
-
In the donor patching experiment, the late-patched text states are read immediately after the same block. Would the target-specific information still be preserved if the readout were taken several layers later?
-
Compared with [1] and [2], what do the authors consider the main new insight of this work beyond providing additional evidence for visual-to-text information transfer?
-
[2] showed that query tokens can support image description without direct access to visual tokens. However, the second-question experiment in this paper largely fails. What do the authors think causes this difference? How should we understand the gap between information being decodable by a probe and being usable by the VLM itself?
[1] Zhang, Z., Yadav, S., Han, F., and Shutova, E. (2025). Cross-modal Information Flow in Multimodal Large Language Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 19781–19791. https://openaccess.thecvf.com/content/CVPR2025/html/Zhang_Cross-modal_Information_Flow_in_Multimodal_Large_Language_Models_CVPR_2025_paper.html
[2] Kaduri, O., Bagon, S., and Dekel, T. (2025). What's in the Image? A Deep-Dive into the Vision of Vision Language Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14549–14558. https://openaccess.thecvf.com/content/CVPR2025/html/Kaduri_Whats_in_the_Image_A_Deep-Dive_into_the_Vision_of_CVPR_2025_paper.html