- Rating
- 2
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates how visual and linguistic information influences action generation in three vision-language-action models. It uses activation patching with counterfactual changes to object identity and scene layout to study representations within the VLM backbone and conditioning at the VLM–action-expert interface. The authors observe different intervention effects across token positions and layers, and identify a narrow band of interfaces with relatively strong influence on predicted trajectories.
Critical strengths
-
The connection between mechanistic analysis and architectural simplification is valuable. The paper goes beyond reporting intervention effects and evaluates whether the identified interfaces support more efficient policies in complete closed-loop tasks.
-
The counterfactual design is useful for interpreting behavioral changes. Varying object identity and location helps distinguish transferable object-selection effects from spatially specific effects more carefully than changing the instruction in a fixed scene alone. Studying three architectures also reveals how attention masks affect where instruction-dependent information can appear.
Critical weaknesses
-
The additional insight from early-layer noun patching is not sufficiently established. Replacing an early representation of "apple" with that of "banana" may behave similarly to modifying the instruction internally, after which downstream computation locates the requested object in the recipient scene. Because backbone patching changes all subsequent computation, successful transfer establishes behavioral influence but does not directly identify where object selection is computed. The cross-layout result is informative, but comparisons with direct instruction changes or input-embedding replacement would help establish what additional insight the layer-wise analysis provides. Although the paper acknowledges limitations of information localization, it remains unclear how much the depth-dependent effects reflect changes in the representations themselves versus differences in how downstream computation propagates or uses the patched signal.
-
Activation patching is an established technique, and the paper itself discusses prior work applying activation interventions and attention knockout to VLAs. The contribution therefore rests primarily on the new mechanistic insights obtained through these tools and their value for architectural design. However, some findings, such as early noun representations influencing object selection through downstream computation, appear largely expected. Although the empirical evaluation is substantial and the measured efficiency gains are useful, I remain unconvinced that the paper establishes a sufficiently strong conceptual advance beyond applying existing interpretability tools to motivate a sparse interface.
Questions for authors
see weaknesses
3 comments
What is the contribution beyond prior work ?
“I remain unconvinced that the paper establishes a sufficiently strong conceptual advance beyond applying existing interpretability tools to motivate a sparse interface.“
We respectfully disagree that the paper only applies existing tools to motivate a sparse interface. While activation patching is an existing tool, the insights we glean from it significantly improve on the understanding of VLA models, while also demonstrating compelling efficiency improvements.
Prior causal work on VLAs is limited. Prior work shows that individual representations can be steered or knocked out. However this work does not localize where the action expert reads the VLM backbone, what information is exchanged or how that information forms and flows through the network. We provide an expanded selection of exciting novel contributions of our paper:
- The action-conditioning interface (Section 2). In three VLAs with different architectures and conditioning mechanisms, the action expert reads the VLM backbone through a small number of mid to late layers. The transmitted information is the target location (Section 4.2).
- How that information forms (Section 4). We agree that the early noun patching selecting the object is expected. However we find significantly more surprising phenomena in the later representations.
-The noun’s causal role collapses from E ≈ 1 to near zero by layer 15 in MolmoAct2, 14 in MolmoBot and 7 in π0.5, after which the target object location is carried in later text representations.
- Scene layout is read mainly from one camera: the exterior camera in MolmoAct2, the wrist camera in π0.5 and MolmoBot.
- The target location sits in very few tokens. In MolmoAct2, four tokens retain 89% of the all-text effect at layer 18 (Figure 7).
- π0.5’s bidirectional attention writes the target object location into image tokens, which the Molmo models cannot do.
- We leverage this understanding to create improved models (Section 3). Keeping only the action-conditioning-interface reduces MolmoBot’s computation and latency by 33% without reducing success rate. We find the same principle carries over to Pi0.5 on a real robot and actually leads to a significant improvement in completion time.
It also justifies existing VLA designs and makes predictions for improvements. Two existing VLA models, GR00T N1 and SmolVLA utilize slightly different architecture, conditioning on a single mid-layer and on the first half of its layers respectively. Both choices were made heuristically. Our experimental findings explain why conditioning on intermediate layers works. It also shows that neither of these VLAs are an optimal. To improve performance SmolVLA could likely drop its early backbone connections while GR00T N1 would likely gain performance from conditioning on a few layers around the action conditioning interface instead of one.
The paper gives the first account of the path from perception to action in VLAs. We show clearly that this information is useful towards improved architecture designs. The localization of relevant information across tokens and layers provides a guide for further interpretability studies on specific parts of the model.
Thanks for authors detailed response. I will increase my score.
We thank the reviewer for their thoughtful review and feedback. We address the weaknesses and questions below.
Comparison with direct instruction change
We agree that patching the noun at the earliest layers is equivalent to changing the instruction. In fact we already include the baseline you suggest. E is measured against the trajectory produced by directly changing the instruction, and patching the noun at layer 0 gives E = 1.00 in all three models.
The interesting question is what happens as the input representations are transformed with depth. What type information they carry (semantic, visual or geometric), and whether it is causally relevant to the action. While the patching effect at layer 0 is expected, patching internal representations across our counterfactual scenes produced several findings were unexpected and which significantly advanced our understanding of VLA models:
We added an additional mediation experiment to test this directly (Appendix B.4). We patch the noun at layer 0 while holding the later text positions at their original values. In MolmoAct2 and MolmoBot the patching effect unsurprisingly disappears (E = 1.00 → 0.00 and 0.03). Copying only those downstream positions into an otherwise original run (other tokens held constant) reproduces the patching effect. This establishes that object selection is not computed at the noun itself. The noun passes the requested object to later text positions (or unused image tokens in the case of Pi0.5). After this depth (layer 16 in MolmoAct2, 10 in MolmoBot and 8 in Pi0.5) the action depends only on those later text positions.