- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes an observe-and-steer framework to improve the spatial robustness of vision-language-action (VLA) policies without updating their weights. The method trains linear probes to decode a 3D affordance cost from VLA hidden states and uses probe-derived directions to steer internal activations at inference time. It further introduces intervention gating, layer selection, and adaptive strength selection through bisection. Experiments on LIBERO-Object with displaced target objects demonstrate improvements in task success on both OpenVLA (16.6% to 29.5%) and π0.5 (34.5% to 41.1%).
Critical strengths
-
Meaningful connection between representation analysis and control. Rather than merely demonstrating high probing accuracy, the paper uses affordance costs decoded from VLA hidden states to guide actual robot behavior. This connection between representation analysis and closed-loop control is an interesting contribution.
-
Promising experimental improvements. The method improves task success from 16.6% to 29.5% on OpenVLA and from 34.5% to 41.1% on π0.5, with matched evaluation scenarios within each backbone. These results demonstrate practical benefits across two different VLA architectures.
Critical weaknesses
-
Insufficient evidence for affordance-specific steering. Reducing the probe's predicted cost does not necessarily imply that the resulting actions are better. Although the paper shows that interventions change actions, it does not establish that the probe-derived direction is more effective than generic perturbations. Key controls, such as norm-matched random directions and simpler target-distance probes, are missing. This weakens the central claim that the method specifically controls affordance representations.
-
Unclear layer selection and missing critical ablations. The appendix describes how candidate intervention layers are identified, but the final layer choices and selection procedure are not sufficiently documented, particularly whether selection is independent of the OOD test cases. Moreover, the paper does not evaluate probe accuracy under object displacement or isolate the benefits of adaptive bisection over fixed intervention strengths. These omissions make it difficult to attribute the reported improvements to the proposed mechanisms.
Questions for authors
-
Layer selection (clarification). Which intervention layer was ultimately selected for each task? What data and criteria were used for selection, and was the process independent of the OOD evaluation scenes?
-
Steering effectiveness (additional experiments). How does the method perform with norm-matched random perturbation directions or a probe trained using only target distance instead of the full affordance cost field? How much improvement does adaptive bisection provide over a fixed intervention strength?
-
OOD probe validity and behavioral effects (additional analysis). How accurately does the probe predict affordance cost after target objects are displaced? After steering, does the actual geometric affordance cost decrease over subsequent executed steps, rather than only the probe's predicted cost decreasing immediately after intervention?
Thanks to the authors for the detailed rebuttal and additional experiments. Some of my concerns have been addressed, especially the fixed-strength comparison and OOD probe evaluation.
However, I am still concerned about the layer selection, as the authors confirmed that OOD evaluation scenes were used to select the intervention layers. This makes it difficult to judge how well the method generalizes to unseen test cases.
Also, the improvement over random directions on π0.5 is quite small (65.0% vs. 63.3%), and the full affordance cost only slightly outperforms target distance supervision (25.0% vs. 21.7%). These results still leave some doubts about whether the improvement really comes from affordance-specific steering.
Overall, I appreciate the additional efforts, but I will keep my original rating.