- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies image-space shortcuts in VLA policies, where camera changes induce systematic action drift despite unchanged robot–object geometry. Through prompt-conditioned relevance maps and frozen-feature localization probes, it identifies weak visual self-grounding as a potential source of this behavior. It introduces S³-VLA, which mines robot-localization targets from demonstration videos using visual motion and supervises visual representations through an auxiliary self-grounding objective. Evaluations on SimplerEnv, Meta-World, and real-world manipulation show improved task performance, while complementary analyses support the role of visual self-grounding in camera robustness.
Critical strengths
-
The paper addresses a meaningful problem with a compelling motivation. The image-space shortcut perspective provides a clear explanation for an important failure mode of VLA policies. Camera-only perturbations make the problem concrete and naturally motivate using the robot’s visible body as a spatial reference.
-
The self-grounding analyses are insightful and complementary. Real-world relevance maps and simulation-based localization probes provide an informative view of the learned representations. The robot-target attribution audit, matched occlusion controls and action-consistency measurements further support the proposed interpretation. The paper goes beyond success-rate comparisons to investigate what the method changes in depth.
-
The approach is practical and empirically well supported. Motion-derived supervision avoids manual robot annotations and camera calibration, while the auxiliary grounding head is used only during training. Experiments across two VLA backbones, multiple simulated embodiments and real-world tasks demonstrate the approach’s utility. The state-prediction controls and localization-target comparison provide additional support for the design.
-
The paper is clearly written and well organized. The progression from identifying image-space shortcuts to probing self-grounding, designing auxiliary supervision and evaluating its effects is coherent and easy to follow.
Critical weaknesses
-
Several implementation details need clarification. Appendix B provides the main target-mining equations, but does not fully specify the robust-normalization procedure, motion-support selection, or Gaussian-uncertainty estimation. The grounding head’s query count and decoder configuration should also be reported for reproducibility.
-
The normalization ablation changes multiple components. The Gaussian CE comparison changes both target construction and loss scaling relative to normalized KL. Although Appendix E.4 provides useful qualitative analysis, a comparison using identical targets would better isolate the contribution of normalization.
-
The Meta-World comparison would benefit from a matched continuation baseline. The paper reports 1,000 additional fine-tuning steps for S³-VLA, but does not report a corresponding action-only continuation from the same π₀.₅ checkpoint. This control would help isolate SGA’s contribution to the Meta-World improvement.
Questions for authors
-
Could you specify how robust normalization, motion-support selection and Gaussian-uncertainty estimation are implemented, together with the grounding head’s query count and decoder configuration?
-
Could you compare normalized and unnormalized KL using identical localization targets and appropriately tuned auxiliary-loss weights, while keeping the other training settings fixed?
-
Could you report an action-only π₀.₅ baseline continued from the same checkpoint for 1,000 steps, using the same Meta-World data and optimization settings as S³-VLA?
Dear Reviewer,
Thank you again for your careful review and constructive suggestions. We sincerely appreciate the time and effort you have devoted to evaluating our work!
As the discussion period draws to a close, we would be grateful to hear whether our rebuttal has addressed your concerns. Please do not hesitate to let us know if there is anything we can clarify:)
Best regards,
The Authors