- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes R2G-VLA, an inference-time grounding correction framework designed to improve the robustness of frozen Vision-Language-Action (VLA) policies under physical scene perturbations. The method estimates visual-token grounding risk by propagating action prediction uncertainty to intermediate visual representations and aggregates high-risk tokens into spatially connected regions. It then applies semantic role-dependent corrections to different visual regions, including targets, receivers, support surfaces, backgrounds, and distractors. The modified representations are processed through a second forward pass, and a safety gate determines whether to accept the corrected action.
Critical strengths
- The paper addresses the robustness of frozen VLA policies under physical scene perturbations. The proposed framework performs inference-time correction without modifying model parameters or input observations, providing an alternative to robustness methods that require additional training or policy adaptation.
- The paper evaluates multiple perturbation types and examines the contributions of individual components. The experiments cover target displacement, receiver displacement, relational changes, viewpoint shifts, and distractors. The ablation studies examine risk localization, connected-region aggregation, role-aware correction, and safety-gated inference.
Critical weaknesses
- The proposed method mainly combines gradient-based attribution, connected-region selection, role-dependent feature scaling, and uncertainty-based gating. These techniques are closely related to existing interpretability and token intervention methods. The paper should clarify its methodological novelty beyond integrating established components into VLA inference.
- All experiments are conducted using a single VLA architecture, OpenVLA, on the LIBERO-Spatial benchmark. It remains unclear whether the proposed approach generalizes to other VLA architectures, robotic tasks, or real-world environments. Broader evaluations are needed to support its applicability to general VLA policies.
- The paper primarily compares against frozen OpenVLA and a RobustVLA-style training baseline, rather than existing inference-time approaches such as BYOVLA and DTP. Since these methods also address robustness through visual interventions, direct comparisons under identical perturbation settings would better establish the advantages of R2G-VLA.
- The role-guided correction mechanism relies on explicit masks obtained from task metadata or object annotations. Such information may not be available or sufficiently accurate in real-world deployments. The paper does not adequately evaluate the sensitivity of its performance to imperfect role assignments or the feasibility of obtaining these masks automatically.
- The method assumes that visual tokens with large gradients of action uncertainty correspond to misleading grounding evidence. However, high sensitivity does not necessarily indicate incorrect or harmful visual information. The paper lacks quantitative validation of the risk maps against ground-truth perturbation regions or alternative attribution methods, leaving the reliability of this central assumption unclear.
Questions for authors
see the weakness.