- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces ReGuide, an external module designed to address the compositional generalization challenge in VLAs without modifying model weights. ReGuide first employs a grounding module to identify the correct target region. Subsequently, during inference, ReGuide performs semantic rebinding assessments at each controller step, intervening to steer the robot to the correct location whenever the VLA trajectory deviates.
ReGuide has been validated in both Libero and real-robot settings, demonstrating significant improvements, particularly on real robots.
Critical strengths
- The manuscript flows logically, progressing from the formulation of the compositional generalization problem to the observation that "VLAs often fail at global grounding while retaining local manipulation skills that recover near the correct target in familiar configurations," and finally to the ReGuide method, which employs a grounding module to address the limitations in VLA grounding capabilities.
- The experimental validation is quite comprehensive. Experiments conducted on Libero and in the real world have both demonstrated the effectiveness of the ReGuide method, particularly the significant improvements observed in real-world settings.
I would consider raising my score if the authors adequately address these two concerns.
Critical weaknesses
- ReGuide relies on the unexecuted portions of an action chunk to perform semantic rebinding assessments. This raises a question regarding control modes: is ReGuide limited to synchronous control, or is it compatible with asynchronous control or Real-Time Action Chunking (RTC)? If it is restricted to synchronous control, its applicability would be significantly limited, given the recent prevalence of asynchronous control and RTC in VLA applications. Conversely, if it supports asynchronous control, new challenges arise—such as the potential obsolescence of the action chunk used for assessment, and the handling of actions that have already been submitted to the controller but not yet executed at the moment a correction is triggered.
- At its most upstream stage, ReGuide relies on a Grounding Module; further analysis of the module's failure modes—and how these modes impact ReGuide's performance—helps readers understand the system's operational boundaries (for instance, by introducing perturbations of varying magnitudes to the grounding location, orientation, or object dimensions and observing the resulting changes in ReGuide's success rate).
Questions for authors
- Does ReGuide support asynchronous control? If so, I would like the author to address the issue regarding asynchronous control raised in Weakness 1.
- Performance of the grounding module under various failure modes