- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents Explicit Action-Space Grounding (EASG), a framework that allows pretrained vision-language models (VLMs) to produce executable robot actions without any robot-action pretraining. EASG overlays a tool-center-point (TCP) coordinate frame onto wrist-camera observations, supplies explicit metric depth information, and describes the action semantics through language instructions. Using its original textual generation interface, the VLM outputs translation, rotation, gripper, and termination commands, while robot-specific execution is handled by deterministic coordinate transforms and inverse kinematics. The same action interface can subsequently be fine-tuned on robot trajectories, with grammar-constrained decoding enhancing the reliability of generated outputs.
The authors assess EASG via real-world zero-shot manipulation, robustness to object and pose changes, fine-tuning on more difficult manipulation tasks, LIBERO benchmark evaluations, and cross-embodiment transfer. The findings indicate that, given a suitable action interface, pretrained VLMs can exhibit non-trivial manipulation ability and can improve further through robot-data fine-tuning.
Critical strengths
- Convincing Zero-Shot Manipulation from a Pretrained VLM. EASG enables a pretrained VLM to reach a 79.4% average zero-shot success rate on six real-world tasks, on par with VLA baselines fine-tuned with task-specific demonstrations, and it remains comparatively stable under object and pose randomization. This suggests that capabilities usually acquired through robot-action training can be elicited through an explicitly grounded interface.
- A Unified, Trainable Action Interface. The same textual action interface supports both zero-shot execution and robot-data fine-tuning without learned action heads or action tokens, yielding 67.2% on six harder real-world tasks, 83.3% on LIBERO with a 0.8B VLM, and direct UR3-to-Flexiv transfer with only a small drop. This supports the promise of explicitly grounded, embodiment-independent action representations.
Critical weaknesses
- Insufficient Isolation of the Grounding Contribution. The comparisons do not clearly control for differences in sensory information (RGB-D metric depth), model capacity, and inference-time computation: Table 7 shows zero-shot success plunges from 79.4% to 11.7% without thinking, indicating that inference-time reasoning accounts for much of the reported performance. More carefully controlled comparisons are needed to separate the contributions of the grounding interface, reasoning, and extra geometric information.
- Missing Runtime Analysis and Limited Generalization Scope. The paper reports no action-prediction latency, control frequency, reasoning-token overhead, or task completion time, which is especially consequential given the strong dependence on thinking and makes practicality hard to judge. Moreover, the cross-embodiment results share the same gripper, matched initial poses, and similar workspaces, so they mainly demonstrate transfer across arms rather than broader generalization to different end-effectors or environments.
Questions for authors
- Inference latency and reasoning overhead. Given the large gap between thinking and non-thinking configurations in Table 7, could the authors report average per-action inference latency, effective closed-loop control frequency, average reasoning-token count, and total task completion time? How do these figures compare with the VLA baselines on identical hardware?
- Fairness of the VLA comparisons. Do the VLA baselines receive the same RGB-D observations and geometric information as EASG? Could the authors specify which sensory inputs, action representations, and inference configurations are shared across methods? A controlled comparison under matched information and computational budgets would help isolate the contribution of the grounding interface itself.
- Evaluation beyond LIBERO. LIBERO is known to inflate scores through task memorization, so results on it may not reflect true generalization. We encourage the authors to additionally evaluate on benchmarks that better probe generalization and zero-shot capability — e.g., RoboLab, LIBERO-Plus, LIBERO-PRO, and RoboDojo — and to report how the gap between EASG, fine-tuned VLA baselines, and the bare VLM without action-space grounding changes in those settings.
- Interpretation of the zero-success ablations. Table 8 shows total failure when either action-frame grounding or metric-depth grounding is removed. Could the authors offer a finer-grained failure analysis — for instance, whether these variants fail due to wrong movement directions, imprecise distances, or accumulated control error?
Author Response to Reviewer pZJ9 (Q3)
W2 & Q3. Additional simulation benchmark and comparisons with recent VLA baselines
We appreciate the reviewer's valuable suggestion to strengthen the evaluation with more challenging benchmarks and recent VLA baselines. To further evaluate generalization beyond standard LIBERO, we additionally evaluate EASG on LIBERO-Plus, which introduces systematic perturbations across camera, robot, language, lighting, background, noise, and object layout. We also extend the comparison to more recent VLA models, including StarVLA and VLAct.
Table R5. Generalization performance on LIBERO-Plus under different perturbations. We report task success rates (%). Original denotes the unperturbed setting, and Total denotes the overall success rate across all perturbed evaluation tasks following the LIBERO-Plus protocol.
Despite using a lightweight 0.8B VLM without any robot-action pretraining, EASG achieves an overall perturbed success rate of 51.9%, outperforming several larger action-pretrained VLA models—including OpenVLA (15.6%), WorldVLA (25.0%), NORA (39.0%) and UniVLA (42.9%)—and closely approaching π₀ (53.6%). Notably, EASG remains more resilient to Noise (72.2%) and Camera shifts (26.3%) than NORA, WorldVLA, and UniVLA (which drop to 0.1%–2.2% on Camera), and even surpasses π₀ under Camera (26.3% vs. 13.8%) and Robot (20.1% vs. 6.0%) perturbations.
At the same time, a clear performance gap remains compared with stronger recent VLAs such as StarVLA (77.2%) and VLAct (82.6%), particularly under uncalibrated camera shifts and robot morphology perturbations. Overall, these results show that EASG enables a compact pretrained VLM to achieve competitive robustness without large-scale robot-action pretraining, while clarifying where specialized VLA pretraining still holds an advantage.