- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes ViGAR, a hierarchical framework for long-horizon compositional robotic manipulation that separates visual subgoal planning from subgoal-conditioned execution. A planner predicts intermediate goal images from the current observation and task instruction, while a world-action policy jointly generates future video and actions conditioned on these subgoals. Both modules are initialized from Cosmos3-Nano. The method introduces subgoal look-ahead supervision to improve stage transitions and end-effector ROI weighting to emphasize manipulation-relevant regions. An optional global goal image enables different task compositions without parameter updates. Experiments on RoboTwin Clean2Random, five real-world manipulation tasks, and two goal-conditioned composition tasks demonstrate improvements over the reported baselines, with additional evaluations of subgoal prediction quality and key design components.
Critical strengths
-
Clear and practically motivated hierarchical design. ViGAR separates visual subgoal planning from action generation, providing an explicit connection between task-level planning and execution. The subgoal look-ahead mechanism also addresses a meaningful challenge in long-horizon manipulation: avoiding regression to already completed subtasks.
-
Strong experimental results and useful validation. ViGAR achieves 67.02% success on RoboTwin Random, compared with 22.46% for the controlled Cosmos3-Nano baseline. The inclusion of this baseline, together with subgoal-quality evaluations, component ablations, and real-world experiments, provides encouraging evidence for the practical value of visual subgoal guidance.
Critical weaknesses
-
Inconsistent evaluation metrics for in-context learning. The reported task progress scores in Table 5 cannot be reproduced using Equation (5). The stage-wise success rates yield 0.35 for both OOD Fruit Arrangement and Desktop Item Storage, rather than the reported 0.43 and 0.52. Without clarification of the normalization procedure and stage definitions, the reported 47.5% average OOD progress remains difficult to verify, weakening a central experimental claim.
-
Insufficient training controls and unclear compositional generalization. The planner receives substantial additional training, while the data available to each baseline and the procedure for replacing incorrect predicted subgoals with ground truth are not sufficiently documented. Furthermore, the planner is explicitly trained with global goal images, and the exact held-out task compositions are unclear, making it difficult to distinguish genuine compositional generalization from standard goal-conditioned behavior. The aggregate RoboTwin results also combine 19 multi-stage and 31 single-stage tasks without separating their performance, limiting evidence for the claimed long-horizon benefits.
Questions for authors
-
Task progress metric (clarification). Could the authors reconcile Equation (5) with Table 5? The reported stage-wise success rates yield 0.35 for both OOD tasks, rather than 0.43 and 0.52. If task lengths vary by goal, how are individual trials normalized, and how is the reported 47.5% average OOD progress calculated?
-
Long-horizon performance (additional analysis). Can the authors report the existing RoboTwin results separately for the 19 multi-stage and 31 single-stage tasks? This would help determine whether the improvements primarily come from better subgoal-conditioned control or better coordination across subtask transitions.
-
Training data and controls (clarification). What training data are available to the planner, executor, and controlled baselines? How are incorrect predicted subgoals identified and replaced with ground-truth images during policy training, and what fraction of predictions is replaced?
-
In-context generalization (clarification). Which exact goal compositions were included in training and which were held out for the two in-context tasks? How does the evaluation distinguish generalization to unseen task compositions from standard goal-conditioned behavior, given that the planner is explicitly trained with terminal goal images?