- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes WorldGuide, a three-stage framework for improving vision-language-action policies with failure-aware latent world modeling. The method first pretrains a latent world model on both successful and failed trajectories, then applies contrastive learning to matched success–failure pairs from the same task and similar execution stages. Finally, the frozen world model provides a differentiable reward for end-to-end VLA policy optimization and is discarded at deployment. Experiments on LIBERO, RoboTwin, SimplerEnv, and a real-robot setup show improved success rates with no additional world-model inference cost.
Critical strengths
-
Broad empirical evaluation. The method is evaluated across multiple simulation benchmarks and a real-robot setup, with consistent improvements over the reported baselines.
-
Clear motivation. The paper identifies an important limitation of success-only world-model training: visually similar successful and failed interactions may receive similar latent feedback.
Critical weaknesses
- Limited methodological novelty. Stages 1 and 2 mainly use general methods for latent world-model training, such as predictive learning on success/failure data and contrastive separation. World-model-based auxiliary guidance has also been explored in prior works such as VLA-JEPA and VLA-RFT. It is therefore unclear what substantive innovation distinguishes WorldGuide from an engineering combination of existing components.
- The contribution of the proposed WM loss is not causally isolated. The paper does not report a controlled (\beta=0) ablation with the same Stage-2 initialization and optimization budget. The default (\beta=0.1) is relatively small, while increasing it to (0.2) causes a clear performance drop, suggesting that BC remains the main learning signal. Thus, the actual contribution of the WM-guided loss is unclear.
- The WM reward is an insufficiently validated proxy. The reward is based on latent distance to a successful future rather than true task success. The paper does not test reward calibration, candidate-action ranking against real outcomes, or possible exploitation of errors in the frozen world model. Hence, the observed gains do not establish that this reward is reliably aligned with task completion.
- Limited generality of the failure-data pipeline. Failure data require simulator perturbations, under-converged policy checkpoints, VLM-based failure-onset annotation, and manual verification. It remains unclear whether the method works with naturally collected failures, noisy annotations, or without this additional supervision.
- Insufficient real-world evidence. The real-robot evaluation uses only three tasks and 20 trials per task. The results are therefore suggestive but insufficient to support strong claims about robustness and generalization.
Questions for authors
see weakness above
3 comments
Response to Reviewer Qxau (2/2)
Thank you for your detailed feedback. The modified parts in the revised PDF are marked in blue.
W4. Insufficient Real-World Evidence
We further expanded our real-world evaluation by introducing three additional manipulation tasks: orange oval, green star, and blue trapezoid. We also increased the number of trials from 20 to 60 per task for each method. The expanded results show consistent improvements with WorldGuide across a broader range of object geometries, providing stronger evidence of its effectiveness and robustness in real-world manipulation. Additional experiments can be found in Appendix E.
| Task | π0 (95% CI) | π0.5 (95% CI) | WorldGuide (95% CI) |
|---|---|---|---|
| Purple square | 11.7% [5.8, 22.2] | 10.0% [4.7, 20.1] | 23.3% [14.4, 35.4] |
| Green circle | 20.0% [11.8, 31.8] | 15.0% [8.1, 26.1] | 20.0% [11.8, 31.8] |
| Yellow triangle | 5.0% [1.7, 13.7] | 10.0% [4.7, 20.1] | 16.7% [9.3, 28.0] |
| Orange oval* | 16.7% [9.3, 28.0] | 15.0% [8.1, 26.1] | 25.0% [15.8, 37.2] |
| Green star* | 6.7% [2.6, 15.9] | 5.0% [1.7, 13.7] | 11.7% [5.8, 22.2] |
| Blue trapezoid* | 13.3% [6.9, 24.2] | 11.7% [5.8, 22.2] | 21.7% [13.1, 33.6] |
| Overall* | 12.2% [9.2, 16.0] | 11.1% [8.3, 14.8] | 19.7% [15.9, 24.1] |
Kind Request for Further Feedback
Dear Reviewer Qxau,
As the discussion period is nearing its end, we would appreciate any feedback on whether our responses and additional experiments have addressed your concerns. If any questions remain, we would be happy to provide further clarification. Thank you again for your time and thoughtful feedback.
Response to Reviewer Qxau (1/2)
Thank you for your detailed feedback. The modified parts in the revised PDF are marked in blue.
W1. Clarification on Novelty
While WorldGuide uses world models to improve VLA learning, its objective and learning mechanism differ fundamentally from prior work.
Specifically, VLA-JEPA focuses on learning action-relevant representations through leakage-free future latent prediction, jointly optimizing representation learning and action generation. VLA-RFT uses an autoregressive world model as a visual simulator, generating policy rollouts and optimizing the VLA through verified visual rewards and GRPO.
Instead of relying on future prediction similarity, WorldGuide explicitly learns outcome-sensitive success/failure boundaries through three key designs: (1) a failure-rich dataset covering both coarse and subtle execution failures. (2) progress-anchored, nearest-neighbor contrastive learning with spatiotemporal weighting to isolate outcome-critical deviations. And (3) a differentiable latent boundary reward that provides direct action-level gradients for policy optimization, requiring neither autoregressive rollouts nor extra inference overhead. Our ablations further support this distinction: the proposed boundary reward achieves an AUC of 0.85, compared with 0.47–0.50 for prediction MSE and goal similarity.
W2. Contribution of the World-Model Reward under Controlled β Ablations
Setting β=0 removes the world-model reward term, reducing the objective to BC-only baseline. Our results show that introducing the boundary-aware reward β=0.1 improves over this baseline. Although increasing β to 0.2 reduces performance by 3.3 percentage points compared with β=0.1, it still outperforms the BC-only baseline. This indicates that the learned reward provides useful policy guidance, while excessive reward weighting compromises the balance between boundary-aware optimization and behavioral imitation. Thus, the performance drop at β=0.2 reflects an imbalance between the two objectives rather than a lack of contribution from the world model. The corresponding results are summarized below:
W3. Local Reward Reliability
To examine whether the learned reward aligns with actual execution outcomes, we conducted local action perturbation experiments on LIBERO, fixing the 9-frame visual context and applying Gaussian noise to successful action chunks.
Ranking accuracy measures how often the reward assigns a higher score to the successful action than to its perturbed counterpart (chance = 0.5). The increasing ranking accuracy, together with the corresponding decline in execution success, suggests that the learned reward captures meaningful local differences in action quality.
W4. Failure Data Generalization and Annotation Robustness
Our failure data are not limited to simulator perturbations. We also execute under-converged policy checkpoints in the simulator and collect the resulting failures, allowing us to continuously expand the failure dataset. Regarding annotation, VLM-generated failure timestamps are used only for temporal matching in Stage 2, rather than as direct supervision for world-model prediction or reward learning. Stage 1 can also learn from failure trajectories without precise failure timestamps.
We also introduced a 0.2s perturbation to failure-onset timestamps. Although performance decreased slightly, it remained above the baseline, indicating robustness to moderate annotation noise.