- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents WISE, a framework for world-model-assisted VLA post-training. It allocates imagination computation to interaction-relevant states, such as grasping and manipulation. A visual scheduler selects states, after which the VLA samples candidate actions and evaluates their consequences through bounded world-model rollouts. A reward model combines progress, confidence and completion signals, while repeated imagination and reliability filtering produce group-relative advantages for updating the VLA action head. Policy supervision uses only the first action chunk sampled from each real interaction context. The framework is evaluated with π0 and π0.5 on MimicGen tasks and real robots.
Critical strengths
-
The paper addresses an important computational efficiency problem. Generating many candidate futures with a world model is expensive, and WISE explicitly studies how to allocate this computation. In the scheduling ablation across three simulated tasks, it reduces the average number of selected states from 138 to 28 and GPU time from 11.45 to 2.61 hours while achieving higher success rates, demonstrating a favorable balance between performance and computation.
-
The evaluation covers two VLA backbones and both simulation and real robots. Across five MimicGen tasks, WISE improves the average success rates of π0 and π0.5 by 10.0 and 7.9 percentage points, respectively. Real robot evaluations additionally cover changes in height, lighting, distractors and language instructions, supporting the effectiveness of the overall framework and the robustness of the resulting policies.
-
The framework explicitly addresses imagination errors and supervision reliability. Bounded rollouts, repeated imagination and candidate-group filtering aim to limit prediction errors and unstable reward estimates. Moreover, imagined trajectories evaluate candidate actions, while policy supervision remains grounded in real interaction contexts and their first action chunks. This may reduce the risks associated with directly learning from unreliable synthetic state–action pairs.
-
The ablations provide evidence beyond overall performance gains. The scheduling study compares learned, random, and uniform selection with the same number of selected states, supporting the value of state selection itself. Reward ablations also show that combining progress, completion and the additional reward components outperforms individual signals, providing empirical support for the main design choices.
Critical weaknesses
-
The scheduler’s ability to identify useful imagination contexts remains insufficiently validated. It is trained using weak labels associated with grasping and manipulation, so its benefits may largely come from concentrating computation on these stages. The scheduling ablations cover only Stack, Threading, and Mug Cleanup in MimicGen, where precise alignment and contact interactions are central challenges. The paper lacks comparisons within the same stage and against simple stage rules. Its independent contribution is also not isolated in real robot experiments.
-
The GRPO and DPO baselines are insufficiently specified. The paper does not clearly explain how these methods are adapted to π0’s flow-matching action generation, including their optimization objectives and computation of policy probabilities or surrogates. Key training configurations and budgets are also unclear. These choices can substantially affect baseline performance, limiting reproducibility and assessment of comparison fairness.
-
The methodological novelty relative to prior work needs clarification. WMPO already combines world-model rollouts, learned rewards and GRPO for VLA optimization. VLAW explores world-model-assisted VLA post-training. AWM studies advantage-weighted flow-matching updates. WISE adds selective imagination, bounded rollouts and reliability filtering, but its central scheduler is a classifier trained with weak stage labels and used through threshold gating. The paper should clarify the substantive advances beyond integrating these components.
Questions for authors
-
Does the scheduler identify states where imagination provides greater benefits? In Stack Cube, one state may have the upper cube already aligned, while another places it near the edge, where different actions could lead to stable stacking or toppling. Does the scheduler preferentially select the latter states, and does imagination at these states produce greater training gains?
-
How does the learned scheduler compare with simple stage rules? Under the same imagination budget, please compare it with random or uniform selection within manipulation stages identified using grasp signals.
-
What is the scheduler’s independent contribution on real robots? Could the authors provide an equal-budget ablation comparing learned, random and uniform scheduling?
-
How are π0 + GRPO and π0 + DPO implemented? Please specify their objectives, policy probability calculations or surrogates, trainable parameters, reward/preference data sources, sampling and update counts, and data or interaction budgets.
-
How are the confidence head’s ground-truth labels constructed? The paper mentions binary cross-entropy but does not define ground truth targets. Please clarify what c_t measures and how its labels are obtained in simulation and real robot data.
-
Is the world model robust to unseen distractors? Please compare generated futures with and without distractors against the corresponding real futures. In particular, can it preserve object and scene consistency while accurately predicting target motion, contact interactions and manipulation outcomes?