- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SCIP, a framework that enables VLM agents to revise plans before execution based on predicted visual consequences. In this framework, a action-conditioned world model is introduced to provide visual consequences, and a shared VLM is responsible for planning and verification. The framework is trained with a novel paradigm, imagination-guided policy learning and verification-driven imagination learning. Experiments cover four EmbodiedBench environments, with the strongest improvements observed on EB-Habitat.
Critical strengths
- The paper is well-written and easy to follow. The problem is formulated well and the integration of planning, latent prediction, verification, and revision is intuitive and clearly motivated.
- The experiments cover both high-level planning and low-level control.
Critical weaknesses
- The necessity of two-round alternating training schedule is not well established.
- In Table 4, adding Section 3.3 improves success from 57.6% to 64.8%, but this stage bundles action matching, visual similarity, turn-wise improvement, and verifier training. Consequently, the improvement cannot be attributed specifically to imagination-guided learning.
- In order to predict the real environment more accurately, the authors introduces verification-driven imagination learning (Sec 3.4). However, Sec 3.4 optimizes predicted latents to increase a frozen verifier’s likelihood of the reference verdict, subject to regularization toward the pretrained model. This may make the latents more useful for classification without necessarily improving their correspondence to actual environment dynamics.
- The framework for improving the plan through the prediction of future states have relevant precedents. SCIP's distinction appears to lie primarily in its training paradigm, making the missing ablation studies and analysis particularly important.
Questions for authors
Please see Critical Weaknesses above.
5 comments
Response to Reviewer 6cFd (2/2)
(W3) Do the imagined states after calibration (Section 3.4) still correspond to the actual environment dynamics?
We thank the reviewer for raising this point. We measure this correspondence by the L1 error between imagined states and real observations in the feature space of the world model (V-JEPA 2 [1]), on the plans that SCIP executes in the EB-Habitat evaluation. As shown in the table below, calibration with verification signals alone raises this error from 0.351 to 0.850 at 4 steps, even though the success rate rises from 64.8% to 68.0% (Table 4). A higher success rate therefore does not ensure this correspondence. To ensure it, we add a next-observation loss to calibration (Section 3.4), which trains the world model to match the real next observation on the training trajectories. With the next-observation loss, the error returns to the level before calibration (0.225 vs. 0.224 at 1 step and 0.358 vs. 0.351 at 4 steps), while most of the gain in success rate is retained (67.7% vs. 68.0%), indicating that the imagined states after the revised calibration still correspond to the actual environment dynamics. We have added this loss to Section 3.4 and this analysis to Section 4.3 (Table 6) of the revised paper.
| EB-Habitat | L1 ↓, 1 step | 2 steps | 3 steps | 4 steps | Avg. SR ↑ |
|---|---|---|---|---|---|
| Before calibration | 0.224 | 0.355 | 0.345 | 0.351 | – |
| SCIP (after calibration) | 0.351 | 0.568 | 0.706 | 0.850 | 68.0 |
| SCIP + next-observation loss | 0.225 | 0.355 | 0.348 | 0.358 | 67.7 |
SR averaged over three runs.
[1] Assran et al. V-JEPA 2: Self-supervised video models enable understanding, prediction and planning. arXiv 2025.
(W4) Clarification of what distinguishes SCIP from prior methods that predict future states, and the ablations of its training paradigm.
Thanks to the reviewer for pointing this out. The training paradigm is indeed our core contribution. Prior methods that predict future states [2, 3, 4, 5, 6] train their world model with task-agnostic objectives or use it as a fixed simulator (Section 2), whereas SCIP (i) rewards plans by their imagined outcomes, (ii) trains the VLM to verify and revise its own plans, and (iii) calibrates the world model for plan verification. As suggested by the reviewer, we ablate each part on EB-Habitat. Retraining Section 3.3 without (i) or without (ii) lowers the average success rate by 4.0 and 6.0 (see the table of our response to (W2)), and (iii) adds 3.2 (64.8% to 68.0%, Table 4), indicating that each part of the training paradigm contributes to SCIP’s performance. We have added this analysis to Appendix C.1 of the revised paper.
[2] Cen et al. WorldVLA: Towards autoregressive action world model. arXiv 2025.
[3] Zhao et al. CoT-VLA: Visual chain-of-thought reasoning for vision-language-action models. CVPR 2025.
[4] Li et al. VLA-RFT: Vision-language-action reinforcement fine-tuning with verified rewards in world simulators. arXiv 2025.
[5] Xiao et al. World-Env: Leveraging world model as a virtual environment for VLA post-training. arXiv 2025.
[6] Wang et al. World modeling makes a better planner: Dual preference optimization for embodied task planning. ACL 2025.
Thank you for your valuable review and for taking the time to read our responses. All changes in the revised paper are marked in blue.
Official Comment by Authors
Thank you again for your time and consideration.
As the discussion period draws to a close, we would like to follow up on our response to your review. We would be grateful if you could let us know whether our response addresses your concerns. We would also be happy to provide further clarification or discuss any remaining questions.
Response to Reviewer 6cFd (1/2)
We thank the reviewer for the opportunity to clarify this. The schedule consists of two stages, each run once. Policy learning (Section 3.3) trains the VLM, which acts as both the planner and the verifier, to plan and verify with imagined outcomes, while calibration (Section 3.4) trains the world model to imagine outcomes that lead the verifier to the correct verdict. Specifically, policy learning takes its reward from the imagined outcomes of a fixed world model, while calibration then tunes the world model against the resulting verifier with the VLM fixed. Each stage is thus trained with the output of the other, and each adds its own gain, as the average success rate on EB-Habitat rises from 57.6% (SFT) to 64.8% and then to 68.0% (Table 4), indicating that neither stage is redundant. We have clarified this in Section 3.5 of the revised paper.
We thank the reviewer for the opportunity to clarify this. The imagination-guided part of Section 3.3 is the visual-similarity reward (rvisual, Eq. 2), which credits plans whose imagined final state matches that of the ground-truth plan, whereas action matching and turn-wise improvement compare actions only. To isolate its effect, we additionally retrained Section 3.3 without this reward. As shown in the table below, with all the other components kept, the average success rate drops from 64.8% to 60.8%, indicating that 4.0 of the 7.2 gain of Section 3.3 is specific to the imagination-guided reward. Removing verifier training instead lowers it to 58.8%, so the verifier trained on imagined states also contributes.