- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper proposes Parallel Predictive World Models (PPWM) and a complementary trajectory refinement method. Compared with Fast-LeWM, PPWM introduces causal interaction among future-state representations before decoding. It also employs a scheduled-sampling-style training method called Multi-Anchor Self-Conditioned Rollout (MAR), which trains the model to continue predicting from its own predicted histories, reducing the training–inference mismatch during long-horizon prediction. For planning, it refines CEM-generated plans by jointly optimizing the action sequence and an auxiliary latent trajectory.
Critical strengths
The paper investigates a worthwhile research direction: how to construct world models that are both low-latency and sufficiently accurate, which is particularly important for their future use in planning.
Critical weaknesses
1. Limited architectural novelty and insufficient evidence for the proposed causal interaction. The main architectural contribution appears to be the addition of causal interaction among future-state representations to Fast-LeWM’s parallel prediction framework. However, causal attention among future representations is not, by itself, a clearly novel mechanism, and the paper does not sufficiently motivate why this additional interaction should improve upon action-prefix conditioning. More importantly, its contribution is not isolated through a direct, controlled ablation—for example, disabling cross-horizon interaction while keeping the remaining architecture, training objectives, and budget unchanged. Table 6 further complicates the interpretation: without MAR, PP-LeWM performs worse than Fast-LeWM at the 20- and 30-step horizons on Push-T. Although this does not establish that causal interaction is ineffective, it leaves unclear whether the reported gains primarily arise from the proposed architecture, the scheduled-sampling-style MAR training, or their combination.
2. Limited evaluation of out-of-distribution generalization. World models can perform well on familiar trajectories yet fail under distribution shifts, limiting their usefulness for planning, where candidate action sequences may depart from the training distribution. The paper does not explicitly evaluate such robustness—for example, training on trajectories collected by one behavior policy and testing on trajectories generated by another. Evaluations under shifted action distributions or unfamiliar initial states would help establish whether the reported gains extend beyond the training distribution.
Questions for authors
Please see the weaknesses above. In particular:
- Can you isolate the contribution of causal interaction among future-state representations through a controlled ablation, with and without MAR? How should we interpret PP-LeWM without MAR underperforming Fast-LeWM at longer horizons in Table 6?
- How were the training trajectories collected, and do the evaluations include shifts in behavior policies or action distributions relative to training?