- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FutureWorlds, a post-training framework for autoregressive robotic world models. Starting from a discrete autoregressive video predictor, it extends the RLVR-World-style use of outcome-based video rewards in three main ways: it maintains candidate-specific bounded histories consisting of a fixed initial scene/state anchor and a recent rolling context; it uses diverse beam search rather than independently sampled trajectories to construct alternative futures; and it applies the resulting group-relative rewards with history-matched policy scoring in the MemSPO objective. Thus, the method is primarily an integration of persistent contextual memory, diverse candidate search, and GRPO/PPO-style optimization around an existing reward-based world-model training paradigm. The method achieves strong open-loop video prediction results on RT-1, BridgeV2, and RoboCasa, but the methodological novelty and causal evidence are insufficient to justify acceptance.
Critical strengths
-
The framework is clearly described and provides a coherent integration of candidate search, branch-specific history maintenance, and trajectory-level optimization.
-
The paper reports a broad evaluation covering long-horizon prediction, motion metrics, memory ablations, decoding sensitivity, and inference resources.
Critical weaknesses
-
Limited methodological novelty. The method mainly combines existing components, including discrete autoregressive video prediction, diverse beam search, a sliding-window history, and GRPO/PPO-style optimization. The paper does not establish that this combination is necessary compared with simpler reward-based fine-tuning or candidate-selection approaches.
-
The alternative-future premise is not sufficiently validated. Candidates are rewarded according to their similarity to a single recorded future, while token-level disagreement is used as the main evidence of diversity. The paper does not show that the candidates represent distinct, physically valid futures or improve uncertainty coverage.
-
The ablations do not isolate the claimed contributions. The ordinary-beam comparison changes beam grouping and allocation in addition to the diversity penalty; the memory study is performed only at inference time; and history-consistent scoring and reward design are not directly ablated under matched training conditions.
-
The optimization provides coarse credit assignment and limited theoretical support. A single trajectory-level advantage is assigned to all (10\times80) dynamic tokens, despite their different frames and histories. Moreover, the theory only characterizes a local gradient identity and does not establish that search-selected candidates produce a better optimization direction or convergence guarantee.
-
The evaluation remains focused on oracle-guided open-loop video quality. The reward uses recorded future frames and is closely aligned with the reported PSNR/SSIM/LPIPS metrics. The experiments therefore do not establish improved planning, closed-loop control, or task success when future ground-truth observations are unavailable.
Questions for authors
see weakness above