- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents ForgeWM, a progressive training framework for converting a bidirectional action-conditioned video generator into causal few-step world models for real-time interactive generation. The proposed pipeline consists of four stages: bidirectional domain adaptation, teacher-forced causal training, causal consistency distillation, and on-policy distribution matching. Based on this pipeline, the authors obtain budget-specialized students operating with 1, 2, or 4 denoising steps while preserving frame-aligned keyboard, mouse, and gamepad controls. The paper further introduces a dual-path deployment scheme, where low-step models are used for latency-critical online interaction, and the generated trajectory can optionally be improved afterwards using Replay-Time Refinement. Experiments are mainly conducted on Minecraft trajectories, with an additional transfer experiment on gamepad-controlled FPS gameplay.
Critical strengths
- The paper presents a practical training pipeline for converting an action-conditioned video generator into 1-step, 2-step, and 4-step interactive world models. The resulting system provides a useful trade-off between generation quality and inference latency.
- The paper considers several practical aspects of interactive world-model deployment. It evaluates different inference budgets and control settings and also demonstrates transfer beyond the main Minecraft environment.
Critical weaknesses
- The proposed pipeline mainly combines existing techniques, and the paper does not provide enough evidence to justify why this particular combination is necessary or technically non-trivial. I do not think a paper must introduce a fundamentally new method to be valuable. However, when the main contribution is the integration of existing techniques, I expect stronger experiments showing why each component is needed and why simpler alternatives are insufficient. The current ablations mostly show that the proposed stages can be combined into a working pipeline. The stage-wise ablation shows that individual stages affect performance, but it does not sufficiently establish why this particular sequence of existing techniques is necessary, or whether simpler or alternative combinations could achieve similar results. I therefore find the current empirical justification insufficient for establishing the significance of the proposed training recipe.
- The experimental comparison is insufficient at both the system level and the distillation-method level. The main baselines are relatively limited, and several more recent interactive world models are not considered. I understand that direct comparison can be difficult because the paper builds on an older base model. However, recent methods are still important for understanding whether the proposed design remains necessary. In particular, Matrix-Game 3.0 demonstrates a strong alternative based on a bidirectional student and self-generated multi-segment training. This makes it important to explain and experimentally justify why a block-wise causal student is preferable to a bidirectional student design in this setting. The paper should ideally compare causal and bidirectional students under the same backbone and data. Since the main contribution is also framed as a distillation pipeline, the paper should include controlled comparisons with related distillation methods such as mentioned AAPT. Without these comparisons, it is difficult to determine whether the gains come from the proposed pipeline itself or simply from applying existing distillation techniques to the chosen base model.
- I am not fully convinced that Replay-Time Refinement is sufficiently connected to the main contribution of the paper. The paper shows that this procedure can improve the quality of a saved trajectory while remaining closer to the original rollout than regeneration from noise. This can be useful for replay or video export. However, it does not improve the quality or latency of the actual real-time interaction. It is also largely independent of the causal distillation pipeline highlighted in the paper. I therefore think its role as a major contribution requires stronger motivation. Otherwise, it may be more appropriate to present it as an optional deployment feature rather than a central component of the method.
Questions for authors
See weaknesses above.
General response (1/2)
We thank the reviewers for their constructive feedback. We are glad that the practical quality–latency trade-offs of ForgeWM and its replay refinement capability were recognized. The reviews also raised important questions about the contribution beyond existing causal distillation methods, the effect of additional in-domain training, and whether our evaluation sufficiently captures the latency and controllability needed for interaction. We have conducted several new experiments to address these points and incorporated the results into the revised manuscript (changes highlighted in blue).
Contribution.
ForgeWM builds on the broader line of autoregressive video distillation methods, including Self-Forcing, Causal Forcing, and Causal Forcing++, rather than introducing a new distillation objective. Our focus is on bringing progressive causal training to interactive world models with game-native controls. Specifically, we combine a domain-adapted bidirectional teacher with causal distillation while maintaining frame-aligned discrete and continuous actions across latent chunks and causal caches. The framework produces budget-specialized 1-, 2-, and 4-step students and also transfers to gamepad-controlled FPS environments, retaining the same backbone, action-module topology, and four-stage training objectives with only an input-level adaptation to the control interface. Replay refinement is presented as an optional deployment feature rather than part of the core training contribution.
To better understand how much each component contributes, we have added controlled comparisons with simpler training alternatives. In E1, we train Matrix-Game 2.0's released distilled student using our data and DMD configuration, and compare against a direct Causal Forcing++ adaptation without our domain-adapted teacher. These experiments use the same 40k clips and matched Stage-3 DMD settings and iterations, allowing us to examine the effect of the preceding training recipe. We also evaluate the Stage-2 checkpoints directly at 1, 2, and 4 steps (E2), and study how removing or shortening the consistency initialization affects subsequent DMD training (E6).
For the interaction-related concerns, we have measured end-to-end latency including decoding and cache updates (E3), tested action reversals both at and within chunk boundaries (E4), and added motion-magnitude-sensitive metrics (E5). We also evaluate the released Matrix-Game 3.0 on our evaluation inputs (E7) to provide a comparison with a more recent interactive world model.
The reference-based comparisons use 200 paired trajectories from Table 1, with an additional set of 200 trajectories from the data_269 subset of GF-Minecraft for cross-model comparisons. We further use 20 independently collected scenes with six constant actions for no-reference quality and control evaluation. The full protocols and results are included in the revised Section 4.4 and Appendix F.