- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Mask Forcing on the autoregressive DMD distillation framework of Self Forming, which applies a Dual-Noise Masking Rollout strategy to the input token at each step of the student model's self-rollout. Randomly select a certain proportion of tokens and inject low-noise signals into the noisy rollout inputs to construct inputs with inconsistent local noise levels. The authors motivate this design as a way to improve teacher-mode coverage and reduce error accumulation, and evaluate it on Self Forcing, Causal Forcing, and LongLive, including a 30-second LongLive setting.
Critical strengths
-
This paper is well written and easy to follow.
-
The experimental evaluation is comprehensive, involving multiple metrics, and the results support the effectiveness of the method.
-
The method is simple and direct, requiring no additional training stages or auxiliary components and incurring low extra cost.
Critical weaknesses
-
I think the overall idea of the novel is relatively low, similar to diffusion forcing, and the core is to add noise disturbance to the history. I think this is more like training regularization that improves model robustness and generation quality.
-
Local injection of lower noise tokens may cause a mismatch between the input and global timestep conditions, and the paper has not fully discussed its side effects.
Questions for authors
-
Can the author report the complete VBench Long results for each dimension, not just the overall score? This will clarify the specific benefits of indicators such as consistency and dynamism, and reveal any trade-offs across dimensions.
-
Are the samples used to train the fake score model also drawn from the same dual-noise masked rollout?
Thank you for acknowledging Mask Forcing as a simple and direct method with comprehensive experimental evaluation, and giving positive feedback. We address your concerns as follows:
W1: Comparison with Diffusion Forcing and history noise augmentation
We thank the reviewer for this comment. We would like to clarify that Mask Forcing perturbs the intermediate denoising inputs of the current chunk, while previously generated history remains uncorrupted. Specifically, the "previous prediction" in Eqs. (8)–(10) refers to the prediction from the preceding denoising step within the same chunk, rather than a previously generated chunk. The completed clean prediction is written to the history KV cache (Algorithm 1).
While both methods involve heterogeneous noise levels, Diffusion Forcing assigns each frame an independently sampled noise level during diffusion training on ground-truth sequences. Mask Forcing introduces masked dual-noise perturbations during autoregressive self-rollout distillation with the DMD objective. We agree that this can have a regularization effect. Our contribution lies in this specific design for autoregressive video distillation and its demonstrated effectiveness.
We additionally evaluate adding noise disturbance to the history as a baseline during autoregressive diffusion distillation in the revision (Appendix J Table 11). Mask Forcing achieves higher HPSv3 (9.84 vs. 9.77), Dynamic Degree (82 vs. 45), and vision reward score (11.37 vs. 9.99). These results support the advantages of Mask Forcing over adding noise disturbance to the history.
W2: Discussion of mismatch between inputs and global timestep conditions
We thank the reviewer for raising this point. The mismatch serves as a perturbation to the student’s self-rollout trajectory. Perturbing the rollout trajectory can expose DMD to a broader range of student samples, providing learning signals beyond the modes the student already covers.
Tables 3 and 4 in the paper analyze the effects of this perturbation by varying the mask ratio α and timestep window Δ. These parameters control the proportion of tokens at lower noise levels and the maximum timestep difference, respectively. The results reveal trade-offs between visual quality and motion dynamics, which show that increasing the extent of the mismatch does not consistently improve performance. Excessive guidance from cleaner tokens may constrain motion in subsequent denoising, while insufficient perturbation can limit the benefits. We therefore adopt α=0.2 and Δ=250, achieving HPSv3 of 9.84 and Dynamic Degree of 82 to balance visual quality and motion dynamics.
Q1: Complete VBench-Long results
We thank the reviewer for this suggestion. We report the complete per-dimension VBench-Long results below. Mask Forcing improves 12 of the 16 dimensions, matches LongLive on human action, and shows decreases in color, dynamic degree, and appearance style. The largest gains are in spatial relationship (+4.18) and imaging quality (+2.19), alongside improvements in subject and background consistency, temporal flickering, and motion smoothness. The main trade-offs are lower color and dynamic-degree scores, while appearance style remains nearly unchanged. We include the complete results in the revision (Appendix K).
Q2: Training samples for the fake score model
Yes. The samples used to train the fake score model are drawn from the same dual-noise masked student rollout. The resulting clean samples are then re-noised using the standard diffusion noising process for fake score training. Dual-noise masking is applied only during student rollout, not during this subsequent re-noising step.