- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes NRP-DMD for distilling bidirectional video diffusion models into few-step causal generators. Motivated by the different temporal factorizations of the teacher and student, it uses their disagreement in text-conditioned score responses as additional directional information for distillation. Specifically, NRP-DMD computes the teacher–student disagreement between null-to-text score responses and uses it to precondition the original DMD update, selectively amplifying the aligned component while preserving the orthogonal component. The method requires no architectural changes or additional inference-time computation. Experiments on Self Forcing and Causal Forcing show consistent improvements in VBench Total and Quality for both 5-second and 30-second generation, supported by extensive ablations and diagnostic analyses.
Critical strengths
- Simple and practical design with no inference overhead. NRP-DMD reweights the existing DMD update rather than introducing a new objective or modifying the generator architecture. It can be directly integrated into Self Forcing and Causal Forcing, with only about 10% additional training time and no extra inference cost.
- Strong controlled evidence for the proposed response-disagreement direction. Uniformly amplifying the DMD signal, shuffling the response direction across samples, or using alternative axes such as the teacher response alone cannot reproduce the gains. These controls support that the improvement comes specifically from the sample-dependent teacher–student response disagreement.
- Consistent improvements across different baselines and generation horizons. NRP-DMD improves VBench Total and Quality on both Self Forcing and Causal Forcing for 5-second and 30-second generation. The 5-second improvements in Total and Quality are further supported by paired bootstrap confidence intervals, strengthening the robustness of the empirical results.
Critical weaknesses
- The temporal-factorization motivation is not directly isolated. The paper argues that response disagreement arises from the mismatch between bidirectional and causal temporal modeling, but the experiments mainly show that the disagreement direction is useful. A causality-matched teacher–student control would better validate this central interpretation.
- The performance gains are consistent but relatively modest. On 5-second generation, the improvements in VBench Total and Quality are small, and gains in Semantic are inconsistent. Although bootstrap results support the Total/Quality improvements, the practical magnitude remains limited.
- The empirical validation is still somewhat narrow. The method is evaluated only on Wan2.1-based Self Forcing and Causal Forcing, with generation horizons up to 30 seconds. Broader validation across different backbones or causal distillation frameworks would strengthen the claim of general applicability.
Questions for authors
-
Can the authors provide a causality-matched teacher–student control, or another experiment that isolates the effect of temporal-factorization mismatch? This would help determine whether the benefit of response disagreement is specific to bidirectional-to-causal distillation or reflects a more general property of conditional DMD.
-
Given the relatively modest gains in the 5-second setting and the inconsistent changes in Semantic scores, can the authors report paired bootstrap confidence intervals for the 30-second results, similar to those provided for the 5-second evaluation, and, if available, results across independent training seeds? This would help assess the robustness of the reported improvements.
-
Do the authors have results on an additional backbone or causal distillation framework beyond the current Wan2.1-based Self Forcing and Causal Forcing settings? Such evidence would materially strengthen the claim that NRP-DMD generalizes beyond the specific experimental setup used in the paper.