- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper accelerates rolling video diffusion through Multi-Scale Patchification (MSP), which assigns larger patches to noisier states, and Multi-Scale Self-Attention (MSSA), which subsamples keys and values according to query scale. Homogeneous-Noise-Level DMD (H-DMD) assembles training videos from a shared window position. On Wan2.1-1.3B, the model reports 22.84 FPS on one H200, 39.7% faster than Rolling Forcing.
Critical strengths
-
Technical design. Using different spatial scales for states at different noise levels is a reasonable design choice for rolling diffusion. MSP reduces the number of tokens, and MSSA reduces the attention cost.
-
Practical value. At 832 × 480 resolution, the reported throughput increases from 16.35 to 22.84 FPS on a single H200, a 39.7% improvement over Rolling Forcing. This is a substantial gain for streaming generation.
-
Experimental evaluation. The paper evaluates five-second videos on 946 prompts with five seeds and 60-second videos on 128 prompts. The ablations report how successive components affect speed, quality, and motion.
Critical weaknesses
-
Limited novelty. The assembly in Eq. (8) already appears in Rolling Forcing, Section 3.4, Eq. (4), which also discusses the heterogeneous-noise mismatch. MSP's projections, LoRA, residual branch, and teacher warm-up closely resemble DDiT, while the related FlexiDiT is omitted. These precedents weaken the claimed originality of H-DMD and MSP's adaptation modules. The new contribution rests mainly on mixed-scale rolling windows and query-dependent KV sampling, but their advantage over adaptations of these prior methods is not tested.
-
Experimental limitations. The reported quality gains vary across settings. On five-second videos, the full model slightly improves the VBench quality score over Rolling Forcing (83.63 to 83.92), although adding MSSA lowers this score relative to H-DMD+MSP (84.61 to 83.92). On 60-second videos, imaging quality is somewhat lower than Rolling Forcing (70.66 to 69.04), while the reported drift decreases (2.227 to 1.700). This indicates smaller fluctuations in segment-level quality; the effect on gradual quality deterioration is less clear. Quality-versus-time curves would help assess how visual fidelity develops during longer rollouts.
-
Methodological concerns. The cumulative ablations change both architecture and training. MSP introduces adapters and an additional 6K-pair warm-up, while H-DMD changes video assembly and which rolling windows receive gradients. These comparisons do not clearly separate the proposed mechanisms from the effects of additional adaptation and different gradient coverage. Comparisons with matched training budgets, alternative patch schedules at the same token budget, and head-only DMD would help establish what accounts for the quality gains.
Questions for authors
-
How does H-DMD differ from Rolling Forcing Eq. (4), and which MSP components are new relative to DDiT and FlexiDiT? Can comparisons with adaptations of these methods to the same rolling-window setting clarify the added value of the proposed integration?
-
How do the authors interpret the short-video quality decrease after adding MSSA and the lower long-video imaging-quality score relative to Rolling Forcing? Could quality-versus-time curves clarify whether reduced drift also reflects better preservation of visual quality during longer rollouts?
-
Can controls with the same adapters, token budget, and warm-up budget test whether noise-matched patch scheduling accounts for the quality gains? How does H-DMD compare with head-only assembly when gradient coverage and training budgets are matched?