- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies the joint design of historical context, execution scheduling, and training in streaming video diffusion. It introduces a framework that distinguishes historical noise-state selection, attention visibility, context representations, training-state sources, and supervision objectives. Three representative policies—clean, same-level, and progressive history—are used to examine how historical conditioning determines dependencies between video chunks and the feasibility of pipelined denoising. The authors adapt a shared autoregressive video model to these policies through video-level distribution matching distillation. They also investigate LoRA adaptation of the auxiliary fake-score network, treating its parameterization as a separate training choice alongside the history policy.
Critical strengths
-
A useful distinction between modeling choices and execution constraints. The framework clearly separates which historical noise states are selected from which token representations are visible to attention. It also distinguishes matching noise levels from matching the source and distribution of historical states. These distinctions are relevant to understanding training–inference consistency. The scheduling discussion correctly separates the number of sequential rounds from the total number of denoising updates and explicitly conditions the ideal pipeline schedule on sufficient concurrency and feature availability.
-
Several meaningful experimental controls and transparent reporting. The three LoRA policy variants share initialization, training data, backbone, chunking, and a four-step sampling setup. Evaluation uses matched prompts and generation seeds, and all 16 VBench dimensions are reported. The authors acknowledge tradeoffs between motion, consistency, and appearance rather than claiming uniform improvement. They also explicitly delimit the timing measurements and include communication and cache operations.
-
Useful findings about history selection. With fake-score LoRA, same-level history maintains aggregate quality comparable to clean history, while progressive history achieves the best aggregate quality and supports faster pipelined execution. Clean history performs better on several consistency metrics, revealing a practical tradeoff between motion dynamics, consistency, and efficiency.
-
Promising results from fake-score LoRA adaptation. Under both clean and progressive history, LoRA adaptation yields better reported student generation quality than full-parameter fake-score updates while training substantially fewer auxiliary parameters. This suggests that limiting fake-score adaptation capacity can be beneficial in the evaluated setting.
Critical weaknesses
-
Limited incremental contribution. The framework primarily organizes established ideas in noisy-history conditioning, distillation, and pipelined denoising. While this organization is useful, the paper does not establish a substantial methodological advance or sufficiently generalizable empirical insight. Its added value over closely related approaches, including Rolling Forcing and Causal-rCM, remains insufficiently demonstrated.
-
Limited support for the central quality claims. The evaluation covers one backbone and a fixed sampling configuration, while long-video improvements rely on qualitative examples. Higher dynamic degree does not establish more coherent motion, and clean history remains stronger on several consistency metrics. Quantitative long-video evaluation and broader validation are needed to establish when the proposed policies are preferable.
-
Underspecified construction of historical context. The training recipe uses random early exit, but it does not explain how progressive history obtains the required cleaner historical states when those denoising levels have not been visited. The corresponding KV construction and refresh rules are also unclear. These details are central to reproducing the method and verifying the framework's stated training–inference alignment.
Questions for authors
-
What substantive new insight does the framework establish beyond existing noisy-history and pipelined methods? Can matched comparisons with Rolling Forcing and Causal-rCM clarify its added value?
-
Do the claimed improvements in long-video consistency and motion coherence hold in quantitative or blinded human evaluations, and across different backbones or sampling configurations?
-
How does random early exit interact with progressive history, particularly if requested intermediate noise levels are not visited? How are the corresponding historical states and KV representations constructed? Please provide pseudocode for state construction, cache refresh, and replay that clarifies how effective conditioning is aligned between training and inference.