- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces Clean Forcing, a learned correction for drift in autoregressive video diffusion with a frozen base. It compares the base model's velocity predictions under clean and generated histories at the same noisy state, then trains a small LoRA corrector to match the clean-history prediction. DAgger-style data aggregation and a next-chunk drift-contraction loss expose the corrector to its own generated states. Experiments report substantial improvements in quality and drift on a causally adapted Wan2.1-1.3B base, with additional scaling and transfer studies.
Critical strengths
- A clear motivation to directly reduce accumulated errors. The paper aims to explicitly correct prediction errors caused by self-generated history, using predictions conditioned on reference history as supervision. This is an intuitive and appealing direction for addressing error accumulation in autoregressive video generation.
Critical weaknesses
-
The training objective does not isolate error accumulation. The objective minimizes the difference between predicted velocities conditioned on self-generated history and pre-generated reference history. However, these histories can differ in semantic content and motion, even when they share the same starting point and caption. Their velocity difference therefore reflects both accumulated errors and legitimate differences between possible continuations. Matching the reference-history prediction may consequently penalize valid semantic or motion variation. This also raises a concern that the objective could favor near-static continuations that limit divergence from the reference, rather than correcting errors while preserving scene progression.
-
Visible artifacts and missing long-video baselines Horizontal line artifacts are visible in some frames generated by the proposed method in Figure 4, suggesting that substantial visual artifacts remain despite the improvement in drift scores. The paper also does not include experimental comparisons with relevant long-video generation baselines such as LongLive and Rolling Forcing.
Questions for authors
-
How do the authors distinguish velocity differences caused by accumulated errors from those caused by legitimate semantic or motion differences between the generated and reference histories? Could controlled experiments test whether the objective penalizes valid scene progression or encourages near-static continuations?
-
What causes the horizontal line artifacts visible in Figure 4, and can they be reduced without sacrificing drift resistance? Could the authors compare against LongLive and Rolling Forcing under matched evaluation settings, reporting visual quality, temporal coherence, and drift?