- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies KV-cache construction in autoregressive video diffusion. It proposes Local Forcing, which retains historical attention during denoising but restricts cache construction to the current completed block. The same attention rule is incorporated into teacher forcing, consistency distillation, self-rollout distillation, and inference. Experiments evaluate its effect on long-video quality, its compatibility with existing training frameworks and inference methods, and the influence of cache-construction locality through controlled ablations.
Critical strengths
- The distinction between using history to generate content and using history to encode completed content is well motivated. The intervention is simple, adds no parameters or losses, and preserves the existing cache interface. Importantly, the three-seed locality ablation holds the denoising context fixed and shows that block-local encoding improves over both full-context and sink-isolated encoding (Table 4). This provides useful evidence that the benefit goes beyond excluding sink frames.
- The empirical benefits extend across several settings rather than relying on a single configuration. For Causal Forcing, LF improves Quality Score by 1.53 points at 60 seconds and 2.67 points at 240 seconds, with all seven evaluated dimensions improving at the latter horizon (Tables 2–3). Its compatibility with Deep Forcing, Infinity-RoPE, and MemRoPE further supports its practical value as a component of existing long-video generation systems.
Critical weaknesses
- The methodological novelty is modest. Relative to the sink-exclusion strategy discussed for Rolling Forcing, the main additional change is removing recent-history attention during cache construction and applying this rule consistently across training stages. This is a useful refinement of existing autoregressive diffusion pipelines, but it does not introduce a substantially new modeling or optimization framework. The contribution therefore rests primarily on the insight and the empirical evidence for its usefulness.
- The proposed error-propagation explanation is plausible but less firmly established than the quality improvements. Appendix S10 shows that local cache construction removes direct dependence on historical K/V when the current block is fixed. This establishes locality by construction, but does not show how strongly the removed pathway contributes to drift in the baseline. Since the generated block still depends on history, the current evidence does not clearly distinguish reduced recursive cache contamination from other effects of restricting context during training. This limits the mechanistic conclusion, rather than invalidating the observed gains.
Questions for authors
- Is there a controlled diagnostic showing that perturbations in historical K/V propagate through cache construction and materially affect downstream drift? This would help connect the conditional-locality analysis in Appendix S10 to the proposed explanation for the empirical improvements.
- Could you report quantitative results for the training-rule × inference-rule crossover mentioned in Appendix S11, particularly for appearance drift and block-boundary continuity? This would clarify the respective contributions of local encoding and adaptation to the changed encoding rule.
3 comments
Thank you for the detailed responses and additional experiments. I appreciate the authors' efforts to address my concerns.
The new ablations help further clarify the contribution of Local Forcing beyond existing approaches such as Rolling Forcing. In particular, the historical KV perturbation experiments provide more direct evidence for error propagation through cache construction, while the training/inference crossover experiments help distinguish the benefits of local encoding during inference from those of adapting the model during training. These results strengthen the empirical support for the proposed method and its underlying motivation.
I have also reviewed the authors' responses to the other reviewers and found no additional concerns that would change my overall assessment. While the methodological novelty remains relatively modest, I believe the rebuttal has adequately addressed my main questions and strengthened the paper's experimental justification. Therefore, I will maintain my original score of 3 (Weak Acceptance).
Thank you for recognizing the value of our approach and for taking the time to read both our new results and our responses to the other reviewers. Your feedback helped us clarify how cache construction affects drift, and we’ll make that connection clearer in the next version of the paper.
W1: Contribution relative to Rolling Forcing.
We consider Rolling Forcing as an important relevant work. Its Appendix A describes excluding global context during cache updates while retaining recent context. However, the implications of this choice for long-rollout stability remain underexplored. Representative open-source methods—including Causal Forcing, Reward Forcing, Self Gradient Forcing and training-free methods such as Deep Forcing, Infinity-RoPE, and MemRoPE—continue to use historical context during cache construction without a separate restriction for this pass.
Our contribution is to identify and systematically study the different context requirements of denoising and cache construction. LF preserves historical attention during denoising but restricts cache construction to the completed block. Our controlled diagnostic in Appendix S10 supports historical error transmission through cache construction, providing a mechanistic basis for this separation. The same rule applies across training stages and inference without adding parameters, losses, or forward passes.
The ablations also go beyond sink exclusion: the matched three-seed comparison shows additional Quality gains of 0.41 and 1.19 points at 10 and 20 seconds (Appendix S5.1). The new history-length ablation further shows that zero-history construction achieves the highest Quality at both durations, outperforming one, two, and all available preceding blocks (Appendix S5.2).
W2 / Q1: Historical K/V propagation and downstream drift.
We have added quantitative perturbation experiments to Appendix S10. Using the same Causal Forcing checkpoint and fixed video blocks across six preselected VBench prompts, we perturb only historical K/V with repeated random bias calibrated to VAE round-trip variation. At the final measured block, the newly constructed cache inherits a deviation averaging 0.357 times the injection RMS under native construction (range: 0.329–0.381), versus zero under LF, measured before the current block’s injection. A separate single-injection probe shows that the perturbation persists through subsequent cache updates after the affected block is evicted and influences denoising predictions at identical noisy inputs.
For downstream drift, the Base training / Base inference versus Base training / LF inference comparison in Q2 changes only the cache-construction rule, keeping model weights and denoising attention unchanged. Saturation drift decreases from 0.05140 to 0.02019 (−60.7%). Together, these experiments demonstrate historical perturbation transmission through cache construction and support the benefit of removing this direct dependence during generation, independently of LF training.
Q2: Training-rule × inference-rule crossover.
We use Causal Forcing as the base model and evaluate three combinations (Appendix S11). Appearance drift is the absolute saturation change between the first and last 10 seconds of 60-second videos generated from official VBench Long prompts. Boundary continuity uses VBench’s AMT-based smoothness score at the 13 block boundaries within the first 10 seconds. We focus on this early interval to reduce coupling with accumulated appearance drift.
Inference-only LF substantially reduces appearance drift. Using LF in both training and inference preserves this reduction (61.2% versus the baseline) and alleviates the decrease in boundary smoothness observed with inference-only LF, bringing boundary smoothness back to the baseline level.