- Rating
- 2(−1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Historical Trajectory Guidance (TGuide), a feature-prediction framework for further accelerating few-step autoregressive video diffusion models. The paper observes that four-step video diffusion models obtained through step distillation exhibit substantial feature changes between adjacent denoising timesteps, which makes direct feature reuse and lightweight prediction prone to large errors. In contrast, features from adjacent video chunks remain strongly correlated at matching denoising timesteps. Based on this observation, TGuide introduces two complementary ways of exploiting features: it uses features from the preceding denoising step of the current video chunk to preserve the spatial structure of the current content, while retrieving spatially corresponding information from the previous video chunk at the same denoising timestep. To mitigate the accumulation of prediction errors across both denoising steps and video chunks, the authors further employ self-rollout on-policy distillation, training the predictor on states induced by its own historical predictions.
Critical strengths
-
The paper is well motivated, with a clear correspondence between its central observation and method design. The paper first analyzes the decline in cross-timestep feature correlation in four-step distilled models and then cleverly exploits the feature correlation between adjacent video chunks at matching denoising timesteps to achieve acceleration. The three components of ATC respectively address the preservation of current content, spatial correspondence across video chunks, and the reliability of historical information, making the overall design intuitive and easy to understand.
-
The experimental evaluation is relatively comprehensive and specifically examines error accumulation in long-video generation. The paper evaluates the proposed method on three autoregressive video generation models and across both text-to-video generation and camera-controlled image-to-video generation. It reports a broad set of metrics, including VBench, PSNR, SSIM, LPIPS, FLOPs, and measured latency.
Critical weaknesses
-
The experiments lack direct comparisons with the most relevant cross-chunk caching methods. The main innovation of TGuide is its use of historical features from the previous video chunk at the same denoising timestep. However, the paper does not empirically compare TGuide with recent methods such as C3ache and X-Cache, which also exploit historical information across video chunks. Moreover, the DisCa results in the tables are based on the authors’ own reimplementation rather than an official implementation, making it difficult to reliably judge the relative performance of these methods. As a result, it remains unclear how much TGuide actually improves over existing cross-chunk caching approaches, and the claimed acceleration advantage is therefore difficult to assess conclusively.
-
The quality improvement is relatively small. This is a minor issue rather than my primary concern, but I would still appreciate further clarification from the authors. In the most important 333-frame Self Forcing experiment, TGuide achieves a VBench Total Score of 82.71, compared with 82.55 for the original four-step model, corresponding to an improvement of only 0.16 points. In the 81-frame setting, TGuide scores 84.23, which is slightly lower than the original model’s 84.28. It is unclear whether the reduction in full denoising computation introduces a loss in generation quality. If the acceleration is achieved only at the cost of a meaningful quality degradation, the practical value of reducing the denoising computation would be limited.
Questions for authors
-
Could the authors provide direct comparisons with C3ache, X-Cache, or stronger cross-chunk direct-reuse baselines?
-
Historical features may become unreliable in the presence of rapid motion, abrupt scene transitions, large viewpoint changes, or newly appearing objects. Could the authors report results grouped by motion magnitude or degree of scene change, and analyze whether ATC’s token-wise gate can identify and suppress unreliable historical information in these failure cases?
I appreciate the authors’ response and their thoughtful answers to my questions. However, the idea of leveraging cross-chunk information for acceleration has been explored in prior work, and the improvements over X-Cache and C3ache appear relatively limited. Regarding Q2 and Q3, I would still like to see visual comparisons of the generated videos. In particular, I remain uncertain whether action fidelity, especially for large-scale motions, can be preserved under acceleration. Therefore, I would like to maintain my original score.