- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes VeloCache, a training-free caching method for video diffusion models acceleration. It reuses low-frequency velocity while extrapolating high-frequency components from previous steps to improve the generation quality. The authors conduct extensive experiments to demonstrate its efficiency and generation fidelity.
Critical strengths
- The paper is well organized and easy to read, and the motivation is clear.
- The paper provides a direct and lightweight way to utilize the frequency information in video generation to accelerate inference. Decoupling the low and high components shows some insights for the following works.
Critical weaknesses
- The benefits of frequency-aware caching are still unclear. As shown in Table 3, the "whole output" achieves a significant improvement in LPIPS over "direct replay" in Wan 2.1 results, which calls into question the benefits of frequency-aware extrapolation. The "interval-scaled" setting beats VeloCache in the Cogvideo. These results raise questions about the general effectiveness of the proposed fixed-gain frequency-aware design.
- Lacking important metrics for video quality: SSIM and PSNR. The paper heavily relies on LPIPS for ablation studies. However, LPIPS only indicates the frame-wise perceptual distance between the target and the original video. Almost all previous works cited by the paper utilize SSIM and PSNR as important metrics. A more comprehensive evaluation would help clarify.
Questions for authors
The proposed method only applies frequency filtering along the spatial dimensions. Could incorporating temporal-frequency information further improve the caching strategy, particularly in terms of motion consistency and video quality?