- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper addresses the continuously growing attention overhead brought by KV‑cache in long‑horizon generation of autoregressive video diffusion models, and proposes A²R (Anchored and Adaptive Reusable Attention), a training‑free sparse‑attention framework. It consists of three core components: (1) Anchored dense‑to‑sparse transition: the first video chunk is kept as a dense visual anchor to avoid corruption of scene layout and object identity; (2) Per‑head adaptive block routing: dynamically selects KV blocks to retain based on a relevance threshold instead of adopting a fixed Top‑K sparsity ratio; (3) Reusable sparse routing patterns across denoising steps: routing is only refreshed at the final denoising step to reduce computation, leveraging the stable routing structure observed among intermediate denoising steps. The authors conduct experiments on autoregressive video diffusion models and demonstrate that A²R substantially reduces inference overhead for long‑horizon video generation while preserving generation quality.
Critical strengths
This paper identifies two unique properties of autoregressive video diffusion: head‑wise sparsity heterogeneity and stable routing across intermediate denoising steps. These serve as key insights distinguishing this work from sparse‑attention solutions originally designed for LLMs. The motivations are well‑aligned with the chunk‑wise rollout nature of autoregressive video generation, rather than a naive transfer of existing LLM sparse‑attention techniques to video diffusion.
The entire framework is training‑free and operates purely at inference time without requiring model fine‑tuning. Equipped with an exact Triton‑based sparse‑attention kernel, the attention computation itself introduces no approximation even when pruning KV blocks. It achieves considerable reduction of KV‑cache overhead for long sequences with manageable degradation in video quality.
Critical weaknesses
Key quality evaluation metrics could be further strengthened: the full set of VBench metrics is not reported, and additional benchmarks could be supplemented.
Questions for authors
- How are finetune‑aware sparse baselines such as SLA implemented in your experimental comparisons?
- Could you add experimental results on more targeted benchmarks such as VBench‑long?