- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
HorizonKV is a training-free system for long-horizon autoregressive video diffusion. It combines CPU–GPU KV storage, overlapping data transfers with computation, and residency-aware sparse attention to retain access to the full history while improving inference efficiency.
Critical strengths
- The paper addresses a valuable problem: retaining access to the full KV history in autoregressive video generation through joint algorithm and system design.
- The analyses of memory growth, transfer overhead, and execution costs provide practical insights for deployment (Sections 3 and 5.4, Appendix E).
- The paper is well written and easy to follow, with clear motivation and an accessible presentation of the system.
Critical weaknesses
- The proposed efficient attention execution assumes that all queries within a chunk share the same selected historical frames within each head. Has this assumption been evaluated through comparative experiments? Would allowing different queries to select different historical frames improve generation quality?
- The frame-then-block sparse attention design closely resembles Light Forcing [1], which also retrieves relevant frames before selecting important blocks. The paper should clarify the algorithmic novelty beyond this existing hierarchy, distinguishing it from the contributions in offloading, overlap scheduling, and residency-aware adaptation (Section 4, Appendix E).
- The qualitative examples focus on continuous single-shot videos (Appendix D, Figures 15–17), and no dedicated multi-shot evaluation is reported. How does HorizonKV perform across shot changes or prompt switches, where relevant history and cache locality may change substantially?
- The reliability of the 120-second Self Forcing results in Table 1 needs further justification, as the original model exhibits quality degradation when extrapolating substantially beyond its training duration. Furthermore, quantitative quality evaluation relies solely on VBench. Could the authors report additional assessments, such as VisionReward [2] scores or human preference results, to better substantiate the claimed long-video generation quality?
[1] Chengtao Lv et al. Light Forcing: Accelerating Autoregressive Video Diffusion via Sparse Attention. arXiv preprint arXiv:2602.04789, 2026.
[2] Jiazheng Xu et al. VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(13): 11269–11277, 2026.
Questions for authors
See Weaknesses
Thank you for the detailed rebuttal, which addresses most of my concerns. However, my main concern about the benefit of full-history retrieval remains.
In Table 1, HorizonKV-GPU already achieves most of the quality gain and a slightly higher speedup, while full-history retrieval adds only 0.72–0.75 VBench points at a small latency cost. Figure 13 shows that this gap remains below one point even at 180 s. Although the new quantitative multi-shot results are encouraging, they lack uncertainty estimates and comparisons with other baselines, and are evaluated on only one backbone. Furthermore, the 14B experiment, where offloading should matter most, does not include HorizonKV-GPU, making it difficult to isolate the benefit of full-history retrieval.
While the revision strengthens the paper, I remain unconvinced that the magnitude and generality of the benefit from full-history retrieval have been sufficiently established. I will therefore maintain my score.