- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Memory Forcing, a few-step streaming video generation framework designed to address mid-horizon forgetting in autoregressive diffusion models. Built upon Rolling Forcing, the method introduces Archive & Working Banks to preserve intermediate historical information within a bounded KV cache, and Bank-aware RoPE to dynamically assign temporal positions to different memory banks. Experiments on Wan2.1-1.3B and Wan2.2-5B demonstrate improved long-horizon generation quality and stability across multiple benchmarks and video durations.
Critical strengths
- Practical and efficient memory design. The proposed memory mechanism preserves intermediate historical information within a fixed KV-cache budget, providing a practical approach to improving long-range consistency without unbounded memory growth.
Critical weaknesses
- Limited methodological novelty. The proposed three-bank memory organization and Bank-aware RoPE share similar ideas with recent or concurrent works such as MemRoPE[1], Anchor Forcing[2], and Rolling Sink[3]. Although the specific implementation differs, the main contributions appear to be incremental extensions of existing memory management and positional encoding strategies. The paper could better clarify its distinctive technical contributions relative to these closely related approaches.
- Limitations of the memory selection strategy. The proposed similarity-based eviction relies on a local comparison between working-memory chunks and the incoming chunk, rather than their relevance to future queries. Consequently, historically important information may be permanently discarded, while less useful content is retained. Moreover, the archive uses FIFO eviction once full, which may further undermine long-term memory retention. This raises concerns about whether the proposed strategy can reliably preserve important events over extended video generation.
- The paper's title appears incomplete, as "Few-Step Streaming Video Generation" would more accurately describe the task. Moreover, the qualitative visualizations are limited and lack sufficiently detailed comparisons to convincingly demonstrate long-term consistency.
[1] Kim, Youngrae, et al. "MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokens." In ECCV, 2026.
[2] Yang, Yang, et al. "Anchor Forcing: Anchor Memory and Tri-Region RoPE for Interactive Streaming Video Diffusion." In ECCV, 2026.
[3] Li, Haodong, et al. "Rolling Sink: Bridging Limited-Horizon Training and Open-Ended Testing in Autoregressive Video Diffusion." arXiv preprint arXiv:2602.07775, 2026.
Questions for authors
- Can the authors further clarify the novelty and distinctive contributions of Memory Forcing compared with prior works?
- How does the similarity-based eviction strategy ensure that important historical information is preserved, given that current similarity does not necessarily reflect its relevance to future queries?