- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces StreamReal, a method designed to switch subjects based on new reference images during streaming video generation while maintaining scene and temporal continuity. The approach adapts existing autoregressive video models to incorporate reference image conditioning and employs Memory Flow to establish historical indexing between the subject and the background, selectively masking cache entries related to the old subject during the switch. Experimental results demonstrate that this method improves reference consistency for new subjects and mitigates the loss of continuity typically caused by clearing historical data.
Critical strengths
- MF is reasonably designed: maintaining separate subject and background memory summaries supports selective suppression of outdated subject information and appears helpful in reducing interference from redundant history.
- The semantic index is decoupled from the native KV cache. MF organizes historical information, while MHR controls access during subject switching, providing a modular design that integrates with existing causal generators.
- The progressive training pipeline—FCA followed by DMD adaptation to self-generated histories—is coherent, addressing reference-conditioning alignment and the mismatch between training and inference histories.
Critical weaknesses
-
No video demos are included in the provided supplementary material. For a video generation paper, demonstrations are essential for assessing visual quality, temporal continuity, and the effectiveness of subject switching. The authors should provide representative examples, including failure cases.
-
The meaning and practical motivation of “subject switching” require further clarification. Introducing or removing subjects during an ongoing rollout seems useful for customized generation. However, it is less clear when users would need to replace an existing subject while preserving the ongoing scene, and how this differs from a video editing task. The authors should clarify the task definition and provide concrete use cases in L52–L61.
-
Several relevant works on video customization and streaming video editing are missing from the discussion:
- [1] Li W, Zhang Y, Long F, et al. ReactID: Synchronizing Realistic Actions and Identity in Personalized Video Generation. ICLR, 2026: 62463–62485.
- [2] Xu X, Li Y, You S, et al. Smrabooth: Subject and Motion Representation Alignment for Customized Video Generation. CVPR, 2026: 16130–16141.
- [3] Deng Y, Yin Y, Guo X, et al. MagRef: Masked Guidance for Any-Reference Video Generation with Subject Disentanglement. arXiv:2505.23742, 2025.
- [4] Wang X, Zhao C, Zhan F, et al. LiveEdit: Towards Real-Time Diffusion-Based Streaming Video Editing. ECCV, 2026: 631–649.
The authors should discuss the methodological relationships and differences between their approach and [1]–[3]. An experimental comparison with [4] would also be valuable where the task settings are compatible; otherwise, the differences should be explicitly explained.
-
The writing is somewhat disorganized. The introduction would benefit from a concise overview of the training and inference workflows and a clearer statement of the core contributions. Figure 3 is overly complex, making the methodological rationale difficult to follow and giving the impression of a collection of engineering components rather than a clearly motivated framework. Terminology should also be consistent: “Few-Step Conditioning Alignment” in L198 is referred to as “Few-Step Alignment” in Figure 3.
-
The authors should quantitatively evaluate the accuracy of MF’s predicted token labels. In particular, they should demonstrate whether reliably captures historical relevance and subject association, and whether the resulting subject labels align with actual subject regions. The computational and memory overhead of MF should also be reported through a controlled comparison with and without the module, including its effect on generation latency during ordinary rollout and subject switching.
Questions for authors
I hope the author can address the weaknesses I raised above.