- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes RelayVSR, a streaming video super-resolution framework based on large–small model collaboration. A large generative model restores sparse keyframes, while a lightweight Dual-Memory Video Transformer propagates their information to the remaining frames using persistent reference memory and rolling video memory. The authors further introduce Video-Aware Reference Optimization (VARO), which optimizes the large model using both reference-level and system-level rewards. Experiments demonstrate competitive restoration quality and improved inference efficiency over existing generative VSR methods.
Critical strengths
- Practical and interesting motivation. The paper explores sparse invocation of a large generative model combined with lightweight temporal propagation, offering a promising direction for efficient generative VSR.
- Comprehensive experimental validation. The paper includes comparisons with recent VSR methods, component ablations, quality-efficiency trade-offs, long-video evaluations, and a subjective user study. The provided video demonstrations further support the practical effectiveness of the proposed framework.
Critical weaknesses
- RelayVSR uses a fixed keyframe interval regardless of motion complexity or scene dynamics. Since videos may exhibit significantly different motion patterns, this fixed strategy may limit restoration quality and the quality-efficiency trade-off across diverse scenarios.
- VARO directly optimizes perceptual metrics such as MUSIQ and DOVER++, while the same or closely related metrics are used for final evaluation. This raises concerns about metric overfitting and potential evaluation bias.
Questions for authors
Can the authors provide more details about the approximately 0.5M videos and 1M images used for training (e.g., sources, preprocessing and procedures, quality, and public availability)? Given the substantial scale of the training data, clarifying its contribution to the reported performance and ensuring reproducibility would be valuable.
General Response
We are delighted that all three reviewers have given positive ratings. We sincerely thank all reviewers for their thoughtful and constructive feedback. We are encouraged by their recognition of RelayVSR’s practical efficiency, competitive video quality, and comprehensive evaluation.
In our revised manuscript, we have incorporated additional experiments, analyses, and implementation details to further strengthen our work. Below, we summarize our core contributions and the main updates included in the revision.
Core Contributions of Our Work
Updates in the Revised Manuscript
We believe these additions and clarifications address the reviewers’ concerns and further strengthen our manuscript. Revisions are highlighted in
dark-redtext for ease of reference.