- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents StreamWeave, a training-free framework for streaming video question answering using only observations available when each question arrives. It combines a recent glance, a broader look-back, and on-demand historical retrieval within a bounded visual context. Its main contributions are a coverage-aware visual history with searchable visual keys and source-frame links, visual-encoder-based filtering of redundant recent frames, and model-directed retrieval of original historical frames without relying on pre-generated event descriptions for indexing. A frozen multimodal large language model either answers from the initial context or requests additional evidence for subsequent reasoning. The authors evaluate five frozen models on OVO-Bench, StreamingBench Real-time, and OVBench, using at most 44 images per model call. Compared with model-matched 44-frame uniform-sampling baselines, overall scores improve for all five models on the first two benchmarks and four on OVBench. Validation includes component ablations, matched-frame temporal-layout comparisons, and historical-frame selection experiments with fixed tool decisions and image counts, alongside an analysis of the accuracy–resource trade-off between adaptive and unconditional retrieval.
Critical strengths
- Consistent improvements across models and benchmarks. StreamWeave improves overall accuracy over model-matched uniform-sampling baselines across most settings, including all five models on OVO-Bench and StreamingBench Real-time. This supports the practical value of the framework.
- Useful component-level analysis. The paper includes ablations on temporal coverage, frame selection, and historical retrieval. Some comparisons control for frame counts and model calls, providing evidence that the improvements are not solely due to additional visual inputs.
Critical weaknesses
- Limited novelty over existing methods. The overall framework overlaps with prior streaming-video memory systems, including OASIS (Liang et al., 2026; https://arxiv.org/abs/2604.17052), EventMemAgent (Wen et al., 2026; https://arxiv.org/abs/2602.15329), and Visual Agentic Memory (Li et al., 2026; https://arxiv.org/abs/2605.16481). StreamWeave introduces visual-key retrieval, coverage-aware record updates, and a multi-timescale context. However, while the paper provides useful ablations, it lacks direct comparisons with the corresponding mechanisms in closely related methods under comparable settings. The incremental benefits of these design choices therefore remain insufficiently established.
- Insufficient control of inference cost. While the paper includes comparisons with matched model calls and image counts, these are limited to specific components. The full framework is not evaluated against the main baselines under matched total inference budgets, making it difficult to separate the benefits of evidence selection from those of additional inference.
Questions for authors
- Technical contribution: The paper describes visual-key indexing and coverage aggregation. How do these differ from the corresponding mechanisms in OASIS and VAM, and what evidence supports their added value beyond the within-framework ablations?
- Inference cost: Beyond the controlled comparison in Table 7, could you report the main configuration’s per-question token usage and latency, with shared indexing costs listed separately? Could a budget-matched comparison with the 44-frame baseline clarify how much of the gain comes from evidence selection rather than extra reasoning?
Summary of Rebuttal
We sincerely thank the Program Chairs, Area Chairs, and all reviewers for their time, effort, and constructive feedback. We are encouraged by the reviewers’ recognition of our paper’s strengths and their positive feedback on our targeted additional experiments. Our goal in this rebuttal revision is to strengthen the paper and improve confidence in its results.
Strengths recognized by the reviewers
Questions raised and our responses
To this end, our final revision will include the following updates:
We hope these clarifications and additional results address the concerns raised and strengthen confidence in StreamWeave’s methodological contribution and practical value. We sincerely appreciate the reviewers’ constructive engagement and welcome further questions and suggestions.
Thank you, the authors of submission #3337