- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes EviStream, a training-free proactive streaming assistant built on frozen Qwen3-VL and streaming ASR. It keeps a bounded sliding KV cache of recent evidence, decodes grammar-constrained per-frame labels in a temporary branch, and updates a persistent task state with a hand-written reducer.
Critical strengths
- The problem is well motivated, and the different clocks are carefully separated.
Critical weaknesses
- Generality is a major concern. The task compiler relies on hand-written rules that look tuned to StreamArena Pro wording (e.g., "next" plus "product", "actual eating rather than food preparation", Appendix B), and all results are on the same 774 questions with one backbone. I suggest the authors explain how the rules were built and evaluate on a held-out split or another proactive benchmark (e.g., OVO-Bench, StreamingBench).
- The ablations do not support the claim that persistent task state is what matters. Only 27 questions are change/reappearance, where the full method gets 3 vs. 1 without S. Most of the drop without S comes from single-label event questions, and the no-notification rate jumps from 27.0% to 63.3% without explanation. I suggest the authors separate the cursor reset from the progress reset.
- Weak experimental comparison. Window-Qwen gives no notification on 85.1% of questions, JoyAI scores 0.0, and the control responses seem to be scored differently from EviStream (Appendix C.1). A same-backbone baseline with the same compiled prompt and the same scoring pipeline for all rows is needed. The paper should also discuss closely related proactive streaming methods such as Dispider [*1] (which also separates perception, decision and reaction) and VideoLLM-online [*2].
[*1] Rui Qian et al. Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction. CVPR 2025. [*2] Joya Chen et al. VideoLLM-online: Online Video Large Language Model for Streaming Video. CVPR 2024.
Questions for authors
As in weakness.