- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces DeltaStreamer, an agent-based framework for streaming video understanding. Specifically, before a question arrives, a vision-language model compares adjacent frames and writes structured observation reports, explicitly recording frame-to-frame deltas while filtering out redundant descriptions. These observations feed a traceable three-layer memory (working, episodic, and long-term pins) built as a DAG, with entity indexes and source pointers linking back to original frames. After a question arrives, a planner parses what the question really needs and creates an evidence contract, guiding memory retrieval. The agent can then replay historical frames to verify pixel-level details and uses a conflict verifier plus tools like SAM 2 and Whisper to correct errors. Experiments are conducted using Qwen3.6-27B as the backbone on OVO-Bench and StreamingBench datasets.
Critical strengths
- The article has a clear motivation, and both the writing and framework are well organized.
- The ablation studies demonstrate the effectiveness of each component.
Critical weaknesses
- Existing streaming video agents already include components such as memory, plan, and verify. This paper mainly adds direct inter-frame change recording, which makes the claimed innovation appear rather limited.
- The superiority of the proposed method is not demonstrated. The authors should explain why some results are missing for the limited open-source online MLLMs. Moreover, many of these models achieve higher results than the proposed method, yet these are not highlighted in bold in the tables. In addition, compared with prior agent work, the backbone models used are different, so comparisons should at least be conducted under the same backbone model.
- The compared baselines are outdated and insufficient. The proprietary MLLMs compared are all roughly two years old, which is too dated. The open-source offline MLLMs compared are either relatively small (7B–8B) or relatively old (only one Qwen2-VL-72B), and even the backbone model used in this paper, Qwen3.6-27B, is not compared. There are also many inconsistencies in method names between Table 1 and Table 2 (e.g., "human agents" in Table 1 vs. "human" in Table 2; gemini-3-flash appears in Table 1 but not in Table 2).
- Latency is not evaluated. Latency is critical for streaming video reasoning, yet the paper does not compare it.
Questions for authors
Please refer to the weaknesses.