- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents Visual Agentic Memory (VAM), a training-free framework for online long-video understanding. VAM consists of three components: Online Indexing, which selectively retains frames using visual filtering and adaptive similarity thresholds; Hierarchical Memory, which organizes temporal event summaries and retrievable visual observations; and Agentic Retrieval, which iteratively searches and inspects relevant evidence to answer questions.
Critical strengths
- The paper addresses an important challenge in online long-video understanding, particularly maintaining searchable visual evidence over extended temporal horizons.
- The combination of online indexing, hierarchical memory, and agentic retrieval is intuitive and reasonably well presented.
- The experiments include both online video understanding and month-scale memory retrieval, demonstrating the potential practical applicability of the proposed system.
Critical weaknesses
- The proposed framework primarily combines existing techniques for visual filtering, hierarchical memory construction, and agentic evidence retrieval. In particular, VideoAgent (ECCV 2024) already explores structured multimodal memory and tool-based video inspection; WorldMM (CVPR 2026) combines textual and visual memories with adaptive retrieval; and VideoARM (CVPR 2026) performs agentic reasoning over hierarchical video memory.
- VAM's adaptive thresholding is closely related to the Otsu-based mechanisms explored in FluxMem (CVPR 2026). Although VAM integrates these components for online indexing and evidence preservation, the paper does not sufficiently establish a distinctive algorithmic contribution beyond their combination.
- Despite introducing three major components, the paper does not provide sufficient controlled ablations to establish their individual contributions. Without these experiments, it is difficult to determine whether the reported performance originates from the proposed memory architecture or simply from the underlying multimodal models and repeated inference.
- On MM-Lifelong, VAM achieves 17.11% accuracy, slightly below ReMA's 17.62%, while its Ref@300 is considerably lower (3.65% versus 9.91%). This raises concerns about the effectiveness of the proposed temporal localization mechanism.
- The system introduces multiple processing stages, including visual embeddings, event summarization, hierarchical indexing, and iterative multimodal inference. However, the paper provides limited quantitative analysis of online indexing throughput, end-to-end query latency, model calls, storage overhead, and computational costs. Since efficient continuous operation is a central motivation, these measurements are important for establishing practical scalability
Questions for authors
- What is the fundamental algorithmic contribution of VAM beyond combining established online filtering, hierarchical memory, and agentic retrieval techniques?
- Could the authors report controlled ablations for Online Indexing, Hierarchical Memory, and Agentic Retrieval?
- Why does VAM improve the RT+BT average while decreasing both Backward Tracing and overall accuracy relative to Gemini 3 Flash?