- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes WATCH, an Acquire–Retain–Halt framework for budgeted active visual perception and bounded visual memory in multimodal large language models (MLLMs). The method adaptively selects visual observations, maintains a compressed persistent visual memory, and learns when to stop further perception. However, I find the paper difficult to understand, inadequately presented, experimentally insufficient to support its central claims, and weak in methodological novelty.
Critical strengths
- This paper follows a standard structure, with the method, experiments, and additional analyses presented in separate sections.
- The framework is technically complete. WATCH integrates adaptive acquisition, bounded memory, and stopping into a unified inference loop, while explicitly enforcing observation and memory budgets.
- The paper provides substantial implementation and reproducibility details. The authors include training procedures, ablations, statistical analysis, and an anonymized code release.
Critical weaknesses
-
The paper is extremely difficult to read and understand. The paper introduces many unusually complicated concepts within a short main paper, such as geometry-aware redundancy resolution, budget-feasible view allocation, and coverage-aware memory control. Even after carefully reading the paper, these unique and complex terms remain difficult to interpret. Moreover, the paper spends substantial space describing technical procedures and notation, but provides insufficient intuitive explanation of the overall method. There is only a very vague method figure but without any detailed explanations. Furthermore, the paper does not clearly decompose the method or explain which component constitutes the core contribution and why all of this machinery is necessary.
-
The presentation of the main experimental results is insufficient and deliberately conceals some findings. The main paper provides very limited experimental results, with only two tables. More importantly, Table 1 covers six image benchmarks, but it reports individual scores for only four benchmarks. The authors deliberately combine the results for the remaining two, RealWorldQA and MMMU, into a single “Gen.” score by averaging them, without explaining why these two benchmarks are treated differently. This selective aggregation obscures more meaningful differences between the two datasets. Furthermore, the score label “Gen.” is potentially misleading, as it could easily be interpreted as a generation-related (e.g. "generation length") metric rather than an aggregated performance score. It is unclear why this abbreviation is used to denote the average of RealWorldQA and MMMU.
-
The novelty of the core idea is limited. The central idea of WATCH appears closely related to existing approaches with several recent works [1-4]. These studies have already explored highly similar directions involving adaptive visual acquisition, iterative perception, and adaptative stopping or feedback mechanisms. In WATCH, these ideas are instantiated as an Acquire–Retain–Halt loop: the model selects a visual view, updates memory, and decides whether to continue or stop. Therefore, it is unclear what fundamentally new methodological insight WATCH introduces beyond integrating these existing ideas into a unified framework.
-
The experimental setup does not sufficiently support the paper’s claims about multimodal reasoning. The evaluation is mainly based on Qwen2.5-VL-7B-Instruct. Given that the paper frames WATCH as a method for efficient multimodal reasoning, the lack of evaluation on reasoning-oriented multimodal models (e.g., Qwen3-VL-Thinking series models) makes it difficult to assess whether the proposed framework generalizes to stronger reasoning settings.
-
The comparison with stronger and more advanced baselines is insufficient. Many closely related recent methods [1-6] are not directly compared in the main results. Since WATCH is closely related to prior work, these recent methods should also be included as baselines for comparison. Given the broad claims of the paper, stronger comparisons with these recent approaches are necessary.
[1] Question-guided Visual Compression with Memory Feedback for Long-Term Video Understanding. CVPR 2026.
[2] Native Active Perception as Reasoning for Omni-Modal Understanding. ICML 2026.
[3] Active Video Perception: Iterative Evidence Seeking for Agentic Long Video Understanding. CVPR 2026.
[4] LensWalk: Agentic Video Understanding by Planning How You See in Videos. CVPR 2026.
[5] Nüwa: Mending the Spatial Integrity Torn by VLM Token Pruning. ICLR 2026.
[6] MMTok: Multimodal Coverage Maximization for Efficient Inference of VLMs. ICLR 2026.
Questions for authors
see weakness