- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CIAct, a training-free framework for proactive responses in video MLLMs. It uses lightweight vision-language models to estimate query-frame relevance, applies a decayed CUSUM mechanism to determine when to respond, and introduces a memory replay strategy for efficient answer generation. Experiments are conducted on streaming and offline video understanding benchmarks.
Critical strengths
-
The paper addresses an important challenge in online video understanding, which is enabling existing MLLMs to determine when to respond without additional training. The proposed plug-and-play design is potentially useful for real-time video applications.
-
CIAct combines lightweight relevance estimation, cumulative evidence tracking, and memory replay into a unified framework. The experiments demonstrate promising trade-offs between video observation costs and answer accuracy.
Critical weaknesses
-
The ablation study in Table 3 does not control for the amount of video observed. For example, on LongVideoBench, accuracy increases from 47.5% to 58.3%, while the average viewed fraction increases substantially from 15% to 79%. Therefore, it is unclear whether the gains come from the proposed cumulative information estimation or simply from observing more video content. Moreover, high query-frame relevance does not necessarily indicate that sufficient information is available to answer a question, but the paper lacks a direct evaluation of response timing accuracy.
-
The reported 4.04% improvement on OVO-Bench is relative to the Qwen3-VL backbone, whereas CIAct only outperforms Streamo by 0.20% (55.81% vs. 55.61%) using a different backbone. It also performs worse than Streamo on Forward Active Responding (50.15% vs. 54.77%). In addition, Table 2 shows noticeable accuracy drops on several benchmarks, contradicting the claim of consistently preserving answer quality. Finally, the reported efficiency results do not clearly account for the cost of query-dependent calibration using the 16K frame reference bank. This is particularly concerning for BLIP, whose cross-modal image-text matching requires query-dependent computation for reference frames, unlike SigLIP2, which can reuse precomputed image embeddings. The authors should clarify whether this additional overhead is included in the reported latency.
Questions for authors
Q1. In Table 3, the final CIAct configuration observes substantially more video content than the simpler alternatives (79% vs. 15% on LongVideoBench). How can the authors demonstrate that the improvement comes from the proposed accumulation mechanism rather than the increased observation time?
Q2. The proposed method triggers a response when accumulated query-frame relevance exceeds a threshold. However, high relevance does not necessarily imply that the evidence required to answer a question is complete. How do the authors evaluate whether CIAct triggers responses at appropriate times, particularly for questions requiring multiple events or temporal reasoning?
Q3. In Table 1, CIAct improves over Streamo by only 0.20 points overall, while performing worse on Forward Active Responding (50.15% vs. 54.77%). Considering the differences in backbone models, how do the authors justify the claimed superiority over existing proactive response methods?
Q4. Table 2 shows that CIAct reduces accuracy on several benchmarks, such as the 4.1-point drop on Video-MME with Qwen3-VL and SigLIP2. How should these results be reconciled with the claim that CIAct consistently benefits existing offline MLLMs without sacrificing answer quality?
Q5. The method uses a reference bank containing 16K frames for query-specific calibration. Does the reported response latency include the cost of computing these reference scores, processing historical frames, and generating the final answer? In particular, how is the BLIP-based calibration performed efficiently for previously unseen queries?
Q6. Could the authors carefully review the manuscript for grammatical errors, numerical inconsistencies, and unclear experimental descriptions? For example, "answer ques" (Line 95), "the answer cues can appears" (Line 260), "not need to wach" (Line 297), and "the right time to response" (Lines 453–454) contain obvious language errors. Additionally, the reported 3.6% improvement in Lines 421–423 appears inconsistent with the rounded values in Table 3 (54.6 − 51.1 = 3.5). The authors should also clarify which computational costs are included in Figures 3 and 4 and provide a clearer description of the evaluation protocols used for different baselines.