- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CASE, a cost-aware stopping framework for long-video agents that learns when to terminate evidence acquisition. It trains a lightweight Ridge regressor using answer-option probabilities, agent execution states, and cost-aware supervision derived from complete trajectories. Experiments across two video agents, three VLMs, and three benchmarks demonstrate substantial token savings with competitive accuracy, including encouraging zero-shot cross-benchmark transfer results.
Critical strengths
-
Practical significance and clear motivation. The paper addresses an important and practical problem in long-video agents: deciding when further evidence acquisition is no longer worth its computational cost. The motivation is clear, and the proposed cost-aware stopping formulation is intuitive and effective, offering a principled alternative to heuristic stopping rules based on confidence or fixed budgets.
-
Strong efficiency gains and cross-benchmark generalization. CASE achieves substantial computational savings across multiple video agents and VLM backbones without modifying their underlying search policies. The zero-shot transfer results on LongVideoBench and MLVU are encouraging, suggesting that the learned stopping policies can generalize across benchmark distributions. The online experiments further demonstrate meaningful reductions in actual inference latency.
Critical weaknesses
-
Limited applicability beyond closed-ended video QA. The proposed method is designed specifically for multiple-choice video QA, relying on answer-option probabilities and a constrained prefix finalizer. It is unclear how this framework could be extended to open-ended video understanding or more general video-agent tasks, where answer correctness and evidence sufficiency are harder to assess. This limits the general applicability of the proposed approach.
-
Limited advantage under matched computation budgets. Although CASE achieves strong Pareto-frontier coverage at its selected operating points, the common-budget comparisons in Table 17 show little improvement over simpler baselines such as tuned token budgets and Forward-Q. In several settings, these baselines achieve comparable or better accuracy with similar computational savings. This raises questions about how much benefit the proposed cost-aware learning objective provides beyond selecting a more aggressive stopping threshold.
Questions for authors
- Benefit over simpler stopping baselines: Table 17 shows that CASE does not consistently outperform simpler approaches, particularly tuned token budgets, under comparable computational budgets. Could the authors clarify what practical advantage the proposed cost-aware learning objective provides beyond threshold tuning? An analysis of when CASE makes better stopping decisions than these simpler baselines would help establish its contribution.