- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies candidate-frame construction before downstream video-QA frame selection. QUEST scores uniformly initialized observations, weights each temporal interval by normalized endpoint relevance, and repeatedly samples the midpoint of the largest relevance-weighted gap. A one-step minimax argument motivates this rule when interval weights are held fixed. Experiments pair QUEST with four selectors and five VLMs on five benchmarks, primarily at N=128 candidates and K=32 selected frames. The reported average improvement over the corresponding uniform candidate pools is 0.87 percentage points; additional analyses measure evidence coverage, acquisition ablations, and latency.
Critical strengths
-
The paper isolates a useful design decision: which frames become available to a subsequent selector. The relevance-weighted gap rule is simple, training-free, and supported by an explicit fixed-weight one-step argument (Sections 3–4). Reusing the selector’s cached relevance scores makes the construction modular, rather than requiring changes to the downstream VLM or selector.
-
The matched uniform-versus-QUEST comparisons cover five VLMs, four selectors, and five benchmarks (Table 1), and improve every model–selector average, although individual benchmark scores sometimes decrease. The direct candidate-pool evaluations in Appendix D also improve annotated evidence coverage across all three scorers. This combination provides more informative support for the acquisition mechanism than downstream QA accuracy alone.
Critical weaknesses
- The comparison with existing adaptive acquisition does not isolate the proposed acquisition rule. Table 3 compares QUEST averaged over four downstream selectors with other complete acquisition pipelines. Appendix A.4 (p.15) states that QUEST uses CLIP/SigLIP/LongCLIP scorers with the question and answer choices, whereas CSES and FOCUS use BLIP-based relevance with the question only; CSES additionally retains adaptive stopping and a variable selected-frame count. Consequently, the reported superiority over adaptive alternatives could reflect these other differences. The clean Table 1 comparison against uniform pools establishes useful gains, but does not resolve whether the minimax acquisition rule improves over an equally configured adaptive competitor.
Questions for authors
- With the same relevance encoder, scoring text, downstream selector, and actual observed/selected-frame budgets, how does QUEST compare with CSES or FOCUS? A controlled comparison on representative settings, in addition to the existing native-pipeline results, would directly clarify the contribution of the acquisition rule.
2 comments
I have read the rebuttal and decided to maintain my score.
[Response to Reviewer ZeB6 (1/1)]
We appreciate the reviewer's emphasis on fair comparisons with existing adaptive acquisition methods, particularly the need to control relevance scoring, observation budgets, and downstream selection protocols.
Q1, W1. Controlled comparison with adaptive acquisition. To isolate candidate acquisition from the scorer and downstream selector, we compared QUEST and CSES with a common BLIP scorer, scoring text with question and options, Qwen3-VL, and the same CSES selector. We additionally evaluated QUEST against FOCUS at matched per-sample acquisition counts. The target number of selected frames is K=32. All averages and differences are computed before rounding.
(i) CSES. Both arms acquire exactly N=128 candidate frames and use the CSES selector without stopping to select exactly K=32 frames. We also disable CSES's acquisition stopping rules to enforce the fixed candidate budget. The only difference between the two arms is whether the candidate pool is constructed by CSES or QUEST.
Replacing CSES acquisition with QUEST improves accuracy on all five benchmarks, with a +0.61 pp average gain. Unlike the original complete-pipeline comparison, this experiment keeps the relevance encoder, scoring text, downstream selector, and actual candidate and selected-frame counts fixed. It therefore directly tests the contribution of the acquisition rule under the requested controls.
(ii) FOCUS. As a complementary pipeline comparison, we preserve FOCUS's adaptive acquisition and match QUEST to its realized acquisition count. For each sample, QUEST acquires as many candidates as the number of unique frames scored during FOCUS acquisition, then uses the CSES selector with stopping disabled. The BLIP scorer, scoring text with question and options, Qwen3-VL, and evaluation protocol remain shared.
QUEST obtains higher accuracy on four of five benchmarks, with a +1.84 pp benchmark-average gain at matched acquisition counts. The CSES experiment isolates the acquisition rule under a common selector, while this FOCUS experiment provides additional pipeline-level evidence when the acquisition budget varies by sample.
We have added the shared scorer CSES and FOCUS comparisons to Section 5.2 (Tables 4–5) and documented their acquisition, scoring, and selection settings in Appendix A.6. The added protocol specifies the stopping-rule controls used for CSES and the per-sample acquisition-budget matching used for FOCUS.