- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes VideoSlate, a framework for selectively revising temporal intervals in video grounding and grounded question answering. It maintains an incumbent interval, constructs alternative candidates from frozen VideoMind proposals, and records candidate provenance and verifier observations in an evidence blackboard. A logistic classifier uses seven source-derived features to score whether a challenger should replace the incumbent. A threshold-based controller then either commits the selected candidate or retains the incumbent. Training labels reflect candidate–incumbent differences in ground-truth IoU. The paper reports results on 5 benchmarks and controlled experiments addressing candidate selection and replacement decisions. The central empirical finding is that selective revision can improve localization while reducing harmful replacements relative to unconditional verifier selection. Overall, I believe this paper offers some novelty and promising empirical results.
Critical strengths
-
The paper addresses a practical and well-motivated problem. A candidate can look relevant to the query while still being worse than the current interval. Comparing a proposed revision against what it would replace is a sensible idea, and the examples make clear why blindly choosing the verifier’s favorite candidate can hurt localization.
-
The results on ReXTime are promising. Compared with unconditional verifier selection, VideoSlate improves mIoU from 33.55 to 41.18 and [email protected] from 28.88 to 38.98. It also reduces harmful replacements while recovering more missed events, suggesting that the policy does more than simply avoid changes.
-
The paper includes useful controlled comparisons. The fixed-budget experiment holds the number of replacements constant, while the Charades-STA controls use a shared candidate pool. These comparisons help distinguish better replacement decisions from gains that might otherwise come from having more candidates or making more updates.
-
The evaluation covers several datasets and both grounding and grounded QA. Localization improvements on Charades-STA and ActivityNet-Captions suggest that the approach has value beyond the main ReXTime setting. The gains are not equally large everywhere, but this broader evaluation is a useful strength.
Critical weaknesses
-
Calibration and testing use different tie-breaking rules. During calibration, the method uses ground-truth IoU to resolve certifier-score ties, whereas testing uses an annotation-free rule. Since derived candidates can inherit identical features, these ties may matter in practice. I would like to see how often they occur and whether the results hold when calibration uses the exact test-time rule.
-
The evidence for the broader stateful framework is limited. The main controlled experiment replays a single revision step over frozen candidates and observations. This supports the usefulness of the replacement policy, but does not show why persistent memory or a blackboard is needed. A comparison with a simpler implementation using the same features would help clarify the architectural contribution.
-
The feature ablations do not fully establish which inputs are necessary. The paper removes features while keeping the remaining coefficients and thresholds fixed. The performance drops could therefore reflect a poorly calibrated model after feature removal, rather than information that a simpler model cannot recover. Retraining and recalibrating each variant would make the conclusions more convincing.
-
The grounded-QA comparisons do not isolate the effect of the proposed method. VideoSlate uses Qwen3-VL-8B as its answerer, while the published baselines retain their own answering configurations. Better answer accuracy and joint QA scores may therefore come partly from the answerer. A comparison with the answer model, prompts, and visual inputs controlled would make the source of these gains clearer.
Questions for authors
-
How frequently do candidates tie in certifier score? What thresholds and evaluation results are obtained when out-of-fold calibration uses exactly the annotation-free selection rule in Equation 2?
-
Do the feature-ablation conclusions hold when each reduced-feature model is retrained and recalibrated? How does the full model compare with a similarly tuned classifier using only incumbent support and candidate support?