- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes SAVER, a RL framework for improving video understanding under sparse-frame inputs. The same policy processes paired dense and sparse video views, with grounding rewards supervising both branches and a gated reference reward encouraging agreement with the dense prediction when it achieves a higher grounding reward. Trained on 1,250 temporal-grounding examples without videoQA annotations during post-training, SAVER improves averaged performance across three grounding and six videoQA benchmarks. Experiments include multiple model sizes, frame rates, reward ablations, and comparisons with alternative training and selection methods.
Critical strengths
-
Practical setting. SAVER improves performance at matched frame budgets without an additional selection module at inference time.
-
Interesting transfer. Post-training on only 1,250 grounding examples improves several QA benchmarks without QA supervision during post-training. Ablations support contributions from joint-view training and the reference reward.
Critical weaknesses
-
Limited evidence for the added value of dense references. Joint-view training already achieves 27.4 mIoU versus SAVER’s 30.0. Ground-truth references also perform similarly (29.5 mIoU; 50.1 QA accuracy). Variability estimates and training-cost comparisons are needed to establish the benefit of dense predictions.
-
Unexplained transfer gains. At 0.1 fps, SAVER-4B gains 20.3 points on VideoMMMU but only about 1.0 point on average across the other five QA benchmarks. Some settings regress, and improved use of temporal evidence is not directly established.
-
Unclear qualitative figures. Figure 2,3’s small thumbnails obscure the relevant action, and the displayed timestamps do not directly reflect the labeled frame rates. The actual model inputs and illustrative frames should be distinguished.
Questions for authors
-
How are training steps, rollout counts, and compute matched across Tables 3–4?
-
Are dense-reference gains over ground-truth references consistent across seeds, and what is their additional training cost?