- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces support–counter grounded VideoQA, where a model must answer a multiple-choice question, localize supporting evidence, and localize the events associated with rejected alternatives while explaining why they do not answer the question. The authors construct SC-GROUND by refining three existing benchmarks and propose GroundBoth, a 2B model trained with role-wise on-policy distillation followed by support–counter GRPO. The model substantially improves grounding over its backbone on both the refined and original benchmarks.
Critical strengths
-
The task formulation is meaningful. Correctly answering a question and localizing its support do not establish that a model distinguished the relevant event from plausible competing events. Option-conditioned localization provides a concrete way to make these alternatives inspectable.
-
The empirical results are promising for a small model. GroundBoth achieves competitive results on the original NExT-GQA and ReXTime benchmarks, suggesting that the benefits of the overall training procedure extend beyond the revised distractors in SC-GROUND.
Critical weaknesses
-
The benchmark lacks independent validation against the underlying videos. As described in Appendix A, distractor verification and answer-uniqueness checks operate on machine-generated event records. Using a different verifier reduces direct self-verification, but cannot identify visual facts that the shared record omits or misrepresents. Only approximately 30–40% of the original questions are retained, and the paper acknowledges incomplete record coverage as one source of filtering failures. Without a human audit against the original videos, the reliability of event existence, temporal boundaries, answer uniqueness, and the resulting selection bias remains uncertain. This is my primary concern because the benchmark is a central contribution.
-
The contribution of counter learning to the original-benchmark gains is not isolated. Table 3 supports counter rewards on SC-GROUND, but does not report the corresponding support-only versus support–counter comparison on the original benchmarks. Consequently, Table 2 establishes the effectiveness of the complete training recipe rather than the specific contribution of counter learning. Similarly, comparing role-wise OPD against pure SFT and pure OPD does not isolate role assignment from the benefit of combining annotation supervision and distillation; a conventional mixed SFT–OPD baseline would clarify this distinction.
Questions for authors
-
Can the authors provide an independent human audit against the original videos, reporting event validity, answer uniqueness, and temporal annotation quality?
-
On a modest evaluation subset, how often are the rejection rationales correct? Can a question-and-options-only baseline help distinguish language-based rejection from visually grounded discrimination?
-
How do support-only and support–counter reward configurations compare on the original benchmarks under the same initialization? Does role-wise OPD outperform a conventional mixed SFT–OPD objective?
-
Are the key joint-score improvements stable under paired confidence intervals, preferably computed by resampling videos to account for multiple questions sharing a video?