- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CG-SC-Bench evaluates sports video commentary through commentary-to-spatiotemporal grounding, causal streaming commentary decisions, and visual-clue-conditioned generation. It connects commentary segments to timestamps and bounding boxes across eight sports categories. Experiments examine the grounding, timing, and factual-generation limitations of multimodal models.
Critical strengths
-
Evaluating when commentary is warranted, alongside visual grounding and generated content, addresses a meaningful limitation of pre-segmented commentary tasks.
-
Fine-grained links between commentary, timestamps, and bounding boxes across sports provide a useful resource for diagnosing temporal, spatial, and factual errors.
Critical weaknesses
-
Trigger reference. Human-commentary onset measures agreement with a narration schedule, not every reasonable commentary-worthy moment. Valid alternative timings or omissions should be distinguished from errors when interpreting the When capability.
-
MTE definition. Section 3.3.1 describes tolerance-constrained matching, yet Table 5 reports MTE above the largest tolerance. This would be inconsistent under that same matching set; a separate unconstrained rule could explain it but must be specified.
-
Commentary-judge validity. Human checks of dataset annotations do not establish judge reliability for generated commentary. Independent agreement on factuality and visual support would directly support the benchmark's conclusions.
-
Linked-task analysis. The aligned resource is useful. Showing which findings require linked timing, grounding, and generation annotations would make its diagnostic contribution more concrete than separate task scores.
Questions for authors
- How does the trigger reference handle plausible alternative commentary timings?
- Which matching set and denominator produce the reported MTE?
- What independent agreement supports generated-commentary judgments?
- Which diagnostic findings rely on the linked annotations?