- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
- This paper addresses efficient spatio-temporal video grounding (STVG) by predicting trajectory control points at one-second intervals and reconstructing dense object tracks via deterministic interpolation.
- The proposed multi-stage training pipeline combines continued pretraining (CPT), supervised fine-tuning (SFT) on synthesized reasoning chains paired with ground-truth coordinates, and reinforcement learning (RL) driven by spatio-temporal overlap rewards.
- Experiments on VidSTG and HC-STVG demonstrate improved grounding accuracy, preserved general video understanding, and a 29.3× inference speedup on 10-second videos compared to 25-FPS frame-level processing.
Critical strengths
-
Pragmatic multi-stage data curation that decouples reasoning from geometry. The pipeline scales across 344K CPT, 20K reasoning-SFT, and 20K RL samples. By pairing teacher-generated reasoning chains with ground-truth temporal spans and bounding boxes (supplemented by manual spot-checks), the SFT stage leverages synthetic semantic supervision without propagating teacher localization errors.
-
Consistent gains in both grounding and general video understanding. RL boosts mean tube IoU from 19.47 to 23.79 on VidSTG and from 33.75 to 40.99 on HC-STVG, while simultaneously improving over the base model on Video-MME and MMVU.
Critical weaknesses
-
The writing requires substantial improvement. The manuscript has limited readability and would benefit from clearer, more concise presentation. Although the authors disclose AI assistance with writing, language editing, and figure/table presentation, the remaining clarity and presentation problems suggest insufficient manual revision and proofreading, contributing to poor readability.
-
Lack of comparison against specialized STVG baselines. Table 2 benchmarks the model primarily against general-purpose MLLMs and proposed SFT checkpoint, omitting dedicated STVG architectures discussed in the related work. Standardized comparisons against task-specific baselines are necessary to establish its competitiveness on the target task.
-
Overstated motion-aware spatial reward formulation. Section 3.6 characterizes the spatial reward as "motion-aware," yet Eq. 6 simply computes the mean box IoU over the temporal intersection without explicit velocity, motion, or identity-consistency terms.
-
Overclaimed efficiency gains driven by input subsampling rather than technical innovation. Attributing the 29.3× speedup to the proposed method is misleading, as it stems primarily from downsampling inputs from 25 FPS to 1 FPS rather than algorithmic improvements.
Questions for authors
None