Weaknesses
1.The adaptation protocol and split construction are insufficiently specified in the available manuscript. Section 3.2 defines adaptation broadly, but the main text does not explain whether training and test data are separated by original recording, subject, match, surgical procedure, or recording session. Since multiple clips and queries can originate from the same recording, clip-level separation alone may allow substantial overlap in visual context. This is especially important for a benchmark whose central contribution is measuring adaptability. The intended setting should also be stated more precisely: supervised adaptation to new domains, generalization to unseen concepts within a domain, and generalization across recording environments are different evaluation targets.
2.The limited-data adaptation claim is not supported by a systematic data-efficiency study. Table 2 provides approximately 410–583 training queries per domain, but Table 4 reports only one training-set size. These results cannot establish how adaptation scales with the available supervision or whether the observed limitations persist across data budgets. Furthermore, dense tube annotations provide substantially different amounts of supervision depending on event duration. Fine-tuning is evaluated only on Qwen3-VL-8B, which also limits the generality of the conclusion that adaptation produces only modest STVG gains. A benchmark paper need not introduce a new adaptation method, but stronger characterization of its adaptation setting is important here.
3.The claimed shift toward a joint spatio-temporal alignment bottleneck is not established by the current decomposition. SVG receives a video cropped to the ground-truth temporal interval, whereas STVG receives the full video. SVG therefore benefits from oracle temporal localization, potentially different effective sampling density, and less distracting context. In addition, the three tasks use separate prompts and predictions. Consequently, strong standalone SVG and TVG results combined with weak STVG do not, by themselves, isolate a joint-alignment failure. Joint metrics also penalize simultaneous spatial and temporal inaccuracies. Controlled oracle experiments using the same STVG predictions would provide stronger evidence for this interpretation.
4.Important evaluation choices and baseline coverage remain unclear. The paper explicitly notes that some models predict boxes only at selected timestamps, but the available text does not specify how these predictions are converted into dense tubes. Interpolation, missing-box handling, coordinate conversion, output parsing, and truncation can materially affect the results. Frame sampling and resolution are also particularly consequential for rapid actions and small objects. Moreover, Table 3 includes only one specialized STVG VLM, LLaVA-ST, despite discussing several grounding-oriented models. Additional specialized baselines and a modular temporal-localization-plus-detection/tracking pipeline would help determine how much of the observed difficulty comes from domain shift versus the chosen direct-generation interface.
5.Annotation quality and domain-specific difficulty need stronger quantitative validation. The described manual review process is encouraging, but the available manuscript doess not report quantitative agreement for temporal boundaries, target identity, or bounding boxes. Queries adapted from action labels may also be ambiguous when several similar objects or actors are present. Additionally, Figure 4 shows that event duration and object size affect performance. Without source-level results or controlled comparisons, differences attributed to specialized-domain understanding may partly reflect object size, motion, viewpoint, or temporal scale.
6.Uncertainty is not reported for the central adaptation comparisons. Each domain has only 157–250 test queries, so some reported differences correspond to a small number of successful examples. Although Figure 4 includes bootstrap confidence intervals, Tables 3 and 4 do not report uncertainty, and repeated adaptation runs are not described in the supplied text. This makes small improvements and degradations difficult to interpret. If several queries share a video or recording, uncertainty estimation should also account for this dependence rather than treating all queries as independent.
General Response
We thank all reviewers for their time and constructive feedback. We are glad that the reviewers found:
We summarize the main points addressed in response to the reviews:
Revisions (all changes are shown in red)
We have uploaded the revised paper. If any concern remains, please let us know and we will address it promptly.
[1] Robicheaux et al., Roboflow100-VL: A Multi-Domain Object Detection Benchmark for Vision-Language Models, NeurIPS 2025.
[2] Gao et al., Detector-Empowered Video Large Language Model for Efficient Spatio-Temporal Grounding, ACM MM 2026.
[3] Rasheed et al., Locate Anything in Videos: Rethinking Efficient Generative Spatio-Temporal Video Grounding, arXiv 2026.