- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper addresses arbitrary‑occurrence video temporal grounding for long‑form videos. The authors construct AO‑Bench, and propose a three‑stage Retrieve‑Rerank‑Refine pipeline. For the reranking stage, the authors propose Multi‑Agent Consensus Reranking (MACR), which uses multiple MLLM agents to evaluate candidate clips and aggregates their judgments.
Critical strengths
The human‑in‑the‑loop curation pipeline for AO‑Bench is carefully designed. The authors identify common annotation artifacts including missing event instances, boundary shifts and ambiguous queries, and provide inter‑annotator agreement statistics to support benchmark quality.
The distillation from heavy multi‑agent MACR into the lightweight ReGround model yields substantial speedup while retaining most multi‑occurrence performance benefits.
Critical weaknesses
The Retrieve‑Rerank‑Refine three‑stage paradigm is a standard coarse‑to‑fine pipeline widely adopted in prior works of long‑video temporal grounding or temporal action localization, e.g., [1-4]. The proposed method lacks technical novelity.
[1] Xiong, Zeyu, et al. "Rethinking video sentence grounding from a tracking perspective with memory network and masked attention." IEEE Transactions on Multimedia 26 (2024): 11204-11218.
[2] Fang, Xiang, et al. "Hierarchical local-global transformer for temporal sentence grounding." IEEE Transactions on Multimedia 26 (2023): 3263-3277.
[3] Long, Fuchen, et al. "Coarse-to-fine localization of temporal action proposals." IEEE Transactions on Multimedia 22.6 (2019): 1577-1590.
[4] Hu, Yufan, et al. "Learning proposal-aware re-ranking for weakly-supervised temporal action localization." IEEE Transactions on Circuits and Systems for Video Technology 34.1 (2023): 207-220.
Related works are sufficient. The authors only shortly survey long video temporal grounding benchmarks and methods. For methods, they simply category existing methods into traditional methods and MLLM-based methods. Is there really a fundamental difference between methods that use MLLMs and those that do not? Can the innovation of a previously published paper simply be reimplemented using an MLLM and then published as a new paper?
The computational complexity and inference time of the proposed model are not compared with those of existing methods.
Since the method relies on an MLLM, its generalization ability should be carefully evaluated. However, the paper does not provide any cross-dataset generalization experiments.
No ablation studying how instance granularity affects benchmark metrics and model ranking.
No comparison against simple baselines: e.g., take existing strong VTG models and let them output all high‑confidence proposals without modification.
There is insufficient analysis on how retrieval K balances recall, computation and downstream reranking load for arbitrary‑occurrence scenarios.
The arbitrary‑occurrence problem formulation is questionable and lacks well‑defined task boundaries. The core claim is that existing video temporal grounding benchmarks assume exactly one ground‑truth segment per query, which fails for real‑world long videos where events repeat. However, standard video temporal grounding never enforces a hard constraint that an event must occur exactly once. Most benchmarks simply only annotate one valid segment for each query due to annotation cost.
Questions for authors
What is the fundamental difference between Retrieve-Rerank-Refine and the extensive existing work on coarse-to-fine long-video temporal grounding and temporal action localization?
Does the construction of AO-Bench provide meaningful value to the field?
3 comments
Thank you for the authors' rebuttal, which addresses some of my concerns. I hope the above discussion and clarifications can be incorporated into the revised manuscript. I raise my score from 1 to 2.
Thank you for reading our rebuttal and for raising your score. We will incorporate the clarifications and additional results into the revised manuscript, specifically clearer contribution and task descriptions, expanded related work, and the additional experimental analyses.
To make the best use of the remaining discussion period, could you let us know if there are any remaining concerns that are not yet fully resolved?
Gentle Reminder for Your Feedback
Dear Reviewer vieH,
Thank you for your time and effort in reviewing our submission. We have carefully considered your comments and provided detailed responses. We look forward to your feedback.