- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces the Streaming Text-to-Video Retrieval (STVR) task, where a model continuously retrieves relevant videos from multiple synchronously arriving video streams and determines whether the queried event is occurring at the current moment. The authors propose HMER, which consists of three main components. RVG-EM uses radial valleys in hyperbolic space to estimate event transitions and aggregate historical segments within the current event. ACS introduces a query-centered angular cone to model the general-specific hierarchy between text queries and local video evidence. SQ-AER predicts query-matching confidence and event boundaries, and maintains the highest-confidence historical prediction to determine whether retrieval results should be triggered at the current moment.
Critical strengths
The paper formally introduces the STVR setting, which combines cross-stream retrieval with online event occurrence assessment in a multi-stream streaming scenario.
Critical weaknesses
-
I am not fully convinced by the necessity of hyperbolic space in this work. The paper uses radial valleys to estimate event transitions and angular cones to model the hierarchical relation between queries and videos, but the current motivation and evidence do not sufficiently explain why these problems should be modeled in hyperbolic space. In particular, the connection from radial semantic structure to radial valleys as event boundaries is not sufficiently clear, and the correspondence between cone geometry and semantic hierarchy in ACS also requires stronger justification.
-
The paper defines STVR around multiple synchronously arriving video streams, but the connection between this defining property and the proposed method is not sufficiently clear. RVG-EM mainly performs history aggregation within each individual stream, SQ-AER mainly performs event confidence prediction and boundary localization, and ACS does not appear to be specifically designed for the multi-stream streaming setting. Cross-stream retrieval itself is still mainly based on similarity ranking. It is therefore unclear why HMER is particularly required for the multi-stream streaming setting of STVR, and what its key methodological distinction is from existing streaming temporal grounding methods.
Questions for authors
-
Why is hyperbolic space necessary in this work? What is the specific motivation connecting hyperbolic geometry to the event transition modeling in RVG-EM?
-
How does the query-centered cone in ACS correspond to the semantic hierarchy?
-
Which components of HMER are specifically required by the multi-stream streaming setting of STVR? Why can existing streaming temporal grounding methods not be naturally adapted to this task?
-
What is the inference latency of the proposed framework under the streaming setting? In particular, since the event memory in RVG-EM grows from the most recently detected valley, how is its memory cost kept bounded in long-duration streaming scenarios when no event boundary is detected for an extended period?