- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces SENRI-Bench to study event–space associations in long egocentric videos through six tasks and 500 manually annotated questions drawn from 10 continuous recordings totaling 25.3 hours. It evaluates 28 configurations across direct perception, evidence seeking, and persistent memory, with the strongest baseline reaching 59.0% accuracy. The proposed SENRI-Agent adds target-guided visual checks and working memory to existing memory systems, improving accuracy by 2.6–3.8 percentage points across four evaluated configurations.
Critical strengths
- The paper offers a useful perspective on spatial intelligence by jointly considering events and space, providing a new basis for studying VLMs’ spatial understanding of videos.
Critical weaknesses
-
The benchmark includes trajectory retrieval and navigation planning, but it does not separately assess reasoning across multiple places and events, leaving its coverage of spatial topology unclear.
-
SENRI-Agent improves existing memory systems through targeted visual checks, but it does not explicitly represent 3D structure or connections between places, making it difficult to attribute the gains to spatial modeling.
Questions for authors
- Could the authors include questions that connect multiple events at the same place or trace events across places and times? This would more fully test the proposed space–event nexus.
- The paper emphasizes spatial understanding, while SENRI-Agent verifies evidence from video frames. How does this approach compare with a representative 3D spatial-memory baseline, and what are its relative strengths?
- How do accuracy and SENRI-Agent’s gains vary with the number of places covered and the video duration? An analysis beyond the per-video results would help establish how the method scales.
2 comments
Follow-up on Our Response
Dear Reviewer rc4L,
Thank you again for your thoughtful feedback on the spatial part of our project, which we've tried to address in our rebuttal and our revision. As the discussion period draws to a close, we would appreciate hearing whether our response has addressed your concerns. If any points remain unclear, we would be happy to clarify them.
Thank you for your time and for helping us improve our work.
Best regards,
The Authors
Response to Reviewer rc4L
We appreciate Reviewer rc4L for their constructive feedback. We’re glad that they find our task a novel perspective of spatial intelligence which connect events and spaces in everyday life. For the concerns we address them as follows:
(note that all new experiments are based on the revised benchmark as asked by Reviewer 9sRK in W3 and Q3):
W1 and Q1:multiple places and events.
We thank the reviewer for the valuable question. We have to clarify that we already include the reasoning across multiple places and events in our benchmark.
They are included in the above three types, though they’re not listed as a separate task type by our definition.
W2 and Q2: whether spatial memories help
We thank very much for noticing that. Actually in our early exploration for the task we tried constructing retrievable 3d memories by getting spatial coordinates and relations using 3d models. However we found too much noise in the real-world which make it less effective (e.g. you don’t know which object to propose) and constructing spatial memories is quite heavy so we didn’t include it or claim it in our method.
However, we found a related work DirectMe [1] which does it by constructing 3d scene graphs but requires the time of the question (which is not natively acquirable in our task because lots of our questions require reasoning over a period of time). We tried to adapt it by using time priors by WorldMM and MagicVideo for Qwen to select query time for the geometry information. Results show that they still fall behind our SENRI-Agent:
Details of the experiment are in revised version of our pdf at Appendix C.4.
Q3: scale with number of places and video duration
We thank the reviewer for the suggestion. We did this experiment by dividing to 5 fewer / more places videos and 5 shorter / longer videos. Results are as follows:
3 of 4 settings of SENRI-Agent scales with that though the variance of our videos and number of places are relatively small, the discussion has been added in Appendix C.5.
[1] Wang et al. Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams. ICML 2026.