- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes EgoWorldMem, a 4D world memory for long-term first-person video understanding. The method identifies redundant regions across viewpoints through 3D reconstruction and geometric re-projection, simultaneously performs sparse storage of static scene information, organizes dynamic information into object-centric event segments, and finally serializes them into compact visual token inputs for VLM.
Critical strengths
- By combining geometric re-projection with object-centric temporal memory, it is used to handle the significant visual redundancy caused by camera movement in egocentric videos.
- The paper writing is standard, and it contains all the necessary sections of a paper.
Critical weaknesses
- The degree of innovation is relatively limited. The main difference of the paper seems to be the combination of geometric filtering and object tracking/event serialization. At present, it is not clear whether this combination at the method level has a significantly more innovative aspect compared to the existing spatial memory work.
- The experiment is not sufficient to fully support that object-centric event organization is a strong and universal core contribution in this method, because the performance improvement brought by this module in the ablation experiment was not significant.
Questions for authors
- Can we conduct a comparison with existing memory-based methods under exactly the same training data, fine-tuning protocol, and token budget, rather than just random token retention?
- Does 4D World Memory explicitly establish a complete and continuous 4D scene representation?
- The pipeline strongly relies on accurate camera pose, 3D point map, and SAM2 persistent tracking. If there are any errors in these components, how would they affect the experimental results? It is hoped that a quantitative analysis for these typical failure modes can be provided.
- In the efficiency experiment, it is hoped to further report cumulative FLOPs, total latency or GPU-hour and other relevant metrics.