- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper aims to predict a point map at an interpolated timestamp between two input views. To this end, it leverages an event stream to capture the motion between the two views, and introduces several simple modules that enable point map prediction at the intermediate timestamp.
Critical strengths
- While existing methods learn using events for a specific timestamp (usually the timestamp corresponding to the input view), this paper makes good use of the characteristics of events to predict the point map of the intermediate interpolated time well.
- The experimental results are well presented, and it outperforms existing methods on various datasets, recording the highest numbers.
Critical weaknesses
-
Limited contribution. In my opinion, the main weakness is that the contribution is quite limited. The event representation follows existing encoding schemes, and the core idea appears to be simply taking the events corresponding to a target time as a condition and feeding them into the Align3R decoder to predict the point map. Although a few simple modules are proposed for this purpose, they are not specifically designed around the characteristics of event data, and the method appears to be mainly a combination of two existing modules that happens to work well.
-
Outdated related work. The related work section is largely outdated. For dynamic scenes, recent works such as D²USt3R, POMATO, DPM, and St4RTrack [A,B,C,D] predict point maps aligned to a specific timestamp, and N-view methods such as VGGT and Depth Anything 3 [E,F] also exist. These works also follow the approach of MonST3R to handle dynamic regions. More recently, models such as Trace Anything and D4RT (Open D4RT) [G,H] predict point maps at interpolated timestamps on top of models like VGGT. A comparison with these models would strengthen the paper.
-
Missing comparison with Dynamic DUSt3R. The paper mentions Dynamic DUSt3R but does not compare against it. Since Dynamic DUSt3R predicts an interpolated point map exactly at the middle timestamp, results at the middle timestamp should also be reported to show how the proposed method compares.
-
Unclear motivation for intermediate timestamps. While I understand the goal of predicting point maps at intermediate timestamps, it would be helpful to explain why this is useful and in which applications. When I think about how such intermediate predictions would actually be used, no clear use case comes to mind. I suspect this may also be why existing methods either predict at the timestamp of a specific view, or align to a specific view to obtain outputs such as point tracks, rather than predicting point maps at intermediate timestamps.
-
Missing details on the event voxel. The paper does not clearly explain how the event voxel is constructed. It states that it follows existing EVFI methods, but it should clarify whether the voxel has the shape (x, y, z) or (x, y, t). If it is (x, y, t), the main paper should explain how the event voxel is combined with point map prediction. I consider this the most important part of the method, yet the concrete details are omitted.
-
Questionable plug-and-play claim. When comparing MonST3R + Interp3R with the w/o event setting in Tab 3, the method performs worse on most depth metrics, which is disappointing. If the paper claims plug-and-play capability (as in Figure 1), the method should work in general, so this result is concerning. It is also hard to attribute this to a distribution gap, since the module only takes point maps as input. Therefore, I am not sure the plug-and-play claim is fully supported.
[A] Han, Jisang, et al. "D^ 2USt3R: Enhancing 3D Reconstruction with 4D Pointmaps for Dynamic Scenes." arXiv e-prints (2025): arXiv-2504.
[B] Zhang, Songyan, et al. "Pomato: Marrying pointmap matching with temporal motions for dynamic 3d reconstruction." 2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025.
[C] Sucar, Edgar, et al. "Dynamic point maps: A versatile representation for dynamic 3d reconstruction." 2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025.
[D] Feng, Haiwen, et al. "St4rtrack: Simultaneous 4d reconstruction and tracking in the world." 2025 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, 2025.
[E] Wang, Jianyuan, et al. "Vggt: Visual geometry grounded transformer." 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2025.
[F] Lin, Haotong, et al. "Depth anything 3: Recovering the visual space from any views." arXiv preprint arXiv:2511.10647 (2025).
[G] Liu, Xinhang, et al. "Trace anything: Representing any video in 4d via trajectory fields." International Conference on Learning Representations. Vol. 2026. 2026.
[H] Zhang, Chuhan, et al. "Efficiently reconstructing dynamic scenes one d4rt at a time." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2026.
Questions for authors
See weakness