- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduce a method for feed-forward driving scene reconstruction, proposing separation of static and dynamic features before camera and geometry estimation and reducing dynamic interference. Static branch works independently and is guiding dynamic branch, preserving the established static representations while supplying geometric context for dynamic reconstruction. Additionally, authors develop instance-level motion decoder for estimating object trajectories. Compared to other methods, S2D-Splat achieves state-of-the-art performance.
Critical strengths
- Authors show that splitting static and dynamic parts earlier in backbone improves model geometry, better parts separation and reconstruction quality.
- Method achieves state-of-the-art performance on reconstruction and novel view synthesis.
Critical weaknesses
- Model depends on GT bounding boxes and uses sharper masks from Sam2, while baselines split on dynamic and static with learned approach (DGGT predicts dynamic masks, StreetForward learns dynamic probabilities), which makes it unclear whether improvement comes from that or from proposed split before geometry estimation. Additionally authors used VGGT-Omega backbone, while baselines run on earlier models (VGGT and Pi3).
Questions for authors
- Mask ablation
- Sam2 is running on GT boxes, but in practice this boxes are not available. How would model perform with automatic mask generation using Sam2?
- As tokens are coarse, how sensitive model is for boundaries of masks being used for dynamic-static split? Could you evaluate the model with 2d boxes used instead of Sam2 masks? Please also provide additional visual results, as in Fig. 3 objects are either far or blurry and it would be interesting to see on examples with big cars in front of us and their boundaries (as in Fig.4).
- As Instance-level motion decoder is one of central contributions claimed in paper, evaluate 3d tracking and compare to DGGT and StreetForward.
- Does model better split background and objects and static part is not carrying dynamic information? Could you provide qualitative comparison with baselines for background and objects rendered independently?
3 comments
Response to Reviewer RUin (2/2)
Q2. As Instance-level motion decoder is one of central contributions claimed in paper, evaluate 3d tracking and compare to DGGT and StreetForward.
We evaluate 3D tracking with APD$_{3D}$ on Waymo: points densely sampled on each dynamic instance are displaced with the predicted motion between adjacent frames and compared with the ground-truth rigid motion derived from box trajectories (thresholds: 0.1/0.3/0.5/1.0 m). All methods are evaluated under the same protocol (Table 2 in Sec. 4):
| Method | APD$_{3D}$ |
|---|---|
| DGGT | 13.14% |
| StreetForward | 11.47% |
| S2D-Splat | 19.20% |
S2D-Splat outperforms both baselines by a clear margin. DGGT and StreetForward estimate motion without an explicit instance-level motion decoder (StreetForward predicts per-point velocities), whereas our decoder queries the fused static-dynamic representation to predict each instance's rigid motion.
Q3. Does model better split background and objects and static part is not carrying dynamic information? Could you provide qualitative comparison with baselines for background and objects rendered independently?
Yes. The static component of S2D-Splat carries less dynamic information, as reflected by the static-region depth accuracy on Waymo (Table 2 in Sec. 4):
| Method | Static D-RMSE |
|---|---|
| DGGT | 3.745 |
| StreetForward | 2.913 |
| S2D-Splat | 2.057 |
Lower static-region D-RMSE indicates that the static reconstruction is cleaner and less affected by dynamic interference.
Qualitatively, we added a comparison of full, static, and dynamic renders for GT, DGGT, StreetForward, and S2D-Splat (Appendix D, Fig. 4). S2D-Splat retains the background in the static render and isolates the vehicles in the dynamic render with no obvious residual vehicle artifacts, while StreetForward and DGGT show visible dynamic residuals in their static renders. However, we acknowledge that the model does not achieve perfect static-dynamic separation, and we have revised the corresponding claim in the manuscript.
Thank you for the clarifications, additional experiments and visualizations. Your response addressed most of my concerns. I will maintain my original score.
Response to Reviewer RUin (1/2)
We sincerely thank the reviewer for the detailed evaluation. We appreciate the recognition of early static-dynamic separation and the state-of-the-art reconstruction and novel-view synthesis results, as well as the questions about prompt and backbone fairness, mask boundaries, 3D tracking, and qualitative separation. The responses below address these points.
Prompt availability. For benchmark evaluation, test-set 3D boxes are projected to 2D and used as SAM2 prompts. In practice, a 2D detector can generate candidate boxes, but a human currently selects the key moving instances before SAM2 propagates their masks. We have not yet quantified fully automatic detector-generated prompts; we agree this limits scalability, and automatic prompt generation and selection are future work (discussed in Sec. 5).
Boundary sensitivity. We added a test-time ablation that replaces SAM2 masks with 2D box regions, labeling a patch as dynamic when its center falls inside a box; the trained model is otherwise unchanged. Performance remains close to the SAM2-mask setting (Table 5 in Sec. 4):
This indicates robustness to coarser mask boundaries: patch tokens are already coarse, and the boundary branch can recover static cues from mixed boundary tokens. The ablation tests boundary coarseness, not missed-object errors or automatic instance-selection quality.
Additional visuals. We added a close-vehicle decomposition example (Appendix D, Fig. 4) comparing GT, DGGT, StreetForward, and S2D-Splat, with full/static/dynamic renders showing large nearby vehicles and their boundaries. S2D-Splat isolates the vehicles in the dynamic render with no obvious residuals in the static render.