- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper takes monocular RGB video and uses a pretrained WorldMirror model to provide geometry and Gaussian priors. Its camera tracker favors static patches selected using the model’s cross-frame attention. For mapping, it combines static Gaussians across frames and moves dynamic Gaussians with 3D trajectories obtained from tracked image points. The experiments cover motion segmentation, camera trajectories, rendering, and runtime. I find the rendering results on Bonn more persuasive than the tracking results: the method produces cleaner examples of moving objects, while its average trajectory errors are only slightly below the strongest monocular baselines.
Critical strengths
-
Maintaining moving objects in a monocular SLAM map is useful, and the Bonn rendering examples show fewer visible artifacts around people and moving objects. Table 5 reports 27.28 dB average PSNR against 26.11 dB for Flow4DGS-SLAM. This is encouraging, particularly given the RGB input, though I would describe the full-image gain as moderate.
-
The CAPS ablation gives a reasonably direct check on the tracking component: replacing its sampling strategy raises Bonn ATE from 2.22 to 2.59 cm. The result makes the attention-based patch choice more credible, even though the final improvement over other complete trackers is small.
Critical weaknesses
-
The tracking advantage is very small. Average Bonn ATE is 2.22 cm versus 2.30 cm for DROID-W; on Wild-SLAM it is 0.56 cm versus 0.66 cm for the best listed monocular alternatives. Wild-SLAM novel-view PSNR improves from 20.31 to 20.56 dB over Flow4DGS-SLAM. Without repeated runs or an uncertainty estimate, it is difficult to judge how much weight to place on these differences.
-
The evidence does not yet establish that anchoring Gaussians to long-lived tracks is responsible for the claimed robustness to motion and occlusion. The “without TAGs” ablation removes dynamic mapping altogether, rather than comparing against another way to move dynamic Gaussians within the same pipeline. Dynamic rendering is evaluated, but track survival, recovery after occlusion, and held-out dynamic views or times are not quantified. TrackerSplat also uses point tracks to guide Gaussian motion in a different setting; discussing that relationship would help clarify this paper’s contribution.
Questions for authors
-
Could you compare TAGs with another motion-aware Gaussian update while keeping the same WorldMirror priors, point tracker, and optimization budget? How does the proposed anchoring differ from TrackerSplat’s use of point tracks?
-
How were the dynamic-only images and masks in Table 10 generated for each method, and were those frames used during map optimization?
3 comments
Respomse to Reviewer 8VaL (1/2)
W2 & Q1. Contribution of TAGs and Comparison with Alternative Dynamic Representations
A2: We acknowledge that TrackerSplat is an important related work deserving further discussion. Both methods leverage point tracking to improve dynamic Gaussian reconstruction, but they differ substantially in their problem settings and motion modeling strategies.
TrackerSplat primarily addresses dynamic Gaussian reconstruction from calibrated multi-view observations. It uses 2D pixel trajectories to estimate Gaussian motion in image space, then recovers their 3D centers and covariance matrices through multi-view geometric constraints, followed by Gaussian parameter optimization.
In contrast, TAG4D-SLAM targets online monocular dynamic SLAM with unknown camera poses and without ground-truth depth. We recover long-lived 3D trajectories from 2D point tracking, estimated depth, and optimized camera poses. Canonical Gaussians are explicitly associated with these trajectories and propagated directly according to their 3D displacements. These associations remain fixed throughout incremental map updates, while coverage-aware Gaussian insertion integrates newly observed dynamic content.
To further validate the contribution of our motion representation, we conduct additional controlled ablations by replacing TAGs with TrackerSplat's dynamic motion modeling mechanism and a control-point-based MLP deformation model adopted from 4DGS-SLAM, while keeping the remaining components unchanged. As shown in Table R3-3, TAGs achieve 27.28 dB PSNR, outperforming the TrackerSplat-based and control-point-based alternatives by 2.44 dB and 1.45 dB, respectively. TAGs also achieve higher SSIM and lower LPIPS, demonstrating the effectiveness of our track-anchored dynamic representation.
Table R3-3. Ablation study comparing different dynamic motion representations.
| Method | PSNR ↑ | SSIM ↑ | LPIPS ↓ |
|---|---|---|---|
| w/ TrackerSplat Motion Model | 24.84 | 0.869 | 0.199 |
| w/ Control Points + MLP | 25.83 | 0.881 | 0.189 |
| w/ TAGs (Ours) | 27.28 | 0.902 | 0.156 |
Q2. Dynamic-Only Rendering Evaluation Protocol in Table 10
A3: For the ground-truth dynamic-only images, we apply SAM3 to segment dynamic objects in the original RGB frames and retain only the corresponding dynamic regions. For all compared methods, static and dynamic Gaussians are represented separately. We therefore render only the dynamic Gaussian components to obtain the dynamic-only reconstruction images, ensuring that the evaluation focuses specifically on dynamic scene content. Regarding the evaluation frames, all frames are available to the system during online SLAM and may be used for incremental map optimization. Therefore, Table 10 evaluates the dynamic reconstruction quality within the online mapping setting, rather than generalization to held-out frames or unseen timestamps.
Dear Reviewer 8VaL,
Thank you again for taking the time to review our paper and share your comments. We hope our earlier response has addressed your concerns. Since the ICLR discussion period ends soon, we would greatly appreciate your feedback on our response, and we are happy to answer any further questions.
Best regards,
The Authors
Respomse to Reviewer 8VaL (1/2)
We sincerely thank the reviewer for the constructive feedback and for recognizing the benefits of our monocular dynamic reconstruction framework, particularly the improved rendering of moving objects and the effectiveness of CAPS. Our point-by-point responses are provided below.
W1: Magnitude and repeatability of the tracking and rendering gains
A1: Table R3-1 reports the mean and standard deviation of dataset-average ATE over five runs for DROID-W, π³mos-SLAM, and our method. On Bonn the three results are 2.30/0.00924, 2.37/0.186, and 2.22/0.01747 cm. On Wild-SLAM MoCap they are 0.96/0.00431, 0.66/0.1068, and 0.56/0.00266 cm. Our standard deviations remain 0.01747 cm and 0.00266 cm, while the standard deviation of π³mos-SLAM reaches 0.186 cm on Bonn and 0.1068 cm on Wild-SLAM MoCap, about 11× and 40× larger than ours. Across these repeated runs, our method is stably better than the other two baselines.
Table R3-1. Mean and standard deviation of dataset-average ATE over five runs(cm)
For novel-view synthesis, ours achieves better rendering quality using only monocular RGB, without ground-truth depth. As reported in Table 4, our method achieves higher PSNR on all five sequences and lower average LPIPS than Flow4DGS-SLAM, which uses RGB-D input. Table 6 further shows that our system runs at 0.94 FPS, compared with 0.36 FPS for Flow4DGS-SLAM, providing approximately 2.6× higher throughput. Our method thus combines improved rendering quality with faster processing and reduced input requirements. The standard deviation of our average PSNR across five runs is 0.005 dB, supporting the repeatability of these results. Table R3-2 provides the per-sequence values.
Table R3-2. Standard deviation of novel-view PSNR across five runs on Wild-SLAM MoCap, measured in decibels.