- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents InstanceFlow-SLAM, an RGB-D Gaussian SLAM system that reconstructs nonlinear object motion between keyframes while retaining the underlying keyframe mapping pipeline. It associates dynamic Gaussians, observations, and motion nodes within object instances, allocates nodes according to observed motion variation, and fits continuous SE(3) B-spline motion to image tracks and depth-supported 3D observations. Observation-supported endpoints limit unreliable trajectory extrapolation, and a residual transfer step preserves fitted interior motion after keyframe mapping changes the Gaussian states. Experiments on TUM RGB-D and Bonn evaluate rendering quality, camera localization, and runtime. The strongest reported result is a 1.44 dB improvement in average dynamic-region PSNR over Flow4DGS-SLAM on Bonn.
Critical strengths
-
A coherent solution to motion reconstruction between mapping updates.
The paper addresses a concrete limitation of keyframe-based dynamic Gaussian mapping: accurate keyframe states can still miss motion reversal and other nonlinear variation inside a window. Combining instance-constrained motion sharing, observation-fitted SE(3) splines, and supported trajectory endpoints is well motivated. The position transfer in Eqs. (7)–(8), further explained in Appendix A.6, provides a transparent way to preserve the fitted non-affine motion component while matching updated map boundaries. This is a useful design for reconstructing moving content without adding Gaussian mapping updates.
-
Consistent dynamic-region gains on Bonn, supported by a relevant controlled ablation.
Table 5 reports improved dynamic-region PSNR on all nine Bonn sequences, with the reported average increasing from 24.34 to 25.78 dB. Average full-image PSNR improves from 26.33 to 26.63 dB, while average camera ATE decreases from 3.9 to 3.7 cm (Tables 3 and 6). Table 8 also includes a useful ablation with fixed observation inputs and mapping budget: the full model improves PSNR by 1.155 dB over the linear variant on Bonn balloon. These results support the value of recovering nonlinear motion. The specific failure analysis in Appendix A.7.1 also helps delineate the system’s limitations.
Critical weaknesses
Critical Weaknesses
- Insufficient methodological novelty and inadequate technical presentation.
The proposed framework relies heavily on integrating existing components, including Flow4DGS-SLAM, pretrained instance segmentation and tracking models, SE(3) B-splines, and dual-quaternion blending. Although the authors introduce instance-constrained motion fitting and boundary-consistent transfer, the experiments do not convincingly isolate their contributions from the stronger segmentation and tracking pipeline.
Figure 2 is visually elaborate but does not sufficiently clarify the computational dependencies and implementation details of the proposed modules. A more rigorous technical diagram would improve the reproducibility and transparency of the method.
- Reconstruction quality and empirical improvements are insufficiently compelling.
The reconstruction results do not convincingly demonstrate a sufficiently substantial advance over existing methods. On TUM RGB-D, average PSNR improves by only 0.07 dB, while LPIPS becomes slightly worse. On Bonn, the average full-image PSNR improvement is only 0.30 dB.
Although the reported dynamic-region improvement on Bonn is more substantial, the qualitative results still reveal visible reconstruction artifacts. Figure 7 additionally demonstrates a failure involving overlapping static and dynamic geometry, producing a doubled and blurred reconstruction.
More importantly, these limited overall gains come with a substantial computational penalty: throughput decreases from 0.51 to 0.34 FPS. The paper does not convincingly demonstrate that the proposed architecture provides a sufficiently meaningful improvement in reconstruction quality, robustness, or computational efficiency.
Questions for authors
-
Controlled contribution assessment.
Could you compare against Flow4DGS-SLAM using the same dynamic masks and mapping schedule on a small representative subset? Extending the existing fixed-input linear-versus-continuous ablation to a different motion pattern, such as a box or TUM walking sequence, would also help establish whether the result in Table 8 generalizes.
-
Ablation evaluation protocol.
Which frames, image regions, and aggregation rules are used in Table 8? Its Full result is 26.844 PSNR / 0.8032 SSIM / 0.0806 LPIPS, whereas Table 3 reports 26.50 / 0.892 / 0.207 for Bonn balloon and Table 5 reports dynamic-region PSNR of 26.65. Please clarify whether these results use different subsets or evaluation settings.
-
Computation and output delay.
Could you provide a targeted quality-versus-total-runtime comparison with a baseline that uses more frequent mapping, and specify the hardware and per-frame/per-keyframe/per-window units in Table 7, including the accounting for Track-On-R and SAM2? Please also distinguish the two-frame observation look-ahead from the delay in producing a finalized reconstruction, since Algorithm 1 fits motion after the keyframe window closes.