- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Motion4DGS, which adds motion consistency regularization to deformable 4DGS. The regularization consists of a spatial term that aligns rendered surface normals with depth gradients and temporal terms based on optical flow. The key idea is to extend these constraints from individual time steps to unit time intervals, penalizing changes in depth, normals, and flow between adjacent time steps. The method is evaluated on the N3V and D-NeRF datasets, where it reports higher rendering quality, shorter training time, and faster rendering than prior methods.
Critical strengths
- The paper targets a practical problem (temporal inconsistency such as flickering and ghosting) in dynamic scene reconstruction.
- The proposed regularization does not modify the rendering pipeline, so it can be added to existing 4DGS methods with little overhead.
Critical weaknesses
- Evaluation is limited to N3V (relatively slow motion) and D-NeRF (synthetic), so the paper’s claims about fast and non-rigid motion cannot be verified. Results on more challenging datasets such as ENeRF-Outdoor [1] or SelfCap [2] are needed.
- All baselines date from 2023, and several recent methods such as FreeTimeGS [2] and TRiGS [3] are missing. In addition, the baseline numbers in Table 1 differ from the originally reported values (e.g., 4DGS: 28.42 here vs. 31.15 reported; RealTime4DGS: 29.95 vs. 32.01) without indicating whether they were re-run or cited, and the RealTime4DGS row is identical across Tables 1 and 2. The source and evaluation protocol of these numbers should be clarified.
- The proposed losses largely combine existing depth, normal, and flow supervision using off-the-shelf priors, so the novelty mainly lies in extending these constraints to unit time intervals. However, in Table 3, the spatial term alone yields +2.32 dB, while this extension improves PSNR by only about 0.25 dB (Full Space), and this is measured only on D-NeRF. Without an ablation isolating this extension on N3DV or other real-world datasets, its contribution is difficult to assess.
- Several details required for reproduction are missing, including how depth, normals, and optical flow are rendered from the Gaussians, which estimators provide the priors, the target of Eq. 2, and how - are learned and what their final values are.
- Although the method only adds loss terms, it reports a reduction in training time from 72 to 20 min and an increase in FPS from 40 to 110 over Deformable4DGS. Since additional losses typically increase training cost and the rendering pipeline is unchanged, the source of these gains is unclear; Gaussian counts and whether baselines were re-run on the same hardware should be reported.
[1] ENeRF: Efficient Neural Radiance Fields for Interactive Free-viewpoint Video. Lin et al. (SIGGRAPH Asia 2022)
[2] FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstruction. Wang et al. (CVPR 2025)
[3] TRiGS: Temporal Rigid-Body Motion for Scalable 4D Gaussian Splatting. Yeom et al. (arXiv 2026.04)
Questions for authors
- Are - shared across all scenes or determined per scene? If they differ per scene, how does the method perform when they are fixed per dataset?
- Could the authors report results on more challenging datasets such as ENeRF-Outdoor or SelfCap, and include comparisons with recent methods such as FreeTimeGS and TriGS?
- Since the proposed losses are regularizers, would applying them to other backbones (e.g., Deformable3DGS or STG) yield similar gains? In addition, in Table 3, the time term alone yields +2.13 dB, whereas its marginal gain over the spatial term is only about 0.25 dB, suggesting that much of its effect overlaps with the depth/normal prior. How does the unit-time-interval constraint perform when applied without external priors (i.e., only enforcing consistency between rendered quantities at and )?
Performance Validation and Comprehensive Experiments
1. Quantitative Results on the Long-sequence Datasets
Table 1 reports quantitative results on three long-sequence datasets, ENeRF-Outdoor [lin2022efficient], MobileStage [xu20234k4d, xu2024relightable], and CMU-Panoptic [joo2015panoptic], using PSNR, SSIM, and LPIPS.
On ENeRF-Outdoor, our method achieves the best performance, exceeding the best competing PSNR by 2.64 dB and the best competing SSIM by 0.0771, while reducing LPIPS by 0.1264. On MobileStage, our method improves PSNR and SSIM by 2.98 dB and 0.0329, respectively, and reduces LPIPS by 0.0871 relative to the best competing results. On CMU-Panoptic, our method outperforms Dy3DGS by 2.73 dB in PSNR and 0.0271 in SSIM, while reducing LPIPS by 0.2133. Across the three datasets, PSNR gains range from 2.64 dB to 2.98 dB, and absolute LPIPS reductions range from 0.0871 to 0.2133, indicating consistent improvements in fidelity and perceptual quality on long sequences.
Overall, our method achieves the best results across all three metrics on all three datasets. These consistent gains support its effectiveness in reconstructing long dynamic sequences.
Table 1. Quantitative Comparison on Long-Sequence Datasets. Higher PSNR and SSIM and lower LPIPS indicate better performance. The best result for each metric within each dataset is shown in bold.
2. Rigorous and Comprehensive Experiments
All our experimental results are reliable and valid, as supported by the findings reported in 4D Rotor-GS. By reimplementing the underlying CUDA kernel functions using C++, we gain improved hardware-level computational performance. As shown in Table 2, Motion4DGS achieves substantially higher computational efficiency than Deformable3DGS. Therefore, when evaluated under an equivalent computational budget, our approach outperforms all Gaussian-based baselines in terms of PSNR. Optical flow is obtained by estimating pixel-wise motion between frames, while depth maps are directly generated through the Gaussian rendering pipeline to capture the underlying 3D scene geometry. We present quantitative ablation results in Table 3 to demonstrate the contributions of individual components of Motion4DGS on the D-NeRF dataset. Furthermore, Figure 6 provides qualitative ablation comparisons on the Plenoptic Video dataset, while Figure 7 offers additional evidence of Motion4DGS's effectiveness by illustrating improvements in optical flow consistency.
Duan, Yuanxing, et al. "4d-rotor gaussian splatting: towards efficient novel view synthesis for dynamic scenes." ACM SIGGRAPH 2024 conference papers. 2024.