- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes PhysScene4DGS, a dynamic 3D Gaussian splash framework that incorporates scene flow consistency and depth-aware temporal regularization. The former utilizes depth and optical flow constraints to predict 3D motion, while the latter enhances the temporal smoothness of motion. The authors conducted experiments on the Plenoptic Video, D-NeRF, and HyperNeRF datasets, reporting improved rendering quality and computational efficiency, and claim that the method enhances the physical consistency of motion.
Critical strengths
This paper investigates the issue of motion consistency in dynamic Gaussian splatter, a problem of practical research value in the field of dynamic scene reconstruction. Combining depth information with optical flow to supervise the 3D motion of objects is a reasonable and well-motivated design approach.
The improvements in rendering quality achieved by this method on three benchmark datasets are encouraging, especially considering the efficiency advantages in training time and inference speed emphasized by the authors. If these experimental results can be validated under a unified and consistent evaluation protocol, it will provide more compelling evidence of the method’s effectiveness.
Critical weaknesses
Equation (12) achieves regularization by constraining changes in the ratio of velocity to depth, but this does not necessarily guarantee that three-dimensional motion conforms to physical laws. Even if an object maintains a constant velocity, this loss function may still impose a penalty as long as the depth changes. The paper lacks rigorous theoretical derivations and does not compare the method with traditional velocity- or acceleration-based regularization approaches; therefore, its core conclusion regarding physical consistency lacks sufficient support.
The experiments focus primarily on rendering quality and lack a direct assessment of the accuracy of real-world motion. Key implementation details regarding depth and optical flow supervision are unclear, and the ablation experiments lack comparisons with simpler methods. Furthermore, the results for RealTime4DGS in Table 1 and Table 2 are identical, and the statement regarding training time in Table 1 does not match the actual data. These issues undermine the credibility of the experimental conclusions.
Questions for authors
Q1. What theoretical foundation underpins Equation (12)? Why should a constant velocity‑to‑depth ratio correspond to physically‑valid 3D motion? Please elaborate on the underlying assumptions. Under matched experimental conditions, please compare the proposed loss against conventional velocity‑ and acceleration‑based regularizers, and supply quantitative motion error metrics.
Q2. How are depth maps, optical flow, and foreground masks generated? How do the authors link pixel‑wise observations to individual Gaussian primitives, and how are camera transforms and occlusion cases dealt with? Please lay out the full supervision pipeline, and clarify whether competing baseline approaches are given access to identical auxiliary inputs.
Q3. The paper makes claims of physically consistent motion, yet evaluations mostly rely on image‑quality metrics. Where ground‑truth references exist, could the authors report 3D scene‑flow error, trajectory consistency metrics or temporal motion error? Challenging test scenarios including fast‑moving objects, varying depth and occlusions should be covered. Without these measurements, it is hard to tell whether the reported gains stem from genuine physical‑motion improvements or merely improved image‑space fitting.
Q4. What core distinctions set this method apart from existing dynamic Gaussian approaches equipped with motion priors and temporal regularizers, especially ST‑4DGS and ReMatching? Please spell out the new algorithmic contributions, and offer controlled comparisons if possible. Head‑to‑head tests against standard motion regularizers would help justify the necessity of the proposed formulation.
Q5. RealTime4DGS shares identical numerical results across Table 1 and Table 2 even though the two tables correspond to different datasets. In addition, Table 1 states that the proposed method achieves the shortest training time, while several baseline methods actually run faster. Per‑scene results, baseline code sources, full evaluation configurations, and the computational cost of each proposed module should be provided. Given the large PSNR improvements reported, these details are critical for result verification.
Q6. The submitted manuscript seems to lack the AI Use Statement mandated by the ICLR 2027 author instructions. Could the authors confirm whether this required statement has been included somewhere within their submission package?
2 comments
Thank you for the authors' response and clarifications. However, several of my main concerns remain insufficiently addressed. First, the response does not provide a convincing theoretical justification for Eq. (12), particularly why the proposed velocity-to-depth regularization should ensure physically plausible 3D motion. Second, the claimed improvements in physical motion consistency are still not supported by direct quantitative evaluations or comparisons with conventional motion regularizers. Furthermore, the methodological distinctions from related work remain unclear, and important details of the scene-flow supervision pipeline are still missing. Although the authors state that the numerical issues have been corrected, no verifiable revised results or detailed explanations are provided in the response. Therefore, I believe the current evidence remains insufficient to support the paper's central claims, and I maintain my original rating of 2 (Weak Rejection).
Theoretical Foundations, Experimental Validation, and Implementation Clarifications
1. Theoretical Motivation and Adaptive Weighting
Equation (12) characterizes the relative variations between velocity and depth. As clarified in Lines 304–305 of the manuscript, this formulation introduces a novel inverse-depth weighting strategy that enables faster convergence toward the optimum compared with naive grid search. Under constant-velocity motion, the 4D Temporal Consistency Regularization remains constant. When abnormal motion fluctuations occur, the weighting coefficient of this regularization term should be increased to suppress such variations. Accordingly, as shown in Equation (13), we introduce a tunable hyperparameter to adaptively control the contribution of this loss term.
2. Rigorous and Comprehensive Experiments
All our experimental results are reliable and valid, as supported by the findings reported in 4D Rotor-GS. As shown in Table 2, PhysScene4DGS achieves substantially higher computational efficiency than Deformable3DGS. Therefore, when evaluated under an equivalent computational budget, our approach outperforms all Gaussian-based baselines in terms of PSNR. We not only present quantitative ablation results in Table 4 to demonstrate the impact of individual components of PhysScene4DGS on the D-NeRF dataset, but also provide qualitative ablation comparisons on the Plenoptic Video dataset in Figure 5. Furthermore, Figure 6 provides additional evidence of our method's effectiveness by illustrating improvements in optical flow consistency.
3. Direct evaluation of temporal and geometric behavior
Our primary goal is real-time dynamic novel-view synthesis. Reconstruction metrics evaluate agreement with observed images, including the appearance of moving surfaces, textures, illumination, and reflections. Together with the qualitative examples, these results support the dynamic rendering benefits of our regularization framework. Optical flow is obtained by estimating pixel-wise motion between frames, while depth maps are directly generated through the Gaussian rendering pipeline to capture the underlying 3D scene geometry. We have carefully reviewed the manuscript and corrected all numerical issues.
Duan, Yuanxing, et al. "4d-rotor gaussian splatting: towards efficient novel view synthesis for dynamic scenes." ACM SIGGRAPH 2024 conference papers. 2024.
4. ReMatching is not a dynamic rendering method.
5. We will include the AI Use Statement in the camera-ready version of the manuscript.