- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Summary
This paper investigates the efficiency of Gaussian densification in dynamic scene reconstruction with 4D Gaussian Splatting (4DGS). Based on the TAD-GS framework of the deformation field route, it proposes a two-stage densification optimization scheme. The first stage is an error-guided Gaussian localization mechanism, which identifies regions requiring densification through reconstruction errors and suppresses redundant Gaussian growth in well-reconstructed areas. The second stage is a gradient consistency-aware density control strategy, which bidirectionally adjusts the cloning and splitting thresholds of Gaussians by calculating the consistency of gradient directions across timestamps, to alleviate the problems of gradient collision and redundant growth from aligned gradients.
From the perspective of technical origin, the core ideas of both modules have research foundations in the field of static 3DGS. The idea of error-guided densification has been discussed in related work at ECCV 2024, and the core logic of gradient consistency-aware density control is similar to that of the GDAGS work at ICLR 2026. The core positioning of this paper is to integrate two independent 3D densification optimization ideas and extend them completely to 4D dynamic scenes for the first time, which represents an application-oriented incremental innovation. It should be clarified that this paper does not belong to the direction of 4DGS model compression, but focuses on densification strategy optimization during training. Its goal is to achieve higher reconstruction quality with fewer Gaussian primitives through more reasonable Gaussian allocation.
Strengths
1, it achieves the first complete extension of two densification paradigms to 4D scenarios. It adapts the two densification optimization ideas, error guidance and gradient consistency, from static 3D to 4D spatiotemporal scenes. Through error accumulation across time windows and gradient consistency statistics across timestamps, it mitigates the problems of densification redundancy and structural blur caused by motion blur and temporal inconsistency in dynamic scenes, filling part of the gap in 4D dynamic densification optimization.
2, it constructs a systematic two-stage serial densification pipeline. It integrates two originally independent optimization ideas in 3D into a two-stage architecture: error region screening followed by gradient consistency adjustment. The error mask first eliminates gradient signals in well-reconstructed regions from the source, greatly reducing invalid computations. Then precise gradient consistency adjustment is performed on the remaining high-error regions. The two modules produce complementary gains, achieving a better balance between efficiency and quality compared with any single module. This systematic integration is a clear increment of this work relative to existing 3D studies.
3, targeted detailed improvements are made to the error module. A Laplacian structural term is introduced into the reconstruction error calculation, which enhances the sensitivity to under-reconstructed edges and high-frequency details, and can locate structurally blurred regions more accurately than pure pixel photometric errors. Meanwhile, a 16×16 patch-level voting error screening mechanism is adopted, which suppresses false triggers caused by isolated pixel noise and improves the reliability of densification localization.
4, the gradient consistency module is adapted to the spatiotemporal dimension. Compared with single-frame spatial consistency calculation in 3D scenes, this paper implements weighted spatiotemporal joint consistency statistics combined with the error mask. On the one hand, it excludes irrelevant gradient interference from low-error regions; on the other hand, it accumulates direction information across time windows, which is more compatible with the motion characteristics of dynamic Gaussians and has a better effect on alleviating gradient collision in dynamic scenes.
5, the experimental verification is relatively sufficient. The paper takes TAD-GS as the direct main baseline, and controls variables such as training schedule, optimizer, and resolution, ensuring fair comparison. Ablation experiments systematically verify the independent contributions of the two modules and their sub-components. On multiple mainstream datasets, it achieves simultaneous improvement in reconstruction quality and reduction in Gaussian count and storage volume, and the results are highly credible.
Limitations and Weaknesses
1, the originality of the core ideas is relatively limited. The basic logic and core formulas of both core modules have been proposed in static 3DGS scenarios. The contributions of this paper are mainly reflected in scenario extension and engineering integration, with relatively weak breakthroughs at the basic theoretical level, which is a typical incremental improvement.
2, the discussion on scenario adaptability is insufficient. The paper does not analyze scenarios with different characteristics. For example, whether the performance gain of the method differs between high-speed motion scenarios and slow-motion scenarios, or between scenarios dominated by static backgrounds and scenarios with a large proportion of dynamic regions. Whether there are regular patterns for the optimal settings of hyperparameters such as error thresholds and consistency thresholds across different scenarios also lacks discussion and verification.
3, the selection of key hyperparameters lacks theoretical support. Key parameters such as the 16×16 patch size, the 0.7 threshold for high-error pixel proportion within a patch, and the start and end values of the progressive quantile are all set empirically, without further theoretical explanation or adaptive adjustment strategies, leading to insufficient support for the generalizability of the method.
4, cross-architecture comparison is insufficient. The comparison methods are mainly concentrated on the deformation field route, lacking horizontal comparison with benchmark methods of native 4DGS, making it difficult to fully reflect the competitiveness of the method in the entire 4DGS field.
Questions and Suggestions
1, regarding the source of comparison data. For all comparison methods in Table 1 except the main baseline TAD-GS, are the metric data obtained by the authors through unified reproduction under exactly the same training and evaluation protocols, or directly cited from the original papers of each method? Please clarify the acquisition approach of the comparison data to confirm the fairness of the horizontal comparison.
2, regarding the selection of structural error operators. The Laplacian operator used in error calculation is relatively sensitive to image noise. In real-world scenarios with acquisition noise, it may cause deviation in error localization. We wonder whether the authors have considered using edge detection operators that are more robust to noise, such as the Sobel operator, to replace the Laplacian operator and improve the stability of structural error detection.
3, regarding the generalizability verification of the densification strategy. The core contribution of the paper focuses on the improvement of the densification strategy, and the experimental verification of this part can be more rigorous. Current comparisons are mostly horizontal comparisons with complete methods of different architectures. Since only the densification component is modified, it is recommended to adopt a control-variable approach: fix all other training settings and model components, and only replace the densification module in different baseline methods with the scheme proposed in this paper, then compare the performance changes. This can more clearly prove that the performance gain indeed comes from the densification strategy itself rather than other architectural differences, and also better reflects the general value of this module.
4, regarding the suggestion on core metric emphasis. The core theme of this paper is densification strategy optimization, and the most direct effect of densification is to optimize the number and spatial distribution efficiency of Gaussians. Among current results, the PSNR improvement of a few tenths of a decibel is relatively heavily affected by factors such as random initialization of training and differences in implementation details, and its supporting strength as the core contribution is limited alone. In contrast, the substantial changes in Gaussian count and storage volume are the most direct and stable reflection of the densification strategy. It is suggested that the authors focus more discussion on the control effect of Gaussian count, and supplement the analysis of Gaussian count changes in different types of scenarios and different regions. This will be more consistent with the core positioning of densification optimization and make the practical value of the method clearer.
Critical strengths
Though the core ideas of both modules are rooted in existing static 3DGS research, this work is the first to integrate them into a sequential densification pipeline and fully extend the framework to 4D dynamic scenes. This constitutes a valuable incremental innovation with notable practical and engineering reference value for the field.
Critical weaknesses
None
Questions for authors
- Clarification: For the comparison methods listed in Table 1 except TAD-GS, were all metrics reproduced under exactly the same training and evaluation protocols (identical resolution downsampling, test split, and rendering settings), or were they directly cited from the original papers? Please clarify the source of these comparison results to confirm the fairness of the cross-method comparison.
- Suggestion: The Laplacian operator used for structural error detection is sensitive to image noise. It would be worth exploring whether more noise-robust edge operators such as Sobel could serve as an alternative, to improve the stability of error localization in real-world noisy acquisition scenarios.
- Requested additional experiment: As the core contribution of the paper lies in the densification strategy itself, please consider adding a control-variable validation experiment. With all other model components and training configurations fixed, replace the densification module in at least one other mainstream baseline (such as Swift4D) with the proposed strategy, and report the resulting performance. This would more firmly verify that the performance gains come from the densification strategy itself rather than other architectural differences, and demonstrate the cross-framework generalizability of the method, which is essential for evaluating the significance of the core contribution.
- Suggestion: Given the paper's focus on densification optimization, it would be more aligned with the core theme to center more discussion on Gaussian count and storage reduction rather than the small PSNR improvement, which can be easily affected by random initialization and implementation details. Further analysis of how Gaussian count varies across different scene types and regions would also better highlight the practical value of the densification strategy.
2 comments
Response to the authors' rebuttal
Thanks, the authors have addressed all my concerns, and I have no further questions.
Response For rMHy
1.We thank the reviewer for raising this important question. We clarify that the results of TAD-GS, Ex4DGS, Swift4D, and 4D-Scaffold in Table 1 are obtained by independently running their official implementations, rather than directly citing results from their original papers. In contrast, the STG results are taken from its original paper. For all reproduced methods, we adopt consistent evaluation protocols, including image resolution, test-view selection, and evaluation metrics, while following each method's official training configuration.
2.We thank the reviewer for this valuable suggestion. To evaluate the effect of the error operator, we replace the Laplacian operator with Sobel on N3DV while keeping all other components and training settings unchanged. The results show that Sobel achieves comparable performance, with only marginal differences in reconstruction quality and Gaussian count.
3.We thank the reviewer for this valuable suggestion. To evaluate cross-framework generalizability, we integrate ELGD-GS densification into Swift4D, replacing only its original densification module while keeping all other model components, initialization, and training configurations unchanged. As shown below, our strategy improves reconstruction quality while reducing the Gaussian count, demonstrating its effectiveness beyond the original TAD-GS backbone.
4.We agree that Gaussian count and storage reduction are more direct measures of densification efficiency. Accordingly, we have expanded our analysis to emphasize these aspects across datasets and spatial regions. Gaussian Count and Storage Reduction Across Datasets. We report the Gaussian count and storage consumption on N3DV and InterDigital. Compared with TAD-GS, ELGD-GS reduces the Gaussian count by 51.26% on N3DV and 52.87% on InterDigital, demonstrating consistent densification efficiency across datasets.
Densification Decisions Across Static and Dynamic Regions. We further analyze cloning and splitting decisions separately in static and dynamic regions across six N3DV scenes. As shown below, ELGD-GS consistently reduces both types of densification decisions in both regions.
Overall, ELGD-GS reduces cloning decisions by 30.50% and splitting decisions by 58.09%. These consistent reductions across static and dynamic regions further demonstrate the effectiveness of our densification strategy.