- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates how dynamic Gaussian splatting can accurately and efficiently model appearance that varies with time and viewpoint. Existing 4D Spherical Harmonics (4DSH) methods typically assign a full set of spherical harmonic coefficients to each Gaussian particle. However, Gaussians differ substantially in their contributions to the rendered image and the complexity of the appearance that they need to represent, leading to redundancy in the allocated coefficients.
To address this issue, this paper proposes OccamSplat, which core idea is to adaptively determine the appearance representation complexity required by each Gaussian based on its actual rendering benefits. Specifically, the method follows an “evaluate, select, and validate” strategy. It first computes gradients for candidate 4DSH bands, then selects updates based on the consistency of image loss gradients across views, and finally uses joint rendering validation to decide whether to activate new bands.
The authors conducted experiments on N3DV, MeetRoom, and Technicolor. On N3DV, OccamSplat increases rendering speed by 157% and reduces model size by approximately 19.4% compared with Swift4D, while also achieving a slight PSNR improvement of 0.09dB. These results demonstrate efficiency gains without sacrificing reconstruction quality.
Critical strengths
Traditional SH capacity allocation methods based on rendering residuals have difficulty directly determining whether additional appearance coefficients will improve reconstruction quality. In contrast, OccamSplat directly links 4DSH capacity allocation to the reconstruction benefits of specific parameter updates, rather than relying solely on the current rendering error. The most compelling evidence comes from Table 3. With the same 4DGS backbone and matched training time and appearance parameter budgets, OccamSplat achieves a PSNR of 32.20dB, outperforming residual based SH growth (31.78dB) and learnable band masks (31.85dB) by 0.42dB and 0.35dB, respectively. This further demonstrates the effectiveness of the allocation strategy.
Critical weaknesses
-
OccamSplat does not show a substantial reconstruction quality advantage across datasets. On MeetRoom (Table 6), its average PSNR is 31.60dB, below Swift4D’s 32.05dB. On Technicolor (Table 7), its average PSNR is 33.77dB, below 4DScaffold-GS (34.11dB) and CEM-4DGS (34.04dB). More importantly, the additional MeetRoom and Technicolor experiments in the appendix report only PSNR, but not report FPS, model size,n or training time on these datasets. It is therefore unclear whether sufficient efficiency gains compensate for the lower reconstruction quality.
-
The paper provides limited evidence of how well the appearance capacity allocation strategy transfers across backbones. The main experiments on N3DV, MeetRoom, and Technicolor use real multiview videos. However, the transfer to the SC-GS backbone in Sec. 5.5 is demonstrated using only a single failure case from D-NeRF, a monocular synthetic video dataset, and the speedup is limited. A comprehensive quantitative evaluation using data consistent with the main experiments is missing. The paper also does not examine whether incorporating the same allocation strategy into improved 4DGS methods, such as Ex4DGS, yields consistent gains. I notice that the code submitted in Supplemental includes an attempt to apply the strategy to Ex4DGS, can the authors show the comparison result on Ex4DGS backbone with the proposed strategy? It is difficult to assess the gains in reconstruction quality, model capacity, and efficiency on other backbones, or to determine how much the strategy’s effectiveness depends on the specific 4DGS implementation.
Questions for authors
-
This paper uses joint rendering validation to decide whether to add 4DSH bands. In Sec. 4.4, updates to a group of candidate Gaussians are applied simultaneously, and the decision to activate the corresponding parameters is based on the change in the overall reconstruction loss, rather than an assessment of each Gaussian individually. Could the authors investigate whether Gaussians with small or even negative contributions can receive additional parameters when only some Gaussians in the group produce substantial gains? If this occurs, could the authors evaluate its impact on capacity allocation and reconstruction quality?
-
Table 2 shows that removing the validation mechanism also increases the proportion of activated coefficients from 12.8% to 25.0% and 58.6%. I would like to understand whether the reported performance gains come from the joint validation criterion itself or from the stricter capacity constraint.
-
Prior work has already explored appearance capacity allocation for individual Gaussians from several perspectives. The related work section discusses EfficientGS [1] and RDO-Gaussian [2], which adjust SH representations to accommodate differences in appearance complexity across Gaussians. RD4DGS [3] further extends adaptive SH allocation to dynamic scenes, and Table 3 includes comparisons with these approaches. However, the closely relevant GauRep [4], which is not cited in the paper, already uses loss gradients with respect to SH coefficients to adaptively determine whether to increase the SH order of each Gaussian. OccamSplat extends this direction to dynamic reconstruction and uses gradient consistency across observations and joint rendering validation to decide whether to activate new 4DSH bands. What additional benefits does this validation mechanism provide over existing methods, particularly for modeling dynamic appearance? A more detailed discussion of the differences from gradient driven SH order adaptation methods such as GauRep would help clarify the novelty of this work.
I would consider raising my recommended score if the authors can address my concerns appropriately.
References:
[1] "Efficientgs: Streamlining gaussian splatting for large-scale high-resolution scene representation." IEEE MultiMedia, 2025.
[2] "End-to-end rate-distortion optimized 3d gaussian representation." European Conference on Computer Vision. 2024.
[3] "Temporal smoothness-aware rate-distortion optimized 4D Gaussian splatting." Advances in Neural Information Processing Systems, 2026.
[4] "Effective Gaussian Management for High-fidelity Scene Reconstruction." IEEE Transactions on Visualization and Computer Graphics, 2026.
Post-rebuttal Comments
After reading the authors' rebuttal, I am convinced by the new experiments that the method works on various datasets, with good efficiency and performance trade-off. The authors’ explanation of how their approach differs from GauRep also helps clear up my concern. As such, I would like to raise my rating from Weak Rejection to Weak Acceptance.