- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The prior work, LVDSK, proposes learning view-dependent splatting kernels using neural networks instead of fixed Gaussian kernels. This paper extends LVDSK to dynamic scene reconstruction using native 4D Gaussian primitives. It applies spatial kernel learning to time-conditioned 3D geometry and introduces a center-anchored temporal kernel. Experiments on N3V and D-NeRF show improved reconstruction quality over 4DGS and UBS.
Critical strengths
- Well-motivated by LVDSK's improvements on static scenes, this work presents a useful representation for dynamic scene reconstruction.
- The method achieves better reconstruction quality at similar memory footprints.
While I acknowledge these strengths, my initial score is primarily driven by the concerns below. I am willing to revise my recommendation toward acceptance if the authors adequately address my concerns during the rebuttal period.
Critical weaknesses
- While effective, the contribution appears incremental relative to LVDSK rather than a fundamentally new contribution.
- As native 4DGS produces time-conditioned 3D primitives for rendering, applying LVDSK’s latent-based neural projection and radial decoding to these primitives is straightforward.
- The temporal decoder closely follows LVDSK’s design.
- The pre-training approach is also inherited from LVDSK.
- On N3V, the temporal kernel yields a modest improvement of 0.18 dB, whereas the spatial kernel achieves a larger gain of 0.29 dB.
- The experiments do not sufficiently distinguish the proposed method from other alternative extensions.
- The motivation for more flexible kernels is reasonable, but comparisons are restricted to 4D kernels (see Q1 for more detail).
Questions for authors
- Why should the learnable kernel be designed as 4D for dynamic scene reconstruction? LVDSK could be extended to alternative approaches, such as:
- (a) Online per-frame 3DGS reconstruction (e.g., IGS [1] or more recent methods),
- (b) Deforming canonical 3DGS over time (e.g., E-D3DGS [2] or more recent methods).
- These comparisons would provide a more meaningful insight beyond simply extending LVDSK to dynamic scenes.
- How robust is the proposed method to varying lengths of the input video sequence? Specifically, does the method require hyperparameter re-tuning when scaling to significantly shorter or longer video sequences?
[1] Yan et al. "Instant Gaussian stream: Fast and generalizable streaming of dynamic scene reconstruction via Gaussian splatting." CVPR 2025.
[2] Bae et al. "Per-Gaussian embedding-based deformation for deformable 3D Gaussian splatting." ECCV 2024.
Response to Reviewer Ak4Z
Thank you for your constructive comments and suggestions.
Response C1. (W1) Novelty beyond LVDSK.
Please refer to Response A1.
Response C2. (W2, Q1) Choice of 4D representation.
We adopt 4DGS because its unified representation provides a natural foundation for the joint kernels learning. Our framework could also be incorporated into other dynamic representations.
Response C3. (Q2) Robustness to sequence length.
Our method does not assume a fixed number of frames. We normalize sequence timestamps to a fixed range and evaluate temporal kernels continuously using normalized relative time instead of frame indices, without requiring changes to the representation or network architecture for different sequence lengths.
We evaluated our method on three real-world datasets (N3V, Technicolor, and Google Immersive) with varying sequence lengths. Our method achieves high reconstruction quality without sequence length specific hyperparameter tuning.