- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies the problem of dynamic 3d gaussian reconstruction. This paper proposes Motion-MoE-GS, a dynamic 3D Gaussian method for reconstruction. The method can also perform motion extrapolation. It uses a Neural ODE to evolve a scene-level dynamic state, which each Gaussian combines with its own local feature. They introduce a router that selects the top 2 deformation experts to predict delta position, rotation, and scale. The paper considers these experts as reusable local motion laws and argues that decoding all deformations with one shared network is suboptimal. On the NVFI-Obj and DynMultiParts datasets, they report improved PSNR, SSIM, and LPIPS on most scenes, for both reconstruction and extrapolation. They provide ablations on expert count, routing, conditioning, and the ODE.
Critical strengths
-
clear and intuitive motivation. The idea that motion is locally coherent but globally heterogeneous is easy to understand. Replacing a single shared deformation decoder with a small bank of experts for different motions is a straightforward method following this idea.
-
Reasonable method design. The router is conditioned on both the Gaussian's local feature and the Neural ODE's global state.
Critical weaknesses
- Per-Gaussian Top-K gating over multiple deformation experts, composed as weighted attribute offsets on shared canonical Gaussians, is already the central design of MoDE and MoE-GS in [1]. However, the authors do not compare against them. The remaining differences are an ODE-conditioned router, homogeneous experts, and an extrapolation focus. Experiments should separate these from the prior design, for example by swapping in a MoDE-style gate on the same backbone. Moreover, some related prior works are missing. ODE-GS [2] already argues that time-conditioned deformation fails out of distribution and uses a latent ODE for extrapolation, and MoGaF [3] also decomposes motion explicitly for dynamic scene forecasting.
[1] On the Design of Mixture-of-Experts for Dynamic Gaussian Splatting.
[2] ODE-GS: Latent ODEs for Dynamic Scene Extrapolation with 3D Gaussian Splatting
[3] Space-Time Forecasting of Dynamic Scenes with Motion-aware Gaussian Grouping.
- The idea of decomposing local motion laws is intuitive and reasonable. However, the paper does not clearly (e.g., quantitatively) demonstrate that the experts effectively specialize in different motion regimes. Moreover, the definition of the balance loss is not given in the paper. The experiments show that "Removing the balance loss likewise reduces extrapolation PSNR by 0.4107 dB and 3.2910 dB, respectively, and degrades the remaining extrapolation metrics". A deeper analysis of the reason behind this result would be very helpful to understand how the method works.
Questions for authors
-
As shown in Tables 1 and 2, LPIPS is worse than the baselines in many scenes. Could the authors explain these results? Also, providing video demos would help assess the actual quality of the results.
-
Evaluation covers only two synthetic datasets. Experiments on more datasets, as in ParticleGS, would improve the evaluation.