- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper illustrates the weaknesses of the current dynamic 3DGS: lack of time composability and learning rate degeneration. To mitigate these, this paper decouples direct querying and state transition into two models, and distills the ability of state transition into the direct querying model. According to the experiments, this design shows overall SOTA performance on HyperNeRF and N3DV.
Critical strengths
- The main highlight of the paper is the decoupling of a direct state-free model and a rollout model, which seems to be brand new. This design enables the capabilities of both time querying and motion transition.
- Another strength is the distillation strategy. The direct model is matched with the rollout model at every timestamp; as a result, the direct model gains the ability to perform time querying as well as real motion.
- The experiments and evaluation are reasonably thorough and honestly reported, with three datasets and five representative 4DGS baselines.
Critical weaknesses
I don't doubt the architecture of the method, but the experimental results seem to be less impressive.
- The central claim is weakly convincing. According to the visualization, the rendering results of ours and 4DGS are very similar. The quantitative results also support that the performance of 4DGS and ours is very close. I wonder whether the advantage of the proposed method would diminish if the dataset has a high frame rate.
- The trajectory/flow baselines the paper itself cites as addressing long-term motion consistency (SplineGS, TRiGS, MoRGS, SPIN-4DGS) are not compared with, even though they are the closest competitors to the paper's claimed contribution.
- However, considering motion is still a good aspect. While video timestamps are discrete, motion is continuous. Predicting continuous motion is an intriguing insight.
Questions for authors
- How much does the rollout model contribute to the final performance? Any explanations from both technical and principled perspectives? Preferably supported by experimental results; see Q2.
- Can you provide a direct quantitative evaluation of temporal consistency or long-horizon behavior (e.g., an inter-frame warping error, a temporal-coherence metric, or results on substantially longer sequences) that isolates where the rollout and distillation actually help, rather than relying on aggregate PSNR/SSIM/LPIPS?
- Can the rollout model track the motion of certain Gaussians? For example, there are objects on the desk; can one object be tracked with our model?