- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduced GG4D that addresses dynamic novel-view synthesis by combining explicit geometry with an implicit renderer. It separates static and dynamic regions using clustered features from a frozen geometric backbone, constructs a time-indexed point cloud, and introduces LaCAT to encode input observations into reusable scene memory. Experiments shows that the proposed method improved image quality and multi-view consistency on multiple benchmarks, alongside ~58 FPS rendering at 512 resolution after scene construction.
Critical strengths
-
Strong empirical performance across multiple settings. GG4D improves over the strongest feedforward baseline by approximately 3.6 dB on DyCheck and 2.6 dB on Neural3D, while achieving the lowest MEt3R across all four benchmarks. Additional camera-pose and resolution evaluations strengthen confidence in the reported comparisons.
-
The paper proposed an effective integration with practical rendering efficiency. Cluster-based segmentation improves over token-level classification, and its downstream rendering quality approaches that obtained with ground-truth masks on the evaluated NVIDIA subset. Separating scene construction from rendering also enables interactive rendering after preprocessing.
Critical weaknesses
-
I think the segmentation contribution is insufficiently differentiated from closely related work. Motion segmentation using geometric foundation-model features is already explored by VGGT4D and GeoMotion,. However, Easi3R is particularly relevant: it already uses encoder-feature clustering and cluster-level aggregation of dynamic scores to improve motion segmentation. DAS3R also trains a dynamic-mask prediction head on frozen geometric-model features. Neither is discussed in the submission. GG4D’s supervised cluster classifier and refinement network differ from these approaches, but the conceptual and empirical advantages need clearer justification. Static–dynamic decomposition itself is also established in previous work such as D²NeRF, which limits the novelty of this paper.
-
The specific advantage of LaCAT’s memory-writing design is not fully established. Reusable fast-weight scene representations have already appeared in LaCT, tttLRM, and FSM. LaCAT’s contribution is therefore the query-addressed, attention-augmented regression target. The current ablations do not compare this design against cross-view attention followed by a standard LaCT update, which could also perform attention only during scene construction. Moreover, cross-view attention improves over intra-view attention by only 0.07 dB on NVIDIA, and the ablations use a smaller renderer. These limitations leave the necessity of the proposed target construction uncertain.
-
There are wierd citations in Reference, such as line 540: FIXME Feng et al. In-place test-time training. In International Conference on Learning Representations (ICLR), 2026. arXiv:2604.06169, and line 638: FIXME Ouyang, FIXME Cai, and FIXME Hu. Fixme title. arXiv preprint arXiv:2606.21803, 2026.
Questions for authors
- How does the proposed cluster classifier improve upon Easi3R’s clustering-based aggregation of motion evidence? Can a controlled comparison using the same backbone features and evaluation protocol isolate the benefit of the learned cluster readout?
- Under matched training, model capacity, and scene-construction compute, how does LaCAT compare with cross-view attention followed by a standard LaCT update? Does the advantage persist with the full renderer on dynamic benchmarks?
Thank you very much for the detailed response and the additional experiments. After reading authors’ responses and the other reviewers’ comments, Most of my concerns are solved. However my remaining concerns is still the methodological contribution. I see GG4D as a well-executed integration of prior ideas, with useful refinements in dynamic region segmentation and fast-weight memory writing. The new results demonstrate the value of these refinements, but I still think the overall contribution over prior work relatively modest. So I lean towards weak rejection.