- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper appears to violate the official ICLR formatting guidelines by modifying the margins to fit more content.
A 3D Gaussian Splatting (3DGS) reconstruction framework specifically designed for challenging real-world scenes with sparse input views and transient dynamic distractors.
Critical strengths
-
Novel Problem Setting: The paper addresses 3DGS reconstruction in challenging real-world scenes with both sparse input views and transient distractors. This is a practical problem that existing distractor-removal and sparse-view reconstruction methods may struggle to handle simultaneously.
-
Adaptive Distractor Suppression: Instead of using manually tuned thresholds, the method employs a Gaussian Mixture Model (GMM) to generate static and dynamic pseudo-labels from RGB residuals and uncertainty estimates. An MLP then predicts distractor masks at the pixel level, while a progressive masking strategy at different training stages helps reduce the impact of transient objects on gradient updates.
Critical weaknesses
-
Heavy Reliance on Pre-trained Models: The pipeline depends on multiple pre-trained models, including image matching, Depth Anything 3, DINOv3, and SAM3. Errors in challenging scenarios, such as extreme lighting, severe occlusion, or unusual viewpoints, may propagate through mask generation and pseudo-label construction, compromising reconstruction quality.
-
High Computational Cost and Pipeline Complexity: The extensive use of 2D foundation models introduces substantial overhead. Feature extraction, mask generation, and background detection alone take approximately 77 seconds for 12 views, excluding the subsequent 3DGS optimization. This limits the method’s practicality in resource-constrained or time-sensitive settings.
-
Limited Robustness to Illumination Changes: The method assumes that the appearance of static objects and environmental illumination remain largely unchanged. This assumption may not hold for images captured under different lighting or weather conditions, limiting its robustness in diverse in-the-wild scenarios.
Questions for authors
Beyond the weaknesses mentioned above, could the authors provide additional video visualizations to better demonstrate the method’s robustness, particularly under challenging conditions such as extreme lighting, rapid motion, and other difficult scenarios?
Response to Reviewer qd9P
We thank Reviewer qd9P for your thoughtful comments and spending time to review our paper. We respond to your questions point by point as follows.
A: We sincerely apologize for it. In fact, this was an unintentional formatting error due to some incorrect LaTeX preamble settings that we had overlooked rather than a deliberate attempt to accommodate more content. We have fixed problems in the revised manuscript which meets the requirements of ICLR formatting.
A: We acknowledge that these challenging scenarios are meaningful but they are out of scope in this paper, which focuses on distractor-free sparse-view 3DGS reconstruction. Extreme lighting [1], severe occlusion [2], or unusual viewpoints [3] can be individually treated as a research direction, which is difficult to let one paper concern all the extreme cases.
In addition, our method has a certain degree of robustness under such extreme conditions. Rather than directly relying on pretrained model as fixed supervision, our coarse-to-fine progressive mask generation framework incorporates a subsequent mask refinement stage, allowing inaccurate predictions to be progressively corrected during optimization.
A: In the appendix of our manuscript, the 77 seconds covers the entire reconstruction pipeline including the 3DGS optimization described in Sec. 3.3. The 3DGS optimization takes 59 seconds accounting for approximately 76% of total runtime, while the preprocessing module only takes about 18 seconds accounting for about 24% of total runtime. Hence, the preprocessing module introduces relatively little computational overhead compared with the 3DGS optimization.
A: We think it is reasonable to mainly focus on removing distractors and assume there is no huge environmental illumination changes in our paper. Existing studies on 3D reconstruction in the wild can be categorized into two main research directions: removing distractor [4, 5] and handling illumination changes [6, 7]. Our work falls into the former one.
In addition, our method exhibits some robustness to illumination variations. We assign each image a learnable embedding which is fed into the mask prediction MLP. It can learn the appearance of each image including different lighting and thus alleviate the influence of illumination changes.
A: We have now provided videos of reconstructed 3D scenes in the supplementary material.
References:
[1] Cui, Ziteng, Xuangeng Chu, and Tatsuya Harada. "Luminance-gs: Adapting 3d gaussian splatting to challenging lighting conditions with view-adaptive curve adjustment." CVPR 2025.
[2] Liu, Shiyong, et al. "Occlugaussian: Occlusion-aware gaussian splatting for large scene reconstruction and rendering." ICCV 2025.
[3] Li, Jiahe, et al. "Evpgs: Enhanced view prior guidance for splatting-based extrapolated view synthesis." CVPR 2025.
[4] Fu, Chuanyu, et al. "Robustsplat: Decoupling densification and dynamics for transient-free 3dgs." ICCV 2025.
[5] Wang, Xu, et al. “DualSplat: Robust 3D Gaussian Splatting via Pseudo-Mask Bootstrapping from Reconstruction Failures.” CVPR 2026.
[6] Cui, Ziteng, Xuangeng Chu, and Tatsuya Harada. "Luminance-gs: Adapting 3d gaussian splatting to challenging lighting conditions with view-adaptive curve adjustment." CVPR 2025.
[7] Zhang, Dongbin, et al. "Gaussian in the wild: 3d gaussian splatting for unconstrained image collections." ECCV 2024.