- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents a two-stage framework named SceneWeaver, which constructs an edited Gaussian scene from a single image. The key idea is to generate multiple appearances under a fixed geometric prior and distill them into a shared Gaussian representation. Specifically, SceneWeaver progressively constructs a scene point cloud and then reuses its fixed geometry to generate multi-view videos to expand the scene geometry and appearance. In addition, the authors leverage a Gaussian representation to model residuals between the edits and the original appearance. Furthermore, the authors introduce a scene-editing benchmark and evaluate the reconstruction and editing quality of SceneWeaver through extensive experiments.
Critical strengths
- This paper proposes a 3D Gaussian editing method from a single image with a strategy that progressively expands the point cloud.
- This paper introduces a scene-editing benchmark with indoor and outdoor scenes.
Critical weaknesses
- In Section 3.1, the authors leverage Depth Anything to estimate monocular depth and progressively update the point cloud. Although the authors apply depth scale alignment, the relative depth estimates may still introduce geometric inconsistencies during iterative point cloud construction. Additional ablations using different depth estimators would help assess the robustness of this process.
- In Section 3.1, SceneWeaver leverages the depth estimated from the reference image for initialization. In Section 3.2, SceneWeaver mainly updates SH colors and opacity without updating other Gaussian attributes. When the authors edit scenes involving geometry changes (e.g., adding balloons in Figure 4), it is unclear whether such edits can maintain plausible 3D geometry and multi-view consistency.
- The method evaluates novel view synthesis on the Mip-NeRF 360 and Tanks and Temples datasets, but the appearance editing experiments are primarily conducted on the authors' constructed benchmark. Additional appearance editing experiments on public datasets (e.g., Mip-NeRF 360, Tanks and Temples, and Instruct-NeRF2NeRF) would be helpful.
- Although the related work discusses several 3D scene editing approaches, the experimental evaluation lacks direct comparisons with representative 3D editing methods, such as Instruct-NeRF2NeRF [1], GaussianEditor [2], and GaussCtrl [3].
[1] Instruct-nerf2nerf: Editing 3d scenes with instructions. ICCV 2023. [2] Gaussianeditor: Swift and controllable 3d editing with gaussian splatting. CVPR 2024. [3] Gaussctrl: Multi-view consistent text-driven 3d gaussian splatting editing. ECCV 2024.
Questions for authors
Please refer to the Critical Weaknesses.