- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
In the field of sparse-view 3D reconstruction, instead of generating novel views for more view coverage, this paper proposes to conduct multiview outpainting on the input views alone for larger FOV coverage. The authors mainly present a Geometry-aware Multi-view Outpainter along with a reconstruction pipeline. Specifically, they apply geometry-aware conditioning, latent blending and mask scheduling to the pre-trained MVGenMaster. The results show that GaMO can reconstruct more background area comparing with other sparse-view 3D reconstruction methods.
Critical strengths
The claim of multiview outpainting is more stable than generating novel views is definitely correct, and the authors provide sufficient experiments to verify that. While most methods are generating novel views, I consider this idea a novel one.
Critical weaknesses
Outpainting can reconstruct more background area is expected, and comparing with methods that are not meant for outpainting is not fair. Simply using outpainting will never be the solution to sparse-view 3DGS reconstruction because unseen areas apart from the background remains unseen. This can be proved from the provided results where DIFIX3D+'s details are obviously better. Outpainting is useful, but disgarding generating novel views is not.
Questions for authors
I suggest the authors train a model that can both generate novel views (or fix view artifacts like DIFIX) and conduct outpainting, so that the claim should be more applicable.
Revised Positioning and Complementarity with NVS
1. Revised Paper Positioning: Outpainting as a Complement to NVS (W1/Q1)
We thank the reviewer for the constructive feedback and for recognizing the usefulness of outpainting. We agree that outpainting cannot replace novel-view synthesis, particularly because expanding the original FOV alone cannot recover occluded regions. Accordingly, we have reframed our core contribution: GaMO is a zero-shot multi-view outpainting diffusion model that generates geometrically consistent outpainted views to assist sparse-view 3D reconstruction. These views expand scene coverage and complement existing NVS methods rather than replacing them.
To examine whether outpainting and NVS can be effectively combined, as the reviewer suggests, we incorporated GaMO-generated outpainted views into Difix3D, GenFusion, and GuidedVD-3DGS, and evaluated their performance under the 3-view and 6-view settings on Replica and ScanNet++.
The averaged results (PSNR↑ / SSIM↑ / LPIPS↓) are summarized below:
For reference, standalone GaMO-GS achieves 23.93 / 0.843 / 0.156.
The results demonstrate that incorporating GaMO-generated outpainted views improves the average PSNR, SSIM, and LPIPS across all three methods, with PSNR gains of +2.19, +1.16, and +0.61 dB, respectively. These findings confirm that outpainting can effectively complement existing NVS methods by expanding scene coverage.
We also agree that directly ranking our pipeline against methods not designed for outpainting should not be the primary comparison. Therefore, the revised Table 1 emphasizes comparisons of each existing method with and without GaMO-generated outpainted views, directly demonstrating the complementary benefits of our approach.
Terminology: In the revised manuscript, GaMO denotes the outpainting diffusion model, while GaMO-GS refers to the complete 3DGS reconstruction pipeline using GaMO-generated views, previously referred to as "Ours".
2. Revised Contributions and Integration with Existing NVS Methods (W1/Q1)
Following the reviewer's suggestion, we have substantially revised the paper's positioning and contribution statements. Rather than presenting outpainting as an alternative to NVS, we now emphasize GaMO as a zero-shot multi-view outpainting diffusion model that generates geometrically consistent views to complement existing NVS methods, expanding scene coverage and improving sparse-view 3D reconstruction.
Regarding the suggestion to train a single model that performs both novel-view generation (or artifact fixing, as in Difix3D) and outpainting, we agree that this is a valuable direction. Since GaMO operates in a zero-shot manner without requiring additional training, we instead investigate its integration with existing novel-view generation and artifact-refinement methods through complementary outpainted training views.
Our results demonstrate improvements across all three methods, validating the effectiveness of combining outpainting with NVS. While jointly training a unified model remains a promising direction for future work, our experiments demonstrate that the two capabilities can already work effectively together without additional model training.
These revisions are reflected throughout the updated manuscript, with the complete results presented in Table 1 of the main paper and implementation details provided in Appendix A.