- Rating
- 3
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This work proposes a geometry-routed multi-view diffusion model for sparse-view novel view synthesis, which combines the advantages of both reconstruction-based NVS methods and diffusion-based NVS methods. It presents three key parts:
(1) Geometry-routed generation: a multi-view diffusion framework whose confidence-aware Visual Geometry Router (VGR) transforms VGGT-Ω features and 3D locations into query-aligned conditions, grounding generative completion in observed scene structure.
(2) Geometry-grounded consistency: Point-Track Residual Consistency (PTRC), which aligns predicted-clean residuals along reliable 3D correspondences to reduce cross-view drift without suppressing valid view-dependent appearance.
(3) Geometry-condition regularization: stochastically attenuating or dropping routed geometry during training to prevent over-reliance on imperfect projections, improving robustness under sparse or inaccurate geometry.
Additionally, the experimental results have proved the effectiveness of these proposed modules.
Critical strengths
- This work is well-organized, making it easy to follow.
- The proposed method is intuitive and interesting, which integrates the advantages of both reconstruction-based NVS methods and diffusion-based NVS methods. It explicitly uses the reconstruction priors to guide the novel view synthesis. In detail, it contains three parts: Geometry-routed generation to integrate the VGGT-Omega features, Geometry-grounded consistency to maintain the multi-view consistency, Geometry-condition regularization to reduce the negative effects of projection noises.
- This paper has presented sufficient experimental results, measuring the effectiveness of the proposed method.
Critical weaknesses
The paper lacks separate front-only and back-only ablations of the residual refinement branch with the hard anchor retained. Consequently, it remains unclear whether the back hypothesis and front hypothesis provide complementary information.
Questions for authors
Projection errors and feature aggregation in Visual Geometry Conditioning may cause misalignment, blurring, or loss of fine details, particularly near boundaries and thin structures.
Thank you for your rebuttal
I thank the authors for their careful and well-defined rebuttal. The authors have conducted all experiments I have asked of them, and have given a clear explanation for all the questions I had about the paper, especially the questions regarding the auxiliary PTRC loss. Their experiment on pointmap-only conditioning also validates their contribution as well, I believe. As I have promised, I raise my score to 4.