- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents R$^2$, a VGGT-based framework for 3D reconstruction. The method derives a cross-view rigid-consistency prior from a frozen teacher to guide camera-token attention and introduces a camera- and depth-conditioned refinement module to improve the predicted 3D points. Experimental results show mixed improvements in camera pose and depth estimation over VGGT, while a controlled ablation demonstrates reduced point reconstruction errors with the proposed refinement module.
Critical strengths
- Relevant research problem. The paper explores an important direction of incorporating explicit geometric consistency and coupling into feed-forward 3D reconstruction.
- Efficient architectural design. The proposed modules largely preserve VGGT’s pretrained architecture and require only selective fine-tuning, offering a practical way to incorporate additional geometric constraints.
Critical weaknesses
- The paper could benefit from further analysis of the motivation behind the proposed modifications. While the importance of explicit geometric consistency and coupling is well motivated, I would appreciate a clearer explanation of how the proposed modules (i.e., residual-guided camera attention and point refinement) specifically address the identified limitations. Given the mixed empirical improvements, a deeper analysis of the underlying failure modes and how each module helps mitigate them would make the methodological contributions more convincing.
- The geometric prior is derived entirely from the frozen VGGT teacher’s predictions, and its additional value beyond the pretrained representation could be further clarified. While explicitly modeling geometric consistency may provide a useful inductive bias, I wonder whether similar improvements could be achieved through model adaptation alone. A controlled comparison and an analysis of sensitivity to teacher prediction errors would help better understand and justify the benefits of the proposed prior.
- I would appreciate further clarification on several key technical details, including how cross-view correspondences are obtained and filtered, how correspondence uncertainty in Eq. (4) is computed, and how the 16-channel camera encoding in Eq. (9) is constructed. As these are central components of the proposed method, more detailed explanations would be valuable for reproducibility and for understanding the design choices. Without these details, I find it difficult to fully assess the technical soundness of the geometric prior and refinement module.
- The experimental evidence is not sufficiently convincing. The proposed method does not consistently outperform strong baselines and shows lower performance than the original VGGT across all reported camera metrics on DyCheck. Additionally, I noticed that the highlighted 12.57% reduction in median point error comes from an ablation with a different training configuration from the final model. I wonder if the authors could further clarify this discrepancy and isolate the contribution of camera and depth conditioning from the general benefit of introducing a refinement network. These additional analyses would help better establish the effectiveness of the proposed components.
Questions for authors
- Please see the concerns raised in the Weaknesses section.
- I would appreciate further analysis or visualizations illustrating when and why geometric guidance helps or potentially hurts performance. A direct depth-unprojection baseline and an evaluation of the trade-off between accuracy and computational cost would also help better understand the practical benefits of the proposed design.
- It would be helpful if the authors could use author–year citations consistently throughout the manuscript, distinguishing between narrative citations (e.g., “Smith et al. (2024) propose …”) and parenthetical citations (e.g., “… (Smith et al., 2024)”).