- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a generative reconstruction pipeline to recover large-scale indoor PBR meshes from unposed multi-view RGB images. It leverages VGGT-Ω to obtain coarse point cloud and camera priors, partitions scenes into overlapping spatial blocks, and finetunes TRELLIS.2 with reconstruction based conditioning to generate per-block geometry and materials. Experiments are conducted on synthetic 3D FRONT and real world ScanNet++ datasets, showing improved quantitative metrics over several baselines.
Critical strengths
- The paper targets a practical and important problem, namely large-scale scene mesh reconstruction from casually captured unposed multi-view images.
- Implementation details are relatively complete, including dataset curation, training recipes and ablation studies for key modules.
- Quantitative comparisons against strong baselines (VGGT-Ω+TSDF, MonoSDF, FineRecon, GenRecon) on both synthetic and real indoor datasets demonstrate clear performance gains.
Critical weaknesses
- This work assembles existing components into a working pipeline for unposed multi-view scene reconstruction. While the system works empirically, there are few genuinely new technical insights.
- The whole pipeline relies on VGGT-Ω to provide coarse camera poses and global point cloud scaffold. Although the paper claims robustness against imperfect priors, failure cases clearly show that severe pose/geometry errors from VGGT-Ω propagate and lead to missing or distorted reconstruction. It would be valuable to quantify performance degradation under different levels of pose noise in controlled experiments.
- Among all compared methods, only GenRecon adopts a 3D generative prior to perform structured completion for occluded scene regions. Currently the evaluation pool mixes high capacity generative models and pure reconstruction pipelines with different capability boundaries and computational complexity, which makes overall metric gains harder to interpret.
- There is no comparison of computational overhead, including model size, training memory cost and inference runtime.
- Current limitation analysis is brief; please elaborate more about failure modes besides VGGT-Ω error propagation, e.g. thin geometry, reflective surfaces, repeated structures hallucination.
Questions for authors
- This work assembles existing components into a working pipeline for unposed multi-view scene reconstruction. While the system works empirically, there are few genuinely new technical insights.
- The whole pipeline relies on VGGT-Ω to provide coarse camera poses and global point cloud scaffold. Although the paper claims robustness against imperfect priors, failure cases clearly show that severe pose/geometry errors from VGGT-Ω propagate and lead to missing or distorted reconstruction. It would be valuable to quantify performance degradation under different levels of pose noise in controlled experiments.
- Among all compared methods, only GenRecon adopts a 3D generative prior to perform structured completion for occluded scene regions. Currently the evaluation pool mixes high capacity generative models and pure reconstruction pipelines with different capability boundaries and computational complexity, which makes overall metric gains harder to interpret.
- There is no comparison of computational overhead, including model size, training memory cost and inference runtime.
- Current limitation analysis is brief; please elaborate more about failure modes besides VGGT-Ω error propagation, e.g. thin geometry, reflective surfaces, repeated structures hallucination.
2 comments
Thank you again for reviewing our paper and sharing your comments. As the discussion period draws to a close, we would appreciate any further feedback on our responses. Please let us know if anything needs further clarification.
[1/1] Response to Reviewer FuUf
We sincerely thank Reviewer FuUf for thoughtful review and insightful questions. We appreciate the reviewer’s positive assessment of our problem’s practical importance and the clear performance gains. Below is our point-by-point response. Changes are marked in blue in the revised manuscript.
(W1, Q1) Technical insights
WorldRecon extends overlapping-block generation to reconstruction from unposed multi-view images, providing an end-to-end pipeline from casual captures to complete scene meshes with materials. Our reconstruction-based block generators fuse multi-view observations and coarse geometric priors through learned attention-based conditioning, accommodating imperfect poses and geometry. Our causal pipeline first assembles a global sparse structure, then generates geometry and material latents conditioned on it and previously generated neighbours, adapting established clamping and blending mechanisms accordingly for cross-block consistency.
(W2, Q2) Robustness to pose noise
Tab. R1 compares WorldRecon with GenRecon under progressively stronger perturbations, starting from GT poses and depth. We use rotation/translation/depth RMS levels of Light (1°, 5 cm, 2.5 cm), Medium (2°, 10 cm, 5 cm), and Heavy (4°, 20 cm, 10 cm). WorldRecon achieves better overall reconstruction metrics across all perturbation levels on both datasets and exhibits smaller degradation. From Clean to Heavy, CD increases by only 0.0603/0.0525 for Ours on 3D-FRONT/ScanNet++, compared with 0.1838/0.2362 for GenRecon, supporting our robustness to imperfect geometric priors.
Table R1: Ablation on Input Pose and Depth Perturbation Levels
(W3, Q3) Fair comparison of reconstruction and generative completion
Thank you for your question. We evaluate both reconstruction-only and generative methods against GT using the same metrics for reconstruction fidelity and completion. Pure reconstruction baselines indicate what can be recovered from limited visual observations, while GenRecon provides a generative reconstruction baseline that also completes unseen regions. Tab. 1–2 and Appendix Tab. S2 show that WorldRecon achieves better performance than GenRecon on both datasets under predicted and GT pose/depth settings. Tab. R2 below further shows WorldRecon achieves a lower average runtime than GenRecon.
(W4, Q4) Computational overhead
Tab. R2 compares computational overhead across methods. Since peak training memory usage is not consistently reported, we provide the training hardware configuration as an indication of the maximum available GPU memory, rather than actual memory consumption.
Table R2: Comparison on computational cost
* GenRecon does not report its training hardware or GPU-hours. We report our local GPU configuration and estimate its training cost.
(W5, Q5) More failure modes
We provide additional failure cases in Appendix D.3, Fig. S4 of the revised manuscript, illustrating failures involving thin geometry, reflective surfaces, and hallucinated repeated structures.