- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes ARGeoSplat, which extends next-scale autoregressive multiview generation to jointly predict RGB and pointmaps. A downstream Gaussian predictor takes in the predicted pointmaps and refines their depths to enable novel view synthesis. Experiments on GSO and OmniObject3D show that it improves NVS performance and cross-view photometric consistency given a low number of input views.
Critical strengths
- The paper brings RGB + pointmap prediction into a joint processing in autoregressive view synthesis, which is also different from diffusion-based joint appearance-geometry generation.
- Pointmaps can be generated for unobserved target areas.
Critical weaknesses
- The paper doesn't provide comparisons with its closest prior work, such as NAMVIS or Bolt3D, where joint appearance-geometry generation followed by Gaussian prediction is performed. Also, other multi-view 3DGS reconstruction methods are only discussed without evaluation/comparison.
- While the method can predict explicit pointmaps and receive explicit and direct geometric supervision, its geometric accuracy is not evaluated in the main experiment. It remains unclear whether those explicit pointmaps can be used for broad downstream tasks like other reconstruction models such as VGGT, or just included to serve as a starting point for further refinement, leading to marginal performance improvements as observed in Tab.1 and 2 but with additional training, parameter, and methodological complexity overhead.
- Currently, the geometry head is trained through , while depth refinement and Gaussian rendering losses train the downstream reconstruction stage. It remains unclear whether the whole computational graph is end-to-end differentiable or not. If not, it could create a potential mismatch between (1) generated pointmaps and (2) pointmaps that support the best 3DGS and always require a refinement process to compensate for this mismatch.
- The cost volume searches within 10% of the generated depth, excluding larger errors and leaving unsupported pixels unchanged. Currently, there is no analysis or discussion regarding how frequently those extreme cases remain unresolved with their errors preserved. Also, from Tab.4, the benefits after CV seem marginal. It remains unclear how important or sensitive this hyperparameter is and whether it can be generalized to different use cases/datasets.
Questions for authors
See weakness