- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a feed-forward 3D Gaussian Splatting framework for better view extrapolation. Specifically, DiFSplat uses intermediate diffusion features from pretrained diffusion models to guide unseen regions. By applying extrapolative fine-tuning, DiFSplat shows relatively higher fidelity in extrapolated areas.
Critical strengths
While many methods use diffusion generated images as prior, DiFSplat extracts intermediate diffusion features to guide unobserved areas, which can be considered a novel idea.
Critical weaknesses
The claimed problem does not seem to be solved. The proposed method is still struggling to generate unseen areas with high fidelity as shown in the qualitative results. It is expected that after explicit extrapolative training the model can provide more reasonable novel parts instead of large artifacts, and feed-forwardly fix that would be valuable. However, the current reults are far from applicable with still severe artifacts. For the mild extrapolation in DiFSplat's experiment setting, simply run a SOTA camera conditioned video generation model and then a feed-forward recontruction model can already provide high quality 3DGS results covering unseen areas in the input views. Thus this method does not provide clear advantage.
Questions for authors
The authors are welcomed to address my concerns raised in the Weaknesses section by clarifying the advantage of DiFSplat.