- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper suggests a post-hoc fix mechanism for feed-forward driving scene reconstruction. Similar to recent methods that use diffusion to fix reconstruction artifacts, the suggested method uses a dedicated small model to fix both low and high frequency errors, using a learned opacity-conditioned model and projection-based sampling. The suggested method shows generalization across different feed-forward models, is faster than alternatives, and has good quantitative performance.
Critical strengths
- The paper is mostly well-written and easy to follow.
- The suggested method looks practical for driving-scene reconstruction.
- The authors are willing to publish their code for future research.
Critical weaknesses
-
The papers mention the insight and analysis of the correspondence between predicted opacity and the frequency of the errors. However, it briefly mentions it in the introduction, and then states this as a fact instead of proving this claim. While there are more analysis details in the supplementary material, this analysis is still not convincing enough to be claimed as a main contribution. Moreover, while the paper emphasizes this insight, it's not clear how this fact affected the design choices, as there is no explicit frequency-based fixing.
-
Limited comparisons - The method claims superiority over diffusion-based methods, but it seems that it will only work when the rendered view is very close to a reference view, such that the initial rendered target view is good enough and that the projection correction makes sense. However, most diffusion-based methods operate in a very sparse setting where the generative priors allow for reconstruction with very limited information. This comparison setting should be made clearer, and the model should be evaluated under different sparsity configurations. Under these sparse settings, FID (which is generative in nature) should also be reported.
-
Limited novelty - While effective in the evaluated setting, post-fixing feed-forward reconstruction methods are not new. As Artifixer already uses opacity as a measure of how much "fixing" is needed, this method seems to be mostly better engineering for the setting than a novelty.
Questions for authors
- It's not clear how the DCN module differentiates rendering errors from errors caused by the dynamic regions.
- The qualitative figures are extremely low quality, making it very hard to compare the methods.