- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes a framework for inverse rendering in a reconstructed 3D Gaussian scene. It combines object observations with surrounding scene context and source illumination to jointly estimate material properties and surface normals, supporting downstream relighting and material editing.
The overall novelty is moderate, primarily extending GS-PI through illumination conditioning, joint material–normal prediction, and architectural changes. However, all quantitative evaluations assume access to the GT environment map, which limits the generalization of the framework. Experiments show that the proposed framework achieves substantial improvements in material decomposition and relighting.
Critical strengths
-
The paper is clearly written and easy to follow, with a well-explained technical design.
-
Incorporating source illumination and surrounding scene context is well motivated and helps resolve ambiguity in material decomposition.
-
Quantitative and visual comparisons demonstrate strong material decomposition and competitive relighting performance, including when baselines receive the same GT environment maps.
Critical weaknesses
-
Dependence on known illumination. The framework relies on the provided GT environment lighting, which limits the application scenarios of the framework.
-
Limited evaluation of highly reflective objects. Dedicated tests on glossy and highly reflective objects would better assess the benefits of illumination and surrounding scene conditioning.
-
Limited evaluation of cluttered scenes. Beyond the reported failure case, systematic evaluation of complex object arrangements is needed to assess robustness to occlusion and preprocessing errors.
-
Limited novelty. The method extends GS-PI’s point-diffusion framework through illumination conditioning, joint material–normal prediction, and network modifications. These incremental contributions also bring new limitations: the need for GT environment lighting.
Questions for authors
-
How could the framework operate with unknown illumination? Could the authors discuss a practical approach and its limitations?
-
Could the authors provide experiments on glossy and highly reflective objects to better validate the benefits of illumination conditioning?
-
Could the authors provide evaluations in scenes with more complex object layouts, including at least high-resolution visual comparisons?