- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces MAGS, a method for improving novel view synthesis in reflective scenes by encouraging spatial consistency in estimated material properties. Building upon SpecGloss-GS, a physically based rendering framework using 2D Gaussian Splatting, the proposed method introduces a mask-guided material regularization loss. Specifically, SAM2 segmentation masks are used to define regions within which rendered material attributes, including albedo, roughness, and metallic values, are encouraged to remain consistent by penalizing their deviations from the regional mean. This regularization is incorporated into the differentiable rendering pipeline to optimize the underlying Gaussian material parameters. The method is evaluated on the synthetic ShinyBlender and real-world Ref-Real datasets, with comparisons against several Gaussian Splatting-based approaches. Experimental results show modest improvements over SpecGloss-GS in novel view synthesis quality, achieving the best average PSNR, SSIM, and LPIPS on ShinyBlender and competitive performance on Ref-Real.
Critical strengths
-
The paper addresses the ambiguity in material estimation, which is a fundamental challenge in inverse rendering. Different combinations of material properties and illumination can produce similar appearances, making it difficult to recover consistent material attributes from multi-view images. The proposed mask-guided material regularization is an intuitive and reasonable strategy for mitigating material estimation ambiguity. By encouraging consistent material properties within segmented regions, the method introduces additional constraints that help reduce the solution space of this under-constrained optimization problem.
-
The experiments cover ShinyBlender and Ref-Real and include comparisons with relevant methods, such as SpecGloss-GS, MaterialRefGS, and EnvGS. The proposed method achieves the best average PSNR, SSIM, and LPIPS on ShinyBlender, demonstrating modest but measurable improvements over its direct baseline.
Critical weaknesses
-
The proposed method largely builds upon the existing SpecGloss-GS framework, with the main contribution being a relatively straightforward mask-guided L1 regularization loss. Moreover, prior work such as MaterialRefGS has already explored material consistency constraints and the use of SAM2 masks for material supervision. The paper does not sufficiently clarify its technical novelty or advantages over these existing approaches.
-
The improvements over the direct baseline, SpecGloss-GS, are relatively small, with average PSNR gains of only 0.17 dB on ShinyBlender and 0.05 dB on Ref-Real. Furthermore, MAGS underperforms MaterialRefGS on the average metrics of the real-world benchmark and even degrades performance on some individual scenes. These results raise questions about the practical significance and robustness of the proposed regularization.
Questions for authors
The proposed method assumes that segmentation masks correspond to regions with homogeneous material properties. However, the paper does not investigate whether more accurate material-based segmentation would further improve reconstruction quality. Could the authors compare SAM2-generated masks with ground-truth material segmentation masks on synthetic scenes, if available? Such an experiment would help validate the core assumption and clarify the extent to which the method's performance depends on the alignment between segmentation boundaries and actual material boundaries.