- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents a unified framework that integrates a microfacet material model and ray tracing to jointly model specular reflection and transmittance in 3D Gaussian Splatting (3DGS). It uses separated Gaussian primitives for reflections and transmittance. This allows modeling distance reflections and reconstructing objects behind transparent objects. A differentiable ray tracer is used to obtain the reflection and transmittance appearance.
Critical strengths
-
Microfacet-weighted deferred shading is coupled with differentiable ray tracing over dedicated reflection and transmittance Gaussians in a unified GS-based pipeline.
-
It separates transmittance Gaussian primitives to model the interiors of transparent objects.
Critical weaknesses
-
The main contribution of the proposed method is coupling microfacet-weighted deferred shading with 3D Gaussian splatting. However, this is not new. At least the following paper has ready adopted the idea in reconstructing shiny objects. Shuichang Lai, Letian Huang, Jie Guo, Kai Cheng, Bowen Pan, Xiaoxiao Long, Jiangjing Lyu, Chengfei Lv, Yanwen Guo, Glossygs: Inverse rendering of glossy objects with 3d gaussian splatting, IEEE Transactions on Visualization and Computer Graphics, 2025.
-
The proposed method in this paper doesn’t perform better than existing methods. For instance, From the visual comparison in Figure 5, RT-GS does not perform better than EnvGS. Neither method reconstructs the reflections on the car well, and both still have a noticeable gap compared with the ground truth. In addition, from the quantitative comparison in Table 1, the metrics of RT-GS and EnvGS are very close, almost within the range of numerical error.
-
For the comparison with NU-NeRF in Figure 6, the proposed method doesn’t have any advantage. However, it is quite strange that Table 2 shows RT-GS achieving much higher metrics than NU-NeRF. From Figure 6, this seems to be because NU-NeRF does not reconstruct the background well. However, such a comparison seems somewhat unfair, since both methods target transparent object reconstruction rather than background reconstruction.
-
There’re many loss terms in the final loss function in Equation (18). How are the weights determined? Do different scenes require different weights?
-
No video is provided to show the performance of the proposed method.
Questions for authors
Why are the metrics of the proposed method considerably better than those of NU-NeRF, yet the visual results show no obvious improvement?
W1. We agree that combining microfacet shading with Gaussian splatting is not itself new. Our contribution is using microfacet-based weighting to couple three Gaussian representations—base, environment, and transmission Gaussians—within a unified rendering framework, jointly modeling direct appearance, reflection, and transmission.
W2. We agree that RT-GS offers only modest improvements over EnvGS on reflective scenes, and both retain visible errors relative to the ground truth. The close metrics in Table 1 do not establish a substantial advantage in this setting. Our main improvement compared to EnvGS is on refractive scenes, where explicitly modeling transmitted appearance yields clearer visual and quantitative gains over EnvGS.
W4. The weights are chosen empirically to balance photometric reconstruction and auxiliary regularization. The loss weights are manually specified and shared across scenes. The only scene-specific adjustment is the perceptual loss weight, which is increased from the default 0.01 to 0.1 for the spheres scene. All other weights remain unchanged.
W5. The videos have been added to the Supplementary Material.
Q1 and W3. The selected visual examples do not fully reveal the differences in environment reconstruction and fine details, where NU-NeRF performs less well. NU-NeRF also excludes total internal reflection (TIR) regions from rendering, which can affect the quantitative comparison. We therefore additionally compare both methods within identical transparent-region masks and further exclude NU-NeRF’s TIR regions from both methods’ evaluation.
Our method achieves better PSNR, SSIM, and LPIPS on three of the four scenes, including both scenes evaluated with TIR regions excluded. BallStatue is the only scene with lower PSNR and SSIM, although our LPIPS remains better. This is consistent with the limitation of our straight-through approximation: its glass enclosure has non-negligible thickness, while NU-NeRF explicitly models refraction through thick objects. These regional comparisons provide stronger evidence of improvements that may be difficult to distinguish in the selected visualizations.
The results have been added in Appendix A.7.