- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper presents LUMEN-GS, a feed-forward Gaussian Splatting framework for sparse-view street-scene reconstruction with intrinsic material decomposition and illumination modeling. Unlike existing feed-forward reconstruction methods that mainly focus on predicting geometry and appearance, LUMEN-GS aims to recover both Gaussian primitives and their physical attributes in a single forward pass, enabling relighting and scene editing without expensive per-scene optimization.
Critical strengths
-
This paper explores an interesting and practically valuable direction by extending feed-forward Gaussian reconstruction to jointly predict scene geometry and intrinsic physical properties. Feed-Forward Gassuian prediction with physical attributes is very meaningful direaction.
-
The proposed method achieves competitive rendering quality compared with existing sparse-view feed-forward reconstruction methods(DepthSplat, UniSplat, EvolSplat...). The paper also provides comparisons with optimization-based inverse rendering methods, such as UrbanIR and InvRGB+L, demonstrating the potential of feed-forward reconstruction for physically based scene modeling. Overall, the experimental is extensive and the resultas are good.
-
The authors combine pixel-volume Gaussian reconstruction with PBR-based intrinsic learning. Appendix Table 9 shows that PBR-related supervision also benefits NVS performance. Although the approach is relatively straightforward and relies on teacher-generated pseudo-labels, pioneering feed-forward prediction of physically meaningful Gaussians for street scenes would be a valuable contribution if the novelty claim holds.
-
Ablation studies and qualitative results are sufficient.
Critical weaknesses
- Training protocols and fairness of the NVS baseline comparisons: For the sparse-view feed-forward reconstruction baselines in Table 1, particularly MVSplat, DepthSplat, and EVolSplat, were these models retrained or fine-tuned on nuScenes, or were publicly available pretrained checkpoints directly used for evaluation?
- The quantitative PBR evaluation mainly measures reconstruction under the original lighting conditions. Despite promising qualitative results, it remains unclear whether the predicted intrinsic properties enable physically consistent relighting under novel illumination.
Questions for authors
No
Response to Reviewer DwYj - 1
(Weakness-1) Training protocols and fairness of the NVS baseline comparisons: For the sparse-view feed-forward reconstruction baselines in Table 1, particularly MVSplat, DepthSplat, and EVolSplat, were these models retrained or fine-tuned on nuScenes, or were publicly available pretrained checkpoints directly used for evaluation?
We apologize for not clearly stating how the baselines were run. In Table 1, all baselines other than XYZCylinder (a baseline newly added in our revision) and UniSplat are fully trained, since most of them differ from us in training and evaluation protocols as well as in datasets. XYZCylinder has not released its code, and UniSplat has not released a checkpoint on the nuScenes dataset. We therefore adopt the results reported in the original papers, since their evaluation protocols match ours.
(Weakness-2) The quantitative PBR evaluation mainly measures reconstruction under the original lighting conditions. Despite promising qualitative results, it remains unclear whether the predicted intrinsic properties enable physically consistent relighting under novel illumination.
We agree that paired captures of the same scene and poses under different illumination would provide the most direct quantitative evaluation of relighting. Such paired data are not available in nuScenes or, to our knowledge, in existing public driving datasets. As a complement to our quantitative physical-consistency results, we measure the temporal stability of the predicted scene-level sunlight and ambient illumination within each nuScenes bin. We run inference on 2,842 timestamped six-view samples from 200 validation bins and compute the coefficient of variation (CV = std/mean) of each predicted illumination across the samples in each bin. The median intra-bin CV is 0.89% for sunlight and 0.54% for ambient light. Ambient-light CV is at most 1.99%, while sunlight CV is below 3.41% in 95% of bins. These results support the temporal stability of the predicted scene-level illumination under the assumption that illumination remains approximately constant within each short bin. They do not directly measure relighting fidelity against ground truth under a changed target illumination, which remains a limitation.