- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduce a 3d source-aware lighting estimation technical called lamp. Given a list of 3D queries, LAMP first estimates an inventory of light sources, then estimate the direction from these queries to their most important light directions. LAMP is based a VLM, specifically Qwen3, and trained on synthetic data to make these predictions. The authors also train a separate lightweight ResNet to predict dense RGB irradiance. The method is quantitatively evaluated on synthetic data for light source localization and direction prediction. Qualitative results are shown on downstream probe rendering task on synthetic and real image datasets.
Critical strengths
- The technique attempts to separate out the lighting contribution of individual light sources, which can be useful for application such as synthetically turning light on and off.
- The technique uses vlm to predict dominant light sources, which could be an interesting component of a lighting editing system that enables editing individual lights semantically.
Critical weaknesses
-
The most fatal concern is the quantities the authors propose to estimate in the paper is not useful for many if not most downstream applications. Like what the author have shown in section A.1.4. of the supplementary Since neither light direction nor irradiance map can be used to edit lighting, the author have to resort to complicated and fragile heuristics to insert light probe into the scene. The relighting result is only heuristically plausible looking and not physically correct at all. I will solely reject the paper based on this concern alone as this renders the paper almost completely useless. I strong encourage the author evaluate standard lighting estimation metrics such as RMSE/Si-RMSE/SSIM/Ang. Err. for local environment map such as Table 2 of "Lighting in Motion: Spatiotemporal HDR Lighting Estimation".
-
The technique cannot predict the local environment map at all (which implies weakness point 1 by definition). Therefore, the author have to resort to evaluation of dominant light source accuracy (where energy can arrive through indirect path). However, I do not believe the evaluation is meaningful and I cannot think of a downstream application where knowing the direction of dominant light source (including energy can arrive through indirect path) is very useful. If the author believe otherwise please clarify.
Questions for authors
I think the central concern is clear: given the quantities the authors propose to estimate cannot really be used to light inserted objects, I do not believe the technique is very useful. In particular I do not see how irradiance map and direction of dominant light source(where energy can transport through indirect path) can be used to support downstream applications such as object insertion. Please clarify if there is any misunderstanding.
4 comments
W2 & Q
A local environment map describes incident radiance by direction, whereas our formulation links local lighting contributions to identifiable physical sources. Dominant-source accuracy evaluates which source contributes most at each query, including contributions transported through indirect paths. Contribution shares quantify how much each source contributes. We further evaluate the usefulness of these outputs through probe rendering and controlled lighting changes. We believe such source-referenced outputs could support future source-level editing.
Shading Direction of the composed lighting.
We compare the shading vectors of diffuse probes rendered under predicted and reference lighting. Our method achieves the lowest shading-vector error on Infinigen, Laval-SV, and LuxRemix. On Laval-RF, our error is close to LuxDiT’s (0.124 vs. 0.125), while LiMo performs best at 0.109. These results demonstrate that the composed lighting captures directional shading structure across synthetic scenes and real photographs.
| Method | Infinigen vec. err ↓ | Laval-SV vec. err ↓ | LuxRemix vec. err ↓ | Laval-RF vec. err ↓ |
|---|---|---|---|---|
| Garon et al. | – | 0.119 | – | – |
| LiMo | 0.181 | 0.178 | 0.193 | 0.109 |
| DiffusionLight-Turbo | 0.260 | 0.172 | 0.214 | 0.136 |
| LuxDiT | 0.239 | 0.153 | 0.206 | 0.125 |
| GaSLight | 0.262 | 0.233 | 0.227 | 0.181 |
| Ours | 0.167 | 0.111 | 0.169 | 0.124 |
Light Editing and Rendering.
We additionally render probes at selected query locations under paired two-lamp configurations with A:B contribution ratios of 10:90 and 90:10. For each configuration, we compare the probe rendered using our predicted lighting with the corresponding ground-truth render. The paired examples visualize how changes in the relative source contributions affect the inserted object’s brightness and shading. They connect our source-referenced predictions to a concrete rendering task and complement the quantitative evaluation above. The rendering result is shown in Figure 11 in Appendix A.3.10 of the paper.
I thank the authors for substantive additions. My concern, however, is not about the quality of the added evaluation but about what it evaluates.
I believe the technique is fundamentally flawed. There is no principled or physically correct way to use the estimated quantities to render an inserted object or relight the scene. At the end of the day, it is impossible to represent global illumination of a general indoor scene with light position centric representation. The rendering equation ultimate integrate over incident radiance at each query point across solid angles. At best, this representation can be turned into a light probe made of a few Dirac deltas at the estimated point positions plus one constant term; the directional energy arriving through bounces off walls and ceilings is not represented, only averaged.
To be precise about what is estimated: for each query the model produces (a) a ranked list of contributing sources drawn from a shared inventory in which each source is stored as a single 3D position of the emitter origin, or the centre for area lights and is defined regardless of visibility (b) one unit 3D direction per listed source (c) one scalar contribution share per listed source, defined as that source's fraction of the total source luminance at the query and, independently, a dense per-pixel RGB irradiance map. The contribution share is derived from solo-source renders whose transport response explicitly includes visibility, shadows, reflection and inter-reflection. It is energy delivered at the query after occlusion. The direction is the straight line to the emitter's 3D position, taken from an inventory that is defined regardless of camera visibility, including occluded and off-screen sources. The two components therefore describe different light paths, and when the dominant transport is indirect the pair has no physical referent, as it is neither a light position nor an incident direction.
Since the technique is fundamentally flawed, the authors have to resort to fragile heuristics even to render a probe sphere. The explanation they offer for how a probe is rendered is, verbatim, the construction I called a heuristic, which I spell out below:
By "fragile heuristics" I mean the specific sequence by which the tuple is turned into something a renderer can consume (Appendix A.1.4). (i) For each query, one virtual emitter is placed along the predicted direction, but its distance is not predicted: it is taken from the query to the referenced inventory position, floored at 0.5 m, and set to 3 m whenever the source is not localized in 3D. (ii) Emitter power is proportional to the predicted share, with no radiometric value attached. (iii) The light not attributed to any emitter is absorbed by an isotropic fill with a fixed fraction f_fill = 0.65 of the target luminance. (iv) Emitters and fill are then jointly rescaled so that the analytic mean radiance of a white Lambertian sphere at the query matches the irradiance map's luminance and chromaticity i.e. absolute brightness and colour come from the irradiance branch, not from the source estimates. (v) Rendering uses only the query's own 3D position and normal; for photographs these are themselves estimated (monocular metric depth, a 21×21 plane fit, and a gray-world white-balance correction), and scene geometry, occlusion, and any interaction between the inserted object and the scene are absent.
It follows that, of the four quantities that determine the rendered image: absolute luminance, chromaticity, the 65% isotropic component, and the directional component, three are supplied by the irradiance branch and by a constant, and the source estimates control only the direction and relative weighting of the remaining 35 per cent. A rendering produced this way therefore cannot attribute its own fidelity to source awareness. The paper's own Table 18 states the ceiling explicitly: even with ground-truth sources and ground-truth shares, the shading-direction error remains 17.7°, because each source is a point emitter and the rest is a global fill. A sphere rendered under such a model is indistinguishable from an environment map plus a parametric fit.
Finally, the two tables in the response do not follow my requested evaluation or establish downstream utility. In my initial review, I specifically referenced Table 2 of Lighting in Motion (LiMo). While outputting an explicit environment map is not strictly mandatory if a method can render inserted objects directly, evaluating on local environment maps, or, equivalently, on mirror and sharp specular probes, is standard precisely because it is most sensitive to angular and structural errors in the incident light field. Notably, whereas LiMo's Table 2 evaluates four spheres including a perfect mirror (Mirr) and a perfectly glossy sphere, the authors omit the mirror probe in Table 5 and evaluate only a Lambertian sphere and a wide-lobe sphere (roughness = 0.25). Both act as heavy angular low-pass filters that blur away missing scene reflections and conceal the failure of approximating global illumination with point lights plus a 65% uniform isotropic fill.
Even without evaluating an explicit environment map directly, equivalent error-sensitive evaluations are straightforward and require no new data. First, render a perfect mirror sphere (roughness = 0) at the same query locations, radius, camera, and exposure settings under LAMP's composed lighting, and compare it against the ground-truth mirror-sphere rendering (rendered under ground-truth scene illumination on synthetic datasets, or compared against the ground-truth local HDR / captured chrome ball at the measured probe location on Laval-SV) using the same metrics as Table 5 (RMSE, si-RMSE, SSIM, LPIPS, and RGB angular error). Second, insert a complex non-convex 3D mesh with sharp normal variations and mirror-like or highly specular materials (such as the Stanford bunny) into the scene with cast shadows and local occlusion enabled, and compare the rendered object against the ground-truth rendering quantitatively and qualitatively.
As for the second table in the response ("Shading Direction of the composed lighting", reporting vec. err), "shading vector" is neither a standard lighting-estimation metric nor mathematically defined anywhere in the response or the revised manuscript (where this table does not appear; Appendix A.3.7 Table 18 instead reports an angular error in degrees). More fundamentally, collapsing an already low-pass-filtered diffuse sphere down to a single 3D vector discards virtually all angular lighting structure and adds no value beyond Table 5. For all these reasons, my assessment remains unchanged.
We thank the reviewer for highlighting this concern. We provide additional experiments on the existing test sets to directly assess the usefulness and limitations of our outputs. All changes in the revised paper are marked in blue.
W1 & Q
Our original paper did not explain the connection between the predicted quantities and probe rendering clearly enough. In A.1.4, we construct a compact lighting model with one virtual emitter per ranked source and an isotropic fill term, following the general discrete-light formulation exemplified by Gardner et al.[1]. Predicted source geometry determines emitter placement, while decoded contribution shares determine relative emitter power weights. The calibrated irradiance map supplies the overall brightness and chromaticity. Together, these components specify the lighting used by our physically based renderer. A full environment map is therefore not a prerequisite for using our outputs in object rendering. To directly evaluate the effectiveness of this construction, we provide quantitative rendering comparisons below, testing the resulting rendering accuracy.
RMSE/Si-RMSE/SSIM/Ang. Err. Table
We update our Table 5 with a glossy material, comparing our method's rendering quality with prior works.
Our method achieves the best on Infinigen for both diffuse and glossy probes, as well as the best glossy si-RMSE on LuxRemix (2.24 vs. 2.30). It also closely matches LiMo’s LPIPS on Laval Indoor SV (0.114 vs. 0.114 for diffuse and 0.129 vs. 0.130 for glossy) and LuxDiT’s diffuse SSIM on LuxRemix (0.85 vs. 0.86).
References [1] Marc-André Gardner et al. “Deep Parametric Indoor Lighting Estimation.” ICCV, 2019. Paper.