- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes InvSplat, a feed-forward 3D Gaussian Splatting framework that jointly reconstructs scene geometry and intrinsic material properties (albedo, roughness, and metallic), enabling applications such as relighting and material editing. InvSplat combines the geometric reconstruction capabilities and cross-view consistency of feed-forward 3DGS with the material priors of 2D intrinsic prediction models. The geometry and material branches exchange features during decoding to improve joint prediction. Experiments demonstrate improved multi-view material consistency and relighting quality.
Critical strengths
-
Novel and well-motivated architecture. Combining geometry reconstruction and material estimation in a unified feed-forward framework is an interesting design. The dual-branch feature fusion is well motivated, and the ablation experiments demonstrate its effectiveness. The proposed Point-Light Relighting Loss is also a useful addition, with experimental evidence supporting its contribution.
-
Strong results under sparse-view settings. With only two input views, InvSplat achieves impressive multi-view material consistency and relighting performance.
Critical weaknesses
-
Confusing architecture illustration. Figure 2 does not clearly reflect the feature exchange described in Section 3.2: "The two branches share features during decoding: intrinsic features contribute to depth estimation, while the high-resolution image features of the geometry branch sharpen albedo prediction." However, the figure only illustrates the information flow from the intrinsic branch to the geometry branch, without showing the geometry-to-albedo connection. Moreover, the arrow from the intrinsic branch is ambiguous and may suggest that intrinsic features are fed into both the Depth Head and GS Head, rather than specifically contributing to depth prediction. The figure should be revised to accurately illustrate both feature-sharing paths.
-
Limited evaluation of input view counts. The main quantitative evaluation focuses exclusively on the two-view setting. Although the supplementary material includes qualitative results with four input views, quantitative performance with different numbers of input views is missing. It remains unclear whether the model generalizes to more input views and how increasing the number of views affects reconstruction quality and multi-view material consistency.
-
Incomplete dual-branch fusion ablation. Table 3 demonstrates the overall benefit of feature fusion, but does not isolate the individual contributions of Intrinsic-to-Depth and Geometry-to-Albedo feature sharing. Disabling these two connections separately would help clarify their respective effects on depth estimation and albedo prediction.
-
Lack of quantitative normal prediction ablation. Appendix E provides only qualitative comparisons of different normal prediction strategies. It is difficult to determine the actual improvement without quantitative results. Moreover, Figure 10 suggests that the dedicated Normal Head produces smoother normals, but may also suppress some high-frequency geometric details, such as thin lamp cords and pillow folds. Quantitative comparisons of normal accuracy and relighting quality would help clarify this trade-off.
Questions for authors
-
Relighting with estimated depth for 2D baselines. In Table 1, could the authors evaluate MVInverse with depth estimated by an off-the-shelf model, such as Depth Anything V2, and report the corresponding Relight-Dpred score? This would provide a more complete comparison under inference-time conditions.
-
Geometry features for normal prediction. Have the authors considered feeding geometry-branch features into the Normal Head? Since depth and normal estimation are closely related and can mutually benefit each other, incorporating geometry features may further improve normal prediction, particularly for fine geometric details.
We thank the reviewer for your thoughtful review and positive assessment. We have clarified the architecture, expanded the quantitative evaluation, and improved InvSplat following the suggestion to incorporate geometry features into normal prediction.
W1. Method figure improvement
We agree that figure should be more detailed. We have new version in a revision.
W2. Number of input views
InvSplat inherits ReSplat's variable-view architecture. As in ReSplat, performance generally benefits from matching training and inference view counts: adapting to more views requires retraining with those view counts, without architectural changes. We use two views because InteriorVerse's scattered cameras make larger overlapping sets difficult to sample. Our sampling supports larger sets and mixed-view training, the supplement qualitatively demonstrates four-view inference.
W3/Q2. Feature fusion and geometry-aware intrinsic prediction
Our original fusion shares complementary feature pathways from ReSplat and MVInverse:
This removes two redundant backbones while preserving the original feature pathways, testing whether separate networks can effectively share representations. We did not disable the two feature flows separately, as each reuses features that were already beneficial in the corresponding original network.
Following Q2, we extend geometry-to-intrinsic fusion: ReSplat's Point Transformer aggregates features in 3D and provides high-resolution detail. We inject these features into the final decoding stage of all four intrinsic heads (albedo, metallic, roughness, normals). This improves material and normal accuracy:
Note: All variants in this and the following ablation were retrained for 40k steps (vs. 20k in the submission) with identical base losses, without intermediate geometry and relighting supervision (ablated separately).
W4/Q2. Quantitative normal prediction ablation
We agree that quantitative comparisons are needed to assess normal accuracy and its effect on relighting and provide the following table:
This shows that high-resolution geometry-aware features complement the pretrained normal prior while retaining the advantages of a dedicated normal prediction head. We have added this ablation to the main paper, together with zoomed qualitative comparisons.
Q1. Relighting with estimated depth for 2D baselines
We have extended Table 1 to evaluate MVInverse with estimated depth from Pi3, the geometry model used in MVInverse's relighting pipeline, and Depth Anything 3.
InvSplat achieves the best relighting performance even when the baselines use strong external depth estimators. Notably, Pi3 produces more accurate depth than InvSplat, yet InvSplat outperforms it in relighting.
These results suggest that accurate depth and independently predicted materials are not sufficient for optimal relighting. InvSplat instead jointly learns geometry, materials, and normals in a shared 3D representation, with relighting supervision constraining their combined shading under novel illumination.