- Rating
- 3
- Confidence
- 4(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes ReflectWorld, a diffusion-based framework for jointly recovering transmission and reflection layers from multi-view images captured through glass. It combines a pretrained feed-forward geometry model with a one-step diffusion model. Its Geometry-Routed Cross-View Association module projects reference-view features into the target view and aggregates them using geometric confidence and content-based attention. The resulting cross-view features guide the two output branches through opposite-sign modulation, intended to exploit differences in the layers’ cross-view behavior. The paper also introduces MVRefSep, a dataset containing 40 synthetic scenes with ground truth for both layers and 10 real-world scenes with transmission ground truth. Validation includes comparisons with single-image and multi-image methods, component and design ablations, geometric correspondence analyses, and downstream novel-view synthesis and depth-consistency evaluations. The reported results show improved recovery of both layers on the synthetic benchmark and improved transmission recovery on the real-world dataset.
Critical strengths
-
The paper addresses a central difficulty in multi-view reflection separation: a geometrically correct correspondence may still connect reflection-contaminated content. Combining geometry-constrained candidate routing with content-dependent attention provides a well-motivated way to use imperfect geometric information for joint transmission and reflection recovery. This task-specific design is the strongest methodological consideration supporting acceptance.
-
The proposed dataset and reported improvements provide promising empirical contributions. MVRefSep contains 40 synthetic scenes with ground truth for both layers and 10 real-world scenes with transmission ground truth. On the synthetic benchmark, the method improves average transmission and reflection PSNR over the strongest respective competitors in Table 1 by 1.64 dB and 2.64 dB. These results suggest meaningful potential.
Critical weaknesses
-
Section 5.4 states that all ablations are conducted on MVRefSep-Test, yet Appendix D.4 explicitly uses those results to select the default backbone, diffusion timestep, VAE LoRA configuration, and loss weights. No separate validation set is described. As written, the experimental protocol therefore appears to use the test set for configuration selection and then report performance on that same set. This can produce optimistic results even when training and test scenes do not overlap. The authors are recommended to identify the independent data used for model selection or evaluate the finalized configuration on previously unused test scenes.
-
The interpretation of the reversed-direction ablation in Table 5 is inconsistent with Eqs. (2) and (9). With $ $, the proposed configuration gives $ $ and $ $. Setting $ $ in the reversed configuration yields identical branch features, so both configurations have the same representational capacity if the output projection is freely trainable. Their performance difference therefore cannot establish that the chosen signs intrinsically reinforce transmission and suppress reflection. The authors should clarify whether the variants were retrained or modified only at inference, identify any constraints breaking this equivalence, and revise the mechanistic claim. This somehow weakens the differential-decoding explanation without ruling out the empirical benefit of opposite-sign updates.
Questions for authors
-
Please clarify whether the reversed-direction variants in Table 5 were retrained or changed only at inference, and whether any constraint prevents the output projection from absorbing the sign reversal through $ $.
-
Did reflection separation or geometry estimation use any of the 43 held-out NVS target images before the seven context views were selected?
-
Which baselines were retrained or fine-tuned on the same data as ReflectWorld, including MVRefSep-Train, and how many input views did each multi-image method receive?
6 comments
Response to Reviewer JX5a (Part 2 of 4): W2/Q1 — Differential modulation directions
Response to Reviewer JX5a (Part 2 of 4): W2/Q1 — Differential modulation directions
W2:
“The interpretation of the reversed-direction ablation in Table 5 is inconsistent with Eqs. (2) and (9). ...”
Q1:
“Please clarify whether the reversed-direction variants in Table 5 were retrained or changed only at inference, and whether any constraint prevents the output projection from absorbing the sign reversal through ().”
Thank you for your valuable comments. The reversed-direction variant was trained with a direction constraint. Specifically, we use geometry-aligned cross-view feature differences to determine the correction direction, allowing the output projection to control the correction magnitude while preventing its parameters from absorbing the prescribed modulation direction through sign reversal. We have moved the reversed-direction experiment from Table 5 to Appendix D.4 (Table 17, p. 26) for a detailed explanation.
Response to Reviewer JX5a (Part 3 of 4): Q2 — Held-out NVS target images
Response to Reviewer JX5a (Part 3 of 4): Q2 — Held-out NVS target images
Q2:
“Did reflection separation or geometry estimation use any of the 43 held-out NVS target images before the seven context views were selected?”
Thank you for your careful question. None of the 43 held-out novel-view synthesis (NVS) target images were used during reflection separation or geometry estimation. Thus, the predicted transmission images and geometry used for NVS are obtained without accessing any of those held-out target images, preventing information leakage from the NVS evaluation targets. We have further clarified this evaluation protocol in Appendix C.1, Cross-View Consistency Evaluation (p. 17) of the revised manuscript.
Response to Reviewer JX5a (Part 1 of 4): W1 — Cross-dataset generalization
Response to Reviewer JX5a (Part 1 of 4): W1 — Cross-dataset generalization
W1:
Thank you for your constructive suggestion regarding evaluation independence and cross-dataset generalization. We previously conducted the component and configuration ablations on MVRefSep-Test because it is the only multi-view reflection separation benchmark providing ground truth for both transmission and reflection layers (GT-T and GT-R). It covers daytime, nighttime, indoor, and outdoor scenes, enabling comprehensive quantitative comparisons of both recovered layers across diverse imaging conditions. We agree that additional evaluation on independent real-world data is important for further assessing the generalization of the selected model configurations.
To further assess generalization beyond MVRefSep-Test, we have added ablation experiments on the real-world MVRefSep-Real dataset. These results are reported in Tables 2–3 (p. 8), Table 5 (p. 9), and Tables 15–29 (pp. 24–31, where applicable). The trends across simulated and real-world datasets are broadly consistent, providing further support for the selected model configurations.
Table 2: Component ablation.
Table 3: Effect of reference-view count.
Additional ablation results are provided in Table 5 (p. 9) and Tables 15–29 (pp. 24–31, where applicable).
Cross-dataset generalization evaluation on the TNeRF dataset. We have additionally evaluated ReflectWorld on the external real-world TNeRF dataset, using the same evaluation protocol for all comparison methods (Table 8, p. 20).
Table 8: Quantitative comparison on the TNeRF dataset. ReflectWorld achieves the best performance across all scenes. (p. 20)
All results are reported as PSNR (dB) / SSIM.
ReflectWorld achieves the highest PSNR and SSIM across all four TNeRF scenes. Together with the newly added MVRefSep-Real ablations, these results provide complementary evidence of generalization beyond the dataset used for the original configuration analyses.