- Rating
- 2
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies non-line-of-sight (NLOS) silhouette recovery from indirect wall illumination captured by a conventional RGB camera. The authors propose RUBIN, a framework built on two components: Radiance-Consistent Structural Learning (RCSL) and Uncertainty-Gated Boundary Region Refinement (UGBR). RCSL aims to learn robust structural representations under radiance variations by enforcing global, local, and dense affinity consistency across augmented observations, together with statistical regularization and acquisition-factor suppression. UGBR combines coarse region predictions with multi-scale boundary information to refine uncertain foreground regions. The method is evaluated on five physically measured NLOS datasets built from existing salient object detection collections. RUBIN is compared against both direct-view baselines and NLOS architectures and shows improved silhouette recovery, and ablation studies examine the contribution of each component.
Critical strengths
- The paper investigates passive NLOS silhouette recovery using a conventional RGB camera. Evaluation on physically measured observations, rather than purely synthetic data, strengthens the practical relevance and provides useful evidence for learning-based passive NLOS imaging.
- Combining radiance-consistent representation learning with uncertainty-guided boundary refinement is a reasonable design for this setting. The method achieves competitive results against adapted baselines on five author-collected NLOS datasets derived from existing salient object detection datasets. The component-level ablations on NLOS-ECSSD suggest that RCSL and UGBR provide complementary improvements.
Critical weaknesses
- A highly relevant prior work, Wavefront-Constrained Passive Obscured Object Detection (WavePCNet, AAAI 2026), is not discussed in the paper. WavePCNet addresses a closely related task of recovering obscured-object masks from indirect light observations and evaluates on four physically collected datasets derived from DUTS, HKU-IS, ECSSD, and DUT-OMRON, the same source collections used in this submission. This omission raises concerns about the positioning and novelty of the work, as well as the completeness of the experimental comparison. In particular, WavePCNet appears to be a more directly relevant baseline than several of NLOS methods shown in Table 1. The authors should clarify the differences in task formulation, acquisition setup, and dataset construction, and include a comparison where feasible.
- The proposed framework mainly combines established techniques, including photometric augmentation, feature consistency learning, variance/covariance regularization, gradient reversal, and uncertainty-guided boundary refinement. Although Eq. (1) introduces a light-transport formulation, the proposed network does not explicitly incorporate this model. In contrast, WavePCNet (AAAI 2026) embeds a Fresnel-based propagation module into its network for a closely related passive NLOS segmentation task. The authors do not sufficiently explain how their architectural and learning choices are specifically motivated by the characteristics of NLOS imaging. In addition, the experiments do not adequately isolate the sources of the reported improvements. Table 1 does not specify whether the adapted baselines are trained with comparable augmentation and training strategies. Table 2 provides only limited fine-grained ablations of RCSL and UGBR, leaving the individual contributions of several consistency objectives, auxiliary losses, and gating mechanisms unclear. It is therefore difficult to determine how much of the improvement stems from the proposed designs rather than from augmentation, auxiliary training objectives, or model capacity.
Questions for authors
**Q1. Relation to WavePCNet. ** How does this work differ from WavePCNet (AAAI 2026) in terms of task formulation, acquisition setup, and methodological contributions? What is the relationship between the NLOS datasets used in this paper and the OOD datasets reported in WavePCNet? Could the authors provide a comparison with this closely related method, or explain why such a comparison is not feasible?
**Q2. Fairness and reproducibility of baseline comparisons. ** Could the authors provide more details on how the NLOS baselines in Table 1 were adapted to the RGB-to-mask setting, particularly those originally designed for transient measurements or different prediction targets? What pretrained weights, augmentation strategies, and optimization settings were used for each baseline, and how was training fairness ensured? Training a strong baseline such as GateNet with the proposed radiance augmentation would help isolate the contribution of the network design.
**Q3. Contributions of individual components. ** Could the authors provide finer-grained ablations of RCSL using final segmentation metrics, particularly for local consistency, affinity consistency, variance/covariance regularization, and adversarial factor suppression? For UGBR, how do region uncertainty gating and boundary confidence gating perform individually? How sensitive are the results to the main gating parameters and loss weights?
**Q4. Dataset construction and generalization. ** Could the authors clarify how the measured NLOS datasets and their train/test splits were constructed, particularly whether the same source images appear in both partitions? For example, NLOS-ECSSD contains 1,000 training and 200 test pairs, whereas the original ECSSD dataset contains only 1,000 images. How were the additional observations obtained, and how was train/test independence ensured?
**Q5. Robustness to physical acquisition variations. ** Figure 5 presents qualitative results under physically varied acquisition conditions, whereas Appendix E reports quantitative results based on computational perturbations of recorded NLOS-ECSSD observations. Could the authors clarify how these two experimental settings relate to each other? In particular, are quantitative results available for the acquisition variations shown in Figure 5, including camera pose, camera distance, source brightness, and relay-wall material?
4 comments
Q3. Objectives, gates, and sensitivity.
ECSSD ablations; each cell is Max-F ↑ / MAE ↓ / Dice ↑:
| Setting | Result |
|---|---|
| Full RUBIN | 0.751 / 0.109 / 0.697 |
| Generic refiner | 0.701 / 0.136 / 0.637 |
| Without global consistency | 0.728 / 0.124 / 0.674 |
| Without local consistency | 0.732 / 0.120 / 0.679 |
| Without affinity consistency | 0.710 / 0.126 / 0.674 |
| Without variance regularization | 0.735 / 0.121 / 0.663 |
| Without covariance regularization | 0.734 / 0.120 / 0.650 |
| Without factor suppression | 0.730 / 0.122 / 0.682 |
| Without both gates | 0.709 / 0.128 / 0.664 |
| Region gate only | 0.716 / 0.129 / 0.656 |
| Boundary gate only | 0.714 / 0.127 / 0.638 |
| Without region loss | 0.705 / 0.133 / 0.644 |
| Without boundary loss | 0.706 / 0.134 / 0.636 |
| Without relation loss | 0.726 / 0.124 / 0.672 |
| Without topology loss | 0.725 / 0.123 / 0.673 |
The tables quantify each RCSL objective, gate, and auxiliary loss using segmentation metrics. Both gates together give Dice 0.697, versus 0.656/0.638 with individual gates and 0.664 with neither. These results support the joint gating configuration; the individual gates do not consistently improve every metric when used alone. Loss removals probe the objectives, while the generic refiner provides a comparison with an alternative refinement design.
Sensitivity results; entries give the range across the listed settings:
| Parameter values | Max-F ↑ | MAE ↓ | Dice ↑ |
|---|---|---|---|
| tau_band: 0.30, 0.60 | 0.751 | 0.112 | 0.665–0.687 |
| T_band: 0.04, 0.16 | 0.745–0.746 | 0.114 | 0.669–0.678 |
| gamma_B: 2, 8 | 0.736–0.740 | 0.115–0.120 | 0.677–0.679 |
| lambda_RCSL: 0.025, 0.10 | 0.730–0.735 | 0.120–0.122 | 0.673–0.678 |
| lambda_UGBR: 0.125, 0.50 | 0.726–0.730 | 0.123–0.124 | 0.663–0.681 |
These results quantify sensitivity over the tested settings in all three metrics.
Q4. Dataset construction.
We expanded the ECSSD-derived collection by 200 examples, yielding 1,200 measured pairs with a 1,000/200 partition. We will detail the extension and source-image/observation assignments to each partition. After acceptance, we will publicly release the dataset, paired masks, and split lists.
Q5. Physical and computational variations.
Figure 5 provides acquired-image examples with changes in camera pose, distance, brightness, and relay surface. Appendix E quantifies computational angle transforms, illumination changes, and compression of recorded observations using fixed models. We will make their scope explicit in the captions and protocol.
Thank you to the authors for the rebuttal. Unfortunately, not all concerns raised are addressed clearly. For example, Q4 & Q5 are not elaborated properly. There will be no change in the rating.
Thank you for your comment.
Reply to Q4: We have added an overview of all 200 additional samples used to extend NLOS-ECSSD in Appendix A. The figure presents the source images, corresponding measured relay-wall observations, and binary ground-truth masks, accompanied by a description of the sample diversity and dataset expansion. We confirm that no source image appears in both the training and test sets after a careful check. Please do not share these additional images with anyone else bacasue they are under review by the administrative board of my institute for public release.
Reply to Q5: Figure 5 and Appendix E are linked. Figure 5 is the visible results, while Appendix E shows the values (numerical results) of Figure 5. 'computational' is not a proper word in this context, and we will revise this wording issue in the revision.
Thank you for recognizing our clarifications and the strengthened evidence. We sincerely appreciate your thoughtful assessment and constructive feedback. If our response resolves your concerns, we respectfully ask you to consider increasing your score to support our work, it is a huge motivation for us.
Response to Reviewer BWYd
Thank you for the detailed questions. We address each below.
Q1. WavePCNet and our contribution.
We retrained WavePCNet on our measured NLOS datasets under the same data partitions, input resolution, and target-mask supervision used for all methods, and report its best-checkpoint result per dataset. Because WavePCNet's original paper reports results on its own separately collected OOD data rather than our observations, we compare against the retrained model on our data. Each cell is Max-F ↑ / MAE ↓ / Dice ↑:
RUBIN exceeds the retrained WavePCNet on Max-F, MAE, and Dice on all four shared datasets. The largest margins appear on ECSSD (Dice 0.697 vs 0.524); the remaining datasets show consistent but smaller gains, with the closest on DUT-OMRON.
Both methods address passive mask recovery from indirect light but take different design routes. WavePCNet embeds a Fresnel-based propagation module, committing the network to an explicit transport operator. RUBIN instead treats transport and appearance as latent (Eq. 1) and targets the two degradations that dominate our passive conventional-camera setting: acquisition-dependent radiance variation at fixed target support, and diffuse boundary mixing. RCSL learns radiance-consistent structure across position-preserving radiance views, and UGBR refines uncertain foreground regions using boundary agreement. The consistent advantage over a physics-embedded baseline on our measured data supports this design choice for the passive RGB setting, where the transport operator is unknown and uncalibrated. We will document the measurement provenance and partition correspondence of the shared source collections explicitly.
Q2. Adaptation and fairness.
The adapted methods in Table 1 share RGB wall inputs, target-mask supervision, data partitions, input resolution, and evaluation. Representative adaptations are:
These comparisons evaluate the adapted architectures within the RGB-to-mask task. In particular, LEAP's latent volume is learned from RGB input rather than obtained from transient measurements.
The adapted NLOS baseline recipe uses 384×384 inputs, Adam for 100 epochs, encoder/other learning rates of 1e-4/1e-3, weight decay 5e-4, and equally weighted BCE and IoU losses. Learning-rate multipliers are 1, 0.1, and 0.01 over the first 20%, next 30%, and final 50% of training. ResNet50-based adaptations are configured for ImageNet initialization, while added layers and dedicated encoders use random initialization.
RUBIN's configuration follows Section 4.1, including a batch size of 5 and seed 3407 for the main-paper results. Its additional radiance views and RCSL/UGBR objectives are method-specific training components. We therefore distinguish the shared data and evaluation protocol from these additional objectives, whose effects are examined through augmentation controls and fine-grained ablations. Evaluation uses the epoch-100 checkpoint and the same prediction resizing, normalization, 8-bit conversion, and metric computation procedure. The revision will include per-method initialization, augmentation, loss, and optimization details.
NLOS-ECSSD augmentation controls; each cell is Max-F ↑ / MAE ↓ / Dice ↑:
GateNet with radiance augmentation reaches Dice 0.598, compared with 0.565 for the baseline. The backbone with radiance augmentation reaches 0.576. RUBIN reaches 0.697, exceeding these two augmentation-only controls by 0.099 and 0.121, respectively. The following ablations further examine the effects of the structural objectives and refinement mechanisms.