- Rating
- 3(+1)
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
The paper studies whether the content of a hidden screen can be reconstructed from a camera image of the diffuse light reflected onto a nearby wall. It proposes OARL, a framework that estimates the recoverability of different types of screen information (color, layout, structure, and detail) and uses these estimates to guide a progressive reconstruction process. The evaluation includes five categories of screen content, comparisons with alternative approaches, ablation studies, and experiments under different imaging conditions. The reported results are encouraging, although I have some reservations about how clearly the experiments establish the benefits and generality of the proposed design.
Critical strengths
[+] The paper explores an unconventional reconstruction setting and provides a physical acquisition setup with paired observations and screen images. This gives the work a clear experimental foundation.
[+] The authors include multiple content categories, ablations, and robustness experiments. These experiments provide a useful initial assessment of the proposed approach.
Critical weaknesses
[-] The paper introduces several components and a fixed reconstruction order, but the current experiments do not make it entirely clear how much each design choice contributes beyond a conventional progressive reconstruction approach.
[-] The experiments mainly support reconstruction under the tested acquisition conditions. More direct evaluation of text, icons, and other fine-grained content would help establish what the method can reliably recover.
Questions for authors
-
Could the authors clarify how the training, validation, and test sets are separated? In particular, are the screen contents and acquisition sessions independent across these sets?
-
Could the authors provide a more controlled comparison with a conventional reconstruction model using the same backbone and training setup, to better isolate the contribution of the proposed gates and progressive reconstruction?
-
How well does the method perform when the camera, wall, or display differs from the acquisition setup used for training?
-
Do the authors have an evaluation of fine-grained content accuracy, such as text or icon recognition, beyond the reported image similarity metrics?
4 comments
The method is motivated by the structure of the inverse problem. A wall observation spatially mixes contributions from screen regions and attenuates different spatial frequencies and content types unequally. A uniform reconstruction rule does not explicitly represent this variation. CHRRL estimates spatially and semantically specific support from the current observation, while OSAR uses the resulting gates to regulate residual updates and carries earlier color and layout states into later structure and detail stages. Better-supported cues thereby guide the updates that depend on weaker evidence.
Several completed results support this design. In Table S10, the complements of all four gates correlate with reconstruction errors more strongly than the single-attention control across the five categories. Table S11 shows that gate responses decrease under stronger noise and motion blur, with the detail gate showing the largest decrease. Table S7 shows that OARL retains an advantage over the evaluated retrieval baselines on a template-grouped split, Table S9 shows an advantage over a capacity-matched Restormer, and Table S14 shows transfer to an additional room using the Table 1 weights. For content-level evaluation, Table S12 measures layout IoU and text-region recall.
We appreciate that Reviewer 5CYz recognizes the physical acquisition setup and paired wall and screen data as providing a clear experimental basis, and describes the multi-category, ablation, and robustness experiments as a useful initial evaluation. The evidence above supports recovery of the major colors, layouts, and structures of the screen.
We would value the view of the reviewer on whether the results in Part 1 address the concerns raised in the initial review and whether Part 2 addresses the questions of the revised review.
Thank you for recognizing the task as a meaningful challenge and the division between CHRRL and OSAR as understandable.
Your review asks for three evaluations, namely held-out screen identities, unseen acquisition configurations, and the fidelity of semantically important details. The revised paper contains all three. Every number is given in this reply, and the same tables are in Appendix E of the revised PDF.
(a) Held-out screen identities. Every test screen is new to the model. The number of test pairs that share a source screen or a template with training is 0 in all five categories (Table S6). We also built a second split of Screen that places each template group entirely in training or entirely in test, retrained OARL and its strongest baselines on it, and added retrieval. Retrieval returns the training screen whose wall observation is nearest to the test observation. Its output is a real, sharp, plausible screen, and it is the most that training content alone can supply, so it is the reference for a model that fills in content from learned priors.
| Screen, template-grouped split | PSNR | SSIM | LPIPS |
|---|---|---|---|
| OARL | 25.472 | 0.849 | 0.222 |
| Restormer | 22.366 | 0.768 | 0.348 |
| Restormer, matched | 22.705 | 0.773 | 0.329 |
| Best retrieval | 19.413 | 0.687 | 0.481 |
OARL reproduces Table 1 within 0.086 dB and stays 6.06 dB above the best retrieval. This 6 dB is what OARL takes from the current wall observation beyond the training content. Over three seeds OARL reaches 25.463±0.073 dB against 22.350±0.096 dB for Restormer.
(b) An unseen acquisition configuration. OARL keeps its lead in a room it has never seen. We applied the Table 1 weights directly to 200 Screen pairs from a second room. The room, the wall, the camera body and the camera distance are all different, the screens lie outside the training set, and the session is separate from all training data.
| Second room, Table 1 weights | PSNR | SSIM | LPIPS | Layout IoU |
|---|---|---|---|---|
| OARL | 23.107 | 0.797 | 0.316 | 0.73 |
| Restormer | 21.142 | 0.719 | 0.428 | 0.64 |
| Retrieval of the nearest training screen | 17.859 | 0.627 | 0.594 | 0.48 |
OARL leads on every measure, by 1.97 dB over Restormer and 5.25 dB over retrieval. Its layout IoU is 0.73 in the second room and 0.77 in the training room. The same weights also carry across content. The Screen model applied directly to Browser, whose pages are all new to it, reaches 16.967 dB against 13.774 dB for Restormer.
(c) Fidelity of semantically important content. OARL recovers the layout and the text regions of the screen better than every baseline. The paper claims recovery of screen colors, regional layouts and principal structures (abstract), and we now score this content directly. Layout IoU scores the regional layout of each output against the true screen. Text-region recall scores whether text sits where the true screen has text.
| Layout IoU / text-region recall | Screen | Browser | OSLock | Screen, second room |
|---|---|---|---|---|
| OARL | 0.77 / 44% | 0.72 / 25% | 0.60 / 20% | 0.73 / 37% |
| Strongest restoration baseline | 0.66 / 22% | 0.65 / 17% | 0.57 / 18% | 0.64 / 18% |
| Retrieval | 0.59 / 16% | 0.55 / 10% | 0.48 / 8% | 0.48 / 6% |
OARL leads on both measures in all four settings. On Screen it places twice as many text regions as the strongest restoration network, and in the second room six times as many as retrieval.
Exact character recognition and icon identity are beyond what the diffuse glow of a display carries for every published method. Backes et al. (IEEE S&P 2009) studied this same channel with a monitor facing a white wall 25 cm away. With physical deconvolution they resolved a single 10 cm letter on a 3×3 grid and concluded that diffuse reflections reveal no more than basic shapes. The readable text in this literature comes from other signals, namely mirror-like reflections in teapots, glasses and the eye (Backes et al., IEEE S&P 2008) and the raster timing of a CRT read with a fast photosensor (Kuhn, IEEE S&P 2002). A photograph of a matte wall lit by a flat panel contains neither. Passive imaging from one ordinary photograph relies on the penumbra of an occluder (Saunders et al., Nature 2019), and a 2026 study by Raji and Murray-Bruce (arXiv 2601.12257) describes such methods as still confined to one-dimensional or low-resolution two-dimensional color images. The learned methods NLOS-OT and NLOS-LTM reconstruct single digits, faces and small natural images, and NLOS-LTM reports PSNR and SSIM only. None of these works reports character or icon recognition from a diffuse wall. Our evaluation adds two content-level measures to the usual image metrics, layout IoU for where the regions of the screen are and text-region recall for where its text is, and OARL leads on both.
The five questions are answered in order.
-
No test screen and no test template appears in training. The split is described in (a). Each category is divided into a training portion and test pairs, 3,040/760 for Screen, 1,000/250 for Figure, 1,000/250 for Game, 1,120/279 for OSLock and 3,759/940 for Browser. Source screenshots and templates are disjoint between the two. A validation subset held out from the training portion selects checkpoints, and the test pairs are used for the reported numbers.
-
A recoverability gate makes two predictions, and both are confirmed. Where the gate is low, the reconstruction error is high. The direct control for an ordinary learned attention map is a single attention map trained in the same network. Its correlation with the high-frequency reconstruction error is 0.09 to 0.15, the detail gate reaches 0.42 to 0.51, and every one of the four gates exceeds the attention map on every error measure in all five categories (Table S10). When information is removed from the observation, the gate falls. We degraded the observation in controlled steps of brightness, noise and blur and recorded each gate (Table S11).
| Observation | Color | Layout | Structure | Detail |
|---|---|---|---|---|
| Nominal | 0.867 | 0.792 | 0.689 | 0.601 |
| Noise, SNR 10 dB | 0.781 | 0.640 | 0.432 | 0.231 |
| Motion blur, 15 px | 0.803 | 0.664 | 0.471 | 0.259 |
Under both noise and blur the gates fall in the order color, layout, structure, detail, by 10%, 19%, 37% and 62% at the strongest noise. The wall loses detail first and color last, and this measured order is the order in which OSAR writes.
-
The gates and the inherited stages carry the gain. Table 2 makes the replacement you describe inside OARL, on all five categories. On Screen, OARL with the gates removed gives 23.90 dB and with inheritance removed gives 22.87 dB, and the conventional replacements of either module (a convolutional gate, a ResNet refinement head and four others) give between 16.58 and 20.26 dB. Full OARL gives 25.56 dB. Against a separate architecture, a Restormer matched in size, input, losses and training budget reaches 22.705 dB on the template-grouped split, and OARL stays 2.767 dB above it. OARL has 17.1M parameters and the standard Restormer of Table 1 has 26.1M.
-
The model works in an unseen room with its weights unchanged. Test (b) is this evaluation. One set of weights, trained in the first room, is evaluated as it is in the second room, and OARL leads on all five measures of Table S14.
-
OARL leads every baseline on the recovered content. Test (c) is this evaluation, on Screen, Browser, OSLock and the second room (Tables S12 and S14).
We will release the dataset, splits, weights and code. We hope the three evaluations you asked for resolve your concerns, and we would be grateful if you would consider raising your score.
We thank Reviewer 5CYz for the updated review. The initial review was posted on October 19, 2026. The review page shows that it was updated on November 14, 2026. The initial review requested additional evidence on held-out screen identities, unseen acquisition conditions, and content-level fidelity. We completed the corresponding evaluations using the available data and an additional second-room set; the results are summarized in Part 1. The revised review raises four related but distinct questions, which we address in Part 2.
Part 1. Response to the initial review. The three evaluations requested in the initial review are complete, and their results support the paper. We added evaluations of screen and template separation, transfer to a second room, and content-level reconstruction. Table S6 reports zero test pairs sharing a source screen or template with the training portion. Table S7 reports results on a template-grouped Screen split, where OARL reaches 25.472 dB PSNR and exceeds the strongest retrieval baseline by 6.059 dB. Table S14 evaluates the Table 1 weights on 200 Screen pairs from a second room with a different wall, camera body, and camera distance, and OARL leads on all five reported measures, with 23.107 dB against 21.142 dB for Restormer and 17.859 dB for retrieval. Table S12 reports layout IoU and text-region recall, and OARL leads on both, with 0.77 and 44% on Screen against 0.66 and 22% for the strongest restoration baseline.
Part 2. Response to the revised review. Each of the four questions of the revised review has a direct answer in our data.
Data partition and independence. Training and test are cleanly separated at the level of source screens and templates, and the second-room set adds a separate capture session. Table S6 reports the train and test counts and shows that no test pair shares a source screen or template with the training portion. Table S7 adds a Screen split in which each template group is assigned wholly to training or test, with OARL, restoration, and retrieval comparisons. Section E.9 describes the screen-display and image-capture procedure. We showed each screen for 3 s by script and photographed it once from a tripod with fixed exposure, ISO, white balance and focus, so every pair links one photograph to one screen. The second-room set of Table S14 comes from a capture session separate from all training data. These results establish source-screen and template separation.
Contributions of the gates and progressive reconstruction. The gain comes from the gates and the progressive reconstruction, and it remains when the backbone is fixed and when the capacity is matched. Table 2 evaluates component removals and replacements. On Screen the full model reaches 25.56 dB, against 23.90 dB without the gates and 22.87 dB without inheritance. Tables 3 and 4 compare representation and learning configurations under a shared U-Net recovery architecture. Figure 6 presents inheritance and reconstruction-order comparisons, and Table S9 adds a capacity-matched Restormer comparison, in which Restormer reaches 22.705 dB against 25.472 dB for OARL. Together, these results support contributions from the proposed components and show that the gains are not explained by model size alone.
Changes in acquisition conditions. The Table 1 weights transfer to a second room and stay ahead under camera-position changes. Table S14 evaluates the Table 1 weights on 200 Screen pairs from a second room with a different wall, camera body, and camera distance. OARL stays 1.97 dB above Restormer and 5.25 dB above retrieval there, and its layout IoU is 0.73 against 0.77 in the training room. Figures 7 and 8 show quantitative and qualitative results under camera-position changes, where we moved the camera through seven positions and OARL leads on all three metrics at each one. This shows transfer to a second room and stability across camera positions.
Content-level accuracy. The screen content is recovered and measured directly, and OARL leads on every measure. Table S12 reports layout IoU and text-region recall for Screen, Browser, and OSLock, and Table S14 reports the corresponding measures for the second-room set. On Screen OARL reaches 0.77 and 44% against 0.59 and 16% for retrieval, and in the second room 0.73 and 37% against 0.48 and 6%. Exact character transcription and icon identification from a diffuse wall have not been reached by any published method. Backes et al. (IEEE S&P 2009) studied this same channel and resolved a single 10 cm letter on a 3×3 grid at 25 cm, and the readable text in the literature comes from mirror-like reflections or from the raster timing of a CRT. Our first response gives this literature in full under (c).