- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a framework that recovers hidden display content from the weak light reflected off a wall. More precisely, it presents a two-pass framework, Relay-State Hierarchical Representation Learning (RSHRL), which consists of a Relay-Wall Invertibility Representation (RWIR) and Damage-State Learning (DSL). The authors additionally contribute four self-collected paired datasets, 8,777 wall-observation and screen-image pairs in total, captured under two different acquisition setups.
Critical strengths
1.
I think the data contribution is substantial: four paired datasets totaling 8,777 pairs of a wall observation and the screen image that produced it, captured by the authors themselves under two acquisition setups. As far as I know, measured benchmarks for this task (recovering a hidden screen from the light it casts on a wall) are scarce, so this collection could be the basis for recovering hidden display content from the weak light.
Critical weaknesses
1.
To me, the central feasibility claim (that hidden screen content could be recovered by reading the wall-reflected light) does not seem separated from a simpler explanation: the model may largely have memorized what screens in each dataset typically look like, and draws that, rather than reading the signal of the wall. The setting seems favorable to such memorization: training and testing use the same acquisition setup (Appendix A) and the same family of screen content (desktop/UI, lock screen, or game/HUD; Table 5).
And as far as I could find, how the train/test split was made is not described (Table 5 gives counts only), so visually near-identical screens could exist both sides of the split.
I also could not find a control experiment that measures how much of the reconstruction comes from the wall signal versus this memorized prior. The paper's robustness table seems to show the problem: averaged over the clean condition and five Gaussian-noise levels, RSHRL's scores are almost unchanged from clean (14.52 to 14.53 PSNR on OSHome, 16.74 to 16.77 on OSLock; Tables 1 and 3). That is, if the input is heavily corrupted but the output score barely moves, it looks to me like the model is not really reading the input, which is the behavior a memorization-driven predictor would show. The regional-masking study (Appendix C.3.4) is qualitative and does not quantify this, as far as I can tell.
The conclusion's "initial feasibility of recovering hidden screen content" depends on showing that the wall-reflected light, not the model's memorization, drives the result. Thus, I think this weakness is the main reason for my recommendation.
2.
Second, the comparative evidence does not seem strong enough for its stated claim. As far as I checked, every number appears to come from a single training run with no variance estimate, and on three of the four datasets the margin over the best of 20 baselines is only 0.18 to 0.30 dB PSNR (14.52 vs. 14.34 on OSHome; 16.74 vs. 16.54 on OSLock; 18.45 vs. 18.15 on Game; Table 1).
In my experience, gaps of this size could easily flip with a different random seed. But the abstract claims "RSHRL leads the evaluated restoration baselines across all 12 PSNR, SSIM, and LPIPS comparisons." In my opinion, one run each for 21 models could not establish such a ranking. To claim a performance improvement with gaps of this size, I think at least three seeds are needed, with per-seed values and the variance reported.
In particular, given that training details such as the batch size or learning rate are not reported, it seems difficult to be confident that these gains are reliable.
Questions for authors
- In Table 2, the "w/o RWIR" and "w/o DSL" variants score 16.73 and 16.11 dB on Screen, below several standalone baselines in Table 1 (for example, AdaIR at 21.71 dB (2nd best)). In my understanding, a variant that merely lacks one proposed component should still behave like an ordinary restoration network (i.e., I would expect the "w/o RWIR" and "w/o DSL" variants to score at least around 21 dB, on par with the stronger standalone baselines). So when it falls about 5 dB below off-the-shelf methods trained on the same data, it looks to me as if the removal degraded the network as a whole rather than isolated the component. Measured against such a weakened reference, the +9.22 dB gap would mostly reflect recovering from that damage, not the value RWIR adds over a sensible alternative (against AdaIR, for instance, the margin is +4.24 dB). Could you explain what makes the removed variants fall this far below ordinary baselines (for example, lost capacity, or some functions the remaining modules depend on)?
- Could you report an input-blind control (for example, feeding an all-zero or constant gray image instead of the wall observation) or a mismatched-pair control (for example, evaluating the output for sample A's wall observation against sample B's target), with the resulting PSNR/SSIM/LPIPS?
- Could you provide the training configuration (optimizer, learning rate, schedule, iterations, batch size, parameter count, hardware) for RSHRL and for each retrained baseline (at least for RSHRL)? As far as I could find, none of this is reported.
- I was confused by several baseline numbers that are so low that, to me, they suggest those models did not train properly (DarkIR at 6.57 and 4.46 dB, SFHformer at 8.82 dB on Screen, DeepSN-Net at 10.48 dB; Table 1). Could you share evidence that these baselines converged under your protocol?
- How were the train/validation/test splits constructed for each dataset (Table 5 reports counts only)? And roughly what rate of near-duplicate screen content (same desktop layout, wallpaper, or HUD) appears across splits?
- Could you explain the margin asymmetry between Screen (+4.24 dB) and the other three datasets (+0.18~+0.30 dB; Table 1)?
- Could you clarify what this task is intended to be useful for (for example, a privacy or eavesdropping risk study in Kuhn (2002))? As far as I could find, the paper motivates it only as a feasibility question, and the significance of the result seems to depend on this.
Minor issues:
- Several acronyms are used before they are defined: DACA, DASA, and SDR in the abstract, and CRT and NLOS in the introduction. Please spell them out at first use.
- Figure 2 carries too much explanatory text inside the figure itself. In my opinion, the parts that repeat the caption or the main text could be removed so that only the essential labels remain.
- Some passages repeat almost the same sentences. For example, Appendix C.5.1 contains two nearly identical paragraphs in a row ("On the same Screen example, the full configuration preserves..." followed by "On the same Screen example, the full model preserves..."). Removing such repetition could make the paper easier to follow.