- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the recovery of screen content from images formed by diffuse wall reflections. The pipeline first builds a representation from the observation and an initial reconstruction, and then separates structure-related and degradation-related cues. The experiments cover four kinds of screen content, several restoration baselines, component ablations, and variations in the imaging conditions.
Critical strengths
- The paired physical capture setup addresses an interesting indirect-imaging problem, and the results suggest that the method has some ability to generalize.
- The system diagram and the qualitative figures are clear and easy to understand.
- The experiments include diverse imaging setups, and the method performs reasonably well across them.
Critical weaknesses
- The authors should clarify the relationship between the stated correction bound and the main ablation. Equation 8 and App. A.3.13 state that the final output differs from the clipped frozen anchor by at most 0.008 per pixel; however, Table 4 reports a large improvement between the w/o CCH result and the full model, from 11.73 to 21.16 dB on Screen.
- It would be useful for the authors to provide more analysis of when the correction is beneficial and when the anchor is already adequate.
- Some details about the training and testing protocols are missing. In particular, it is unclear whether the displayed screen contents, templates, and capture sessions are separated between the training and test sets.
Questions for authors
Please address the concerns in Critical Weaknesses.
Thank you for the review. We answer your three points in order. A revised PDF is uploaded.
1. The correction bound and Table 4
The reported models were trained and evaluated with ρ = 0.91, and Eq. 8 holds for every one of them at this value. The 0.008 printed in Section 3.3 and Figure 2 of the submission belongs to an earlier configuration. The revision prints 0.91 in both places and states Eq. 8 for ρ = 0.91 in Section 3.3 and Appendices A.3.12 and A.3.13.
The submitted tables show which value was in use. A model held within 0.008 of the 11.73 dB anchor stays within about 0.3 dB of it. On Screen, twelve of the eighteen ablation variants in Tables 2–4 lie more than 1.5 dB from the anchor, on both sides of it: w/o SPDRL is 1.6 dB below (10.12) and w/o RCCA is 6.3 dB above (17.99). This spread is the result of the wide range, ρ = 0.91, under which all reported models were trained.
The bound that acts at each pixel is ρ·a(p), set by the admission map.
2. When the correction helps and when the anchor is already adequate
The correction is large where the base leaves much to recover and small where the base is already good, and in both cases the gain comes from admitting it pixel by pixel.
When the anchor is already adequate, a plain refiner adds 0.2 dB on Screen and the admitted correction adds 1.1 dB. The revision reports this comparison in the main text (new Section 4.5, Table 5) and states the two regimes in Section 3.3.
3. Training and test protocol
Contents. Each dataset has one fixed training, validation and test partition, shared by our method, the frozen base and every baseline. Every content item belongs to exactly one partition, together with all of its repeated captures, crops and derived versions, and a content item used under two capture configurations keeps the same partition in both (Section 4.1 of the revision).
Capture sessions. We evaluated the Table 1 checkpoints as trained on test data from the original scene rebuilt, from a different camera and from a different room. Our method leads DocRes and DEA-Net in all 12 columns of each setting. With the scene rebuilt, every method stays within 0.14 dB of its Table 1 result. With a different camera and in a different room, our method changes by 0.5 to 0.8 dB, against 0.8 to 1.3 dB for the two baselines (Table S9 of the revision).
Baselines. All 21 baselines were trained on the same paired training set as our method, from their public initialization with their released loss, optimizer and schedule, and selected on the same validation set.
We hope these answers and the revision are useful for your final assessment.