- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
CMOS sensors have dominated the consumer market while it has severe limitations, e.g., rolling shutter effect. Although the recent RSGR mode mitigates this issue to some extent, it also incurs two limitations: reduced capture speed and compressed dynamic range. To tackle this problem, this paper introduces a novel dual reversed scanning setup utilizing both RSGR and inverted RSGR views. In addition, the authors also construct a coaxial imaging system to collect a real-world dataset. Experiments verify the effectiveness of the proposed method.
Critical strengths
-
This paper proposes HaRP, which mitigates two main limitations of RSGR. By combining RSGR and iRSGR, HaRP establishes row-wise exposure complementarity directly at the physical imaging layer. This concept is elegant and fundamentally alleviates the ill-posed nature of RSGR dynamic range compression and motion blur.
-
The authors constructed a functional coaxial optical platform and capture RSGR-HDR consisting of 90 dynamic sequences with 500 fps HDR ground truth.
-
The authors adapted representative baselines into dual-view variants, demonstrating significant and consistent quantitative advantages on both real and synthetic benchmarks.
Critical weaknesses
-
When scanning reaches the sensor's central rows, the exposure durations of the RSGR and iRSGR cameras converge to the exact same value. If high-contrast highlights or deep shadows appear in this central region, both cameras will saturate or underexpose simultaneously. DoesHDR recovery in the center rows rely predominantly on learned neural inpainting rather than physical measurement?
-
On the synthetic GOPRO-Dual dataset, the proposed method achieves 35.88 dB; however, on the physical RSGR-HDR benchmark, the PSNR plunges to 24.24 dB. Does this indicate potential unmodeled systematic errors in the physical capturing rig?
-
Sec. 4.1 acknowledges that the network directly outputs tone-mapped LDR images, and evaluation relies entirely on standard LDR metrics (e.g., PSNR, SSIM, LPIPS). Standard linear radiance metrics (HDR-VDP-2, PSNR-PU, SSIM-μ) are omitted. This is also inconsistent with the title of this paper.
Questions for authors
-
What is the fundamental cause of the 11.6 dB degradation between synthetic GOPRO-Dual (35.88 dB) and real RSGR-HDR (24.24 dB)? Is it sensor noise, beam-splitter light attenuation, or residual parallax that fails to resolve in 3D scenes?
-
If claiming HDR reconstruction, please report evaluations predicting unclipped linear radiance maps under standard HDR metrics (HDR-VDP-2 / 3, PSNR-PU, etc).
3 comments
Weakness 2 PSNR Difference Between Real and Synthetic Data
Absolute PSNR values across different datasets—particularly synthetic and real-world benchmarks—should be interpreted with caution because they reflect different data distributions and levels of difficulty. Accordingly, the gap between 35.88 dB on GOPRO-Dual and 24.24 dB on RSGR-HDR does not necessarily indicate unmodeled systematic errors in the physical capturing rig. We provide the following analyses to clarify this difference.
First, synthetic data cannot fully reproduce real imaging degradations, and previous studies have demonstrated a substantial domain gap between synthetic and real restoration data due to simplified imaging models [1, 2]. In particular, widely used video-based synthesis pipelines, including ours, temporally interpolate relatively low-frame-rate videos before synthesizing the degraded observations. This produces smoother and more regular frame transitions than real capture, while the simplified forward model further omits many physical degradations, substantially reducing the reconstruction difficulty. This is precisely why we construct a dedicated imaging system and collect the real-world RSGR-HDR dataset as one of our main contributions; GOPRO-Dual is used only for supplementary validation.
Second, instead of directly comparing the final PSNR values, we additionally measure the initial input PSNR and calculate the improvement achieved by our method:
| Dataset | Initial RSGR | Ours | PSNR Gain |
|---|---|---|---|
| GOPRO-Dual | 19.02 | 35.88 | +16.86 |
| RSGR-HDR | 12.30 | 24.24 | +11.94 |
After accounting for the initial input quality, the difference decreases from 11.64 dB in absolute PSNR to 4.92 dB in performance gain, demonstrating that a substantial part of the apparent gap originates from the different initial difficulty of the two datasets.
Third, directly comparing the same method’s absolute metrics across different datasets is generally not meaningful because PSNR strongly depends on scene content, dynamic range, degradation severity, and ground-truth distribution. For example, our method obtains 23.54 dB on Adobe-Dual and 24.24 dB on LiU-HDRv-Dual in Section B.2, which are comparable to the 24.24 dB obtained on the real RSGR-HDR benchmark, although Adobe-Dual and LiU-HDRv-Dual do not contain errors from our physical capturing rig. This further confirms that the lower PSNR on RSGR-HDR reflects dataset difficulty and distribution rather than unmodeled systematic errors in the physical system.
[1] Rim et al., “Real-World Blur Dataset for Learning and Benchmarking Deblurring Algorithms,” ECCV 2020.
[2] Rim et al., “Realistic Blur Synthesis for Learning Image Deblurring,” ECCV 2022.
Weakness 3 HDR Evaluation Metrics
As explained in lines 375–391, our output design is grounded in the established exposure-fusion paradigm (Mertens et al., 2007; Lin et al., 2023; Chen et al., 2025). Following these works, we directly reconstruct display-ready tone-mapped results rather than first estimating linear radiance maps and then applying tone-mapping operator. As demonstrated by UltraFusion (Chen et al., 2025), this design avoids error accumulation and additional artifacts introduced by the conventional two-stage pipeline.
Moreover, the “linear-HDR metrics” mentioned in our paper are not actually computed in linear space. In fact, the reviewer-suggested PSNR-PU and SSIM- are also computed in the tone-mapped LDR domain: the linear radiance maps are first transformed using PU encoding or -law tone mapping and then evaluated using standard PSNR or SSIM. Here, “PU” and “” simply indicate the specific tone-mapping transformation used. Since our network directly outputs tone-mapped results, we do not need to first reconstruct linear radiance maps and then apply another tone-mapping transformation before computing PSNR and SSIM. Therefore, our PSNR and SSIM evaluation is fundamentally consistent with PSNR-PU and SSIM-, as all of them are computed on clipped, tone-mapped representations of the underlying linear radiance maps.
In addition, following UltraFusion, we report TMQI (Tables 1 and 5), an important metric widely used in HDR imaging. Therefore, our evaluation using PSNR, SSIM, and TMQI is fully consistent with the HDR objective and title of this paper. To further compare with conventional HDR reconstruction methods, we additionally report both HDR-VDP-2 and HDR-VDP-3 below.
| Method | HDR-VDP-2 | HDR-VDP-3 |
|---|---|---|
| LAN | 24.7635 | 5.7439 |
| HDRFlow | 24.3315 | 5.2198 |
| Dai et al. | 38.3365 | 6.9527 |
| LRHDR | 23.3707 | 5.6970 |
| DeAltHDR | 17.6506 | 5.2260 |
| Ours | 57.2598 | 8.2791 |
Our method achieves the best performance on both HDR-VDP-2 and HDR-VDP-3, further demonstrating its HDR reconstruction quality in terms of perceptual fidelity and detail preservation across a wide dynamic range.
Weakness 1 Physical Measurements and Central-row Recovery
The exposure durations become identical only at the exact central row under an ideal static configuration. Identical exposure does not necessarily mean invalid measurement: most pixels remain properly exposed unless the scene contains extreme highlights or shadows. Moreover, our reconstruction does not process this row independently. RFA aggregates row-shaped neighborhoods, allowing the central row to exploit physically measured information from adjacent rows, where exposure complementarity immediately reappears. Motion-induced visual shifts further cause the same scene content to be observed at different row indices and exposure durations.
To evaluate the practical influence of central exposure convergence, we uniformly divide each reconstructed frame and its corresponding GT into Top, Middle, and Bottom regions:
Each entry reports PSNR/SSIM/LPIPS. RSGR represents the initial input performance, and Gain denotes the absolute metric improvement over RSGR in the corresponding region.
In practice, the Middle region still achieves substantial gains of 10.48 dB PSNR, 0.2957 SSIM, and 0.1565 LPIPS, demonstrating that central exposure convergence does not cause reconstruction failure or predominant reliance on unconstrained neural inpainting. Nevertheless, if both views are simultaneously saturated or underexposed and no valid neighboring evidence exists, recovery must rely on learned image priors. This is a fundamental limitation shared by all reconstruction methods when the physical measurements contain no valid information.