- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a two-stage method for atmospheric turbulence restoration. The first stage corrects multiple input frames to estimate a stable frame. The second stage uses a Kolmogorov structure function to improve image quality. The method achieves good results on several test datasets.
Critical strengths
The experimental results are strong. The authors also provide video demo to demonstrate the method on real-world data.
Critical weaknesses
1.The novelty claims appear overstated. The proposed method has two stages. The first stage aligns multiple frames and produces a single output frame. The second stage learns a Kolmogorov structure function with adjustable parameters for turbulence restoration. The authors describe the first-stage output as a “geometry-stabilized intermediate representation.” However, this stage appears to be a network that selects a lucky frame and aligns multiple frames to it.
2.Equations (5)–(7) model the effect of exposure time on turbulence-degraded images. However, they do not appear to be connected to the model introduced later.
3.The paper omits several important related works and datasets [1–3]. The proposed method should be compared with these works and evaluated on the relevant datasets.
4.The authors propose two metrics to evaluate temporal stability. In Appendix B.3, these metrics measure changes in image gradients between adjacent frames. However, the paper provides little explanation of how these metrics relate to the imaging model. It also lacks visual evidence to verify their reliability.
5.Since turbulence restoration is a physics-based imaging problem, the evaluation should make greater use of PSNR\SSIM, or MTF. Test charts image should also be included for qualitative visual comparisons.
6.The writing and figure legends are unclear in several places, which makes the proposed method difficult to understand.
[1] Diffeomorphic Template Registration for Atmospheric Turbulence Mitigation. CVPR24
[2] Atmospheric Turbulence Mitigation Using Complex Wavelet-Based Fusion. TIP13
[3] Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and a New Physics-Inspired Transformer Model. ECCV22
Questions for authors
1.Turbulence restoration is a physics-based imaging problem. The method design and evaluation should therefore use objective measures wherever possible. Even when reference images are unavailable and PSNR/SSIM cannot be calculated, could the authors capture images of a test chart for quantitative evaluation?
2.In some scenes, turbulence may affect only a small part of the image. How does the proposed method handle such cases, given its limited use of physical modeling?
3.Turbulence Modeling is actually a physical problem, but this paper focus on image restoration, maybe more suitable for CVPR/ICCV/ECCV?
8 comments
Response to Reviewer y1wW (2/4)
W3: The paper omits several important related works and datasets [1–3]. The proposed method should be compared with these works and evaluated on the relevant datasets.
A3: We thank the reviewer for highlighting these relevant studies. We clarify their methodological distinctions and coverage in our evaluation.
Regarding [1], Lao et al. use optical-flow aggregation and inversion to register multiple turbulent frames, then average the aligned frames to form a template and apply blind deconvolution. In contrast, our Stage I learns directly from real turbulent videos to predict a geometry-stabilized representation from a single observation, without requiring neighboring frames or explicit registration at inference. Our key distinction lies in learning an intermediate representation that connects real-video supervision with independently trained, physics-guided detail restoration. The optional multi-frame extension further refines these predicted representations without retraining.
Regarding [2] and [3], both are already cited in our submission. The CLEAR benchmark associated with [2] is evaluated on all 13 test sequences in Table 1, although its complex-wavelet fusion method is not included as a direct baseline. TurbNet [3] is compared in Table 1, while its TurbText dataset is used for OCR evaluation in Table 2.
We acknowledge that [1] and [2] are relevant complementary approaches. Given their multi-frame input requirements and focus on static scenes, we report a matched 12-frame comparison on RLR-AT-Static for reference (Table R1). We will also expand the related-work discussion and clarify the scope of our quantitative comparisons in the revision.
Table R1. Twelve-frame comparison on RLR-AT-Static. CLEAR1 uses region mode. Lower nTII and higher scores on the other metrics indicate better performance.
| Method | LIQE | MUSIQ | NIMA | MANIQA | Q-Align | ARNIQA | HyperIQA | CPBD | LPC-SI | nTII | nTSS |
|---|---|---|---|---|---|---|---|---|---|---|---|
| DTR [1] | 1.487 | 64.308 | 4.760 | 0.379 | 2.150 | 0.591 | 0.519 | 0.851 | 0.971 | 0.578 | 56.373 |
| CLEAR1 [2] | 2.022 | 61.963 | 4.719 | 0.348 | 2.539 | 0.633 | 0.523 | 0.808 | 0.968 | 0.928 | 39.697 |
| Ours | 2.537 | 67.571 | 4.889 | 0.435 | 2.684 | 0.604 | 0.657 | 0.831 | 0.976 | 0.574 | 56.585 |
References
[1] Lao et al., Diffeomorphic Template Registration for Atmospheric Turbulence Mitigation, CVPR 2024.
[2] Anantrasirichai et al., Atmospheric Turbulence Mitigation Using Complex Wavelet-Based Fusion, TIP 2013.
[3] Mao et al., Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and a New Physics-Inspired Transformer Model, ECCV 2022.
W4: The authors propose two metrics to evaluate temporal stability. In Appendix B.3, these metrics measure changes in image gradients between adjacent frames. However, the paper provides little explanation of how these metrics relate to the imaging model. It also lacks visual evidence to verify their reliability.
A4: We thank the reviewer for raising this question. Appendix B.3 measures the second-order temporal differences of normalized high-pass structure maps, rather than directly measuring image gradients (Eqs. B.1–B.3). Its connection to the imaging model follows from Eq. (2): for small turbulence-induced displacements in a static scene, image variations are approximately proportional to the spatial gradient of the blurred scene and the displacement fluctuations. The second-order temporal difference therefore captures irregular structural fluctuations around scene boundaries, while normalization reduces sensitivity to high-frequency amplitude. nTII measures this temporal instability relative to the turbulent input, and nTSS is its exponential transformation. These metrics characterize temporal structural stability rather than directly measuring physical turbulence strength or distinguishing turbulence from arbitrary scene motion.
Visual and quantitative evidence. Figure 4 provides space–time traces of final restorations, while Figure 9 directly compares turbulent inputs, single-frame representations, and twelve-frame refined representations. The progressively more regular structural trajectories are consistent with Table 6, where nTII decreases from 1.000 (input) to 0.784 (Stage I) and 0.349 (twelve-frame refinement) at d=1 across 65 held-out static scenes. These results provide complementary visual and quantitative evidence that the proposed metrics reflect reductions in temporal structural fluctuations.
Response to Reviewer y1wW (3/4)
W5 & Q1: Since turbulence restoration is a physics-based imaging problem, the evaluation should make greater use of PSNR/SSIM, or MTF. Test charts image should also be included for qualitative visual comparisons.
A5: We thank the reviewer for this suggestion. Our primary goal is real-world atmospheric turbulence restoration, particularly under long-range imaging conditions where accurately paired turbulence-degraded and clean reference images are generally unavailable. Consequently, full-reference metrics such as PSNR and SSIM cannot be reliably applied to our main real-world benchmarks. We therefore primarily evaluate perceptual quality, structural sharpness, and temporal stability.
To provide complementary quantitative evidence, Appendix C.1 (Table 5) reports PSNR/SSIM on the paired synthetic TMT-Static dataset under an alternative supervised training protocol. Figure 5 further evaluates the effective MTFs of learned intermediate representations, demonstrating their frequency-response compatibility with the physics-guided Stage-II blur family.
Following the reviewer's suggestion, we additionally evaluate our method on two real turbulence-degraded test-chart sequences from OTIS [4], where reference images are available. As shown in Table R2, our twelve-frame method achieves the highest mean PSNR (11.025 dB) and SSIM (0.51602), together with the best temporal stability among the compared methods. We also provide two supplementary videos, Test chart1.mp4 and Test chart2.mp4, showing synchronized comparisons of the inputs, reference charts, baseline methods, our intermediate representations, and final restorations. While our method achieves better overall metrics, some baselines exhibit more discernible high-frequency details in densely patterned regions, highlighting a limitation of our training-free refinement in exploiting complementary details across frames. Future work will explore more effective cross-frame detail aggregation while preserving geometric and temporal stability.
Table R2. Additional evaluation on real OTIS test charts. Parentheses denote the number of distinct input frames.
| Method | PSNR (dB) ↑ | SSIM ↑ | nTII ↓ | nTSS ↑ |
|---|---|---|---|---|
| DATUM (1) | 10.677 | 0.47038 | 1.070 | 34.290 |
| MambaTM (1) | 10.471 | 0.47225 | 1.033 | 35.602 |
| Ours (1) | 10.741 | 0.48381 | 0.836 | 43.377 |
| DATUM (12) | 10.788 | 0.49767 | 0.620 | 53.798 |
| MambaTM (12) | 10.698 | 0.48286 | 0.635 | 53.013 |
| Ours (12) | 11.025 | 0.51602 | 0.553 | 57.561 |
References
[4] Ferrante and Gilles, Open Turbulent Image Set (OTIS), Pattern Recognition Letters, 2017.
W6: The writing and figure legends are unclear in several places, which makes the proposed method difficult to understand.
A6: We appreciate the reviewer's feedback. We will carefully revise the manuscript to improve the clarity of the writing, figure captions, and methodological explanations, particularly the relationship between the physical analysis and the proposed framework, the distinction between single-frame inference and multi-frame refinement, and the interpretation of the evaluation metrics.
Response to Reviewer y1wW (1/4)
W1: The novelty claims appear overstated. The proposed method has two stages. The first stage aligns multiple frames and produces a single output frame. The second stage learns a Kolmogorov structure function with adjustable parameters for turbulence restoration. The authors describe the first-stage output as a “geometry-stabilized intermediate representation.” However, this stage appears to be a network that selects a lucky frame and aligns multiple frames to it.
A1: We thank the reviewer for the comments and would like to clarify the proposed framework and its main contribution.
Stage-I representation learning. Contrary to the reviewer's interpretation, Stage I neither selects a lucky frame nor aligns multiple frames at inference. Instead, it learns to predict a geometry-stabilized intermediate representation from a single turbulent frame (Eq. 1). Unlike simulation-driven approaches, Stage I learns directly from real turbulent videos without synthetic turbulence/clean-image pairs. Guided by the long-exposure analysis, temporal-average proxies and inter-frame consistency supervision enable the network to suppress geometric fluctuations while retaining residual blur for subsequent restoration (Eq. 8). Multi-frame registration is used only in the optional training-free extension (Algorithm 1).
Stage-II restoration. Our contribution is not simply the sequential application of geometric correction and deblurring, but learning an intermediate representation that connects two independently supervised restoration stages. Stage I learns geometric stabilization from real turbulent videos without paired clean images, while Stage II learns detail restoration from physics-guided synthetic blurred/clean pairs. Specifically, the Kolmogorov-inspired frequency response motivates a family of residual blur degradations, with sampled parameters and spatially varying blur (Eqs. 9–10). Stage II learns the corresponding restoration mapping rather than estimating or learning the Kolmogorov structure function itself.
Experimental support. Table 3 evaluates the learned representation using an identical, fixed Stage-II restorer. Despite requiring only a single input frame, our learned representation achieves 67.356 MUSIQ and 0.834 CPBD, compared with 58.602 MUSIQ and 0.753 CPBD when directly restoring a 50-frame temporal average. These results demonstrate that the learned representation provides a more effective restoration interface than direct temporal averaging, supporting its role in connecting real-video supervision with independently trained detail restoration.
W2: Equations (5)–(7) model the effect of exposure time on turbulence-degraded images. However, they do not appear to be connected to the model
Fθ(Y)introduced later.A2: We thank the reviewer for this question. Eqs. (5)–(7) provide the physical motivation for the intermediate representation learned by Stage I. They show that temporal integration statistically suppresses turbulence-induced geometric fluctuations while converting displacement variations into residual blur, motivating a geometry-stabilized intermediate domain.
Connection to learning. Section 3.2 translates this physical insight into the training objective of
Fθ. Specifically, finite temporal averages of real static-scene turbulent videos serve as supervision proxies for the intermediate domain, while the reconstruction and inter-frame consistency losses in Eq. (8) encourageFθto predict geometrically stabilized representations from individual observations. Since finite-frame averages only approximate the ideal long-exposure limit, they provide scene-content anchors rather than exact physical targets. The resulting representation also connects to Stage II, where Eq. (9) extends the long-exposure frequency response in Eq. (7) to construct physics-guided blur models for independent detail-restoration training.This connection is further supported by Table 4, where inter-frame consistency improves MUSIQ from 63.291 to 67.356, and Figure 5, which shows that the learned representations exhibit effective frequency responses compatible with the Stage-II blur family. We will clarify these connections between the physical analysis, representation learning, and restoration model in the revision.