- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies infrared video super-resolution (IVSR) under turbulent conditions. The authors argue that real object/camera motion can provide effective cross-frame information, whereas the pseudo-motion produced by atmospheric turbulence instead disrupts alignment, and therefore the two should not be treated uniformly as ordinary motion. CAMO uses LMTD in the latent space to factorize the temporal variations into an object-motion component and a turbulence component, and designs TRMCP to estimate motion reliability based on phase, radiative, and edge consistency. Subsequently, TCLR is used to suppress turbulence perturbations, MCTE exploits the real motion to enhance temporal information, and MRGD adjusts the DiT features and the prediction process according to reliability. The model is built on CogVideoX1.5 and adopts one-step inference.
Critical strengths
- The problem definition is more targeted than conventional motion-guided VSR. The paper does not simply pursue a more accurate optical flow; instead, it distinguishes between "beneficial real motion" and "harmful turbulence-induced pseudo-motion." For turbulent IVSR, this entry point is reasonable and does indeed target the tendency of existing methods to misuse temporal correspondence.
- The overall method is fairly complete, with clear division of labor among modules. LMTD handles the factorization, TCLR processes the turbulence component, MCTE uses the object-motion component, and MRGD further adjusts the generation process according to reliability. Although there are many modules, they are not simply stacked: each one basically corresponds to a problem raised earlier.
- The results on FLIR-IVSR are strong. On this dataset, CAMO achieves the best results on PSNR, SSIM, LPIPS, DISTS, MUSIQ, BRISQUE, DOVER, and FasterVQA, and it does not merely dominate on perceptual metrics—reconstruction metrics and temporal metrics are also strong simultaneously. The advantage on M3FD is not as comprehensive, but the results remain competitive overall.
Critical weaknesses
- The claim of "causal-role-aware" is somewhat overstated. In fact, the paper does not perform causal identification in the strict sense. is factorized by learnable modules and then constrained through HQ/LQ consistency, TRMCP, and reconstruction losses. Such a design can produce useful representations, but it does not guarantee that the two components respectively correspond to object motion and turbulence in the physically meaningful sense.
- The basic assumption of TRMCP may not be robust under complex motion. The method first estimates local translation and then treats phase, radiative, and edge residuals that cannot be explained by coherent translation as turbulence evidence. However, fast non-rigid motion, occlusion, rotation, and scale changes can also produce large residuals; conversely, slowly varying turbulence does not necessarily manifest as obvious random high-frequency perturbations. Thus, the current prior resembles an empirically effective reliability cue rather than a physical criterion sufficient to distinguish the two types of motion.
- The experiments on M3FD cannot actually sufficiently validate motion-turbulence disentanglement. The authors repeat a single image for 30 frames and then add turbulence, downsampling, and noise. The videos generated in this way have no real object motion themselves, so this dataset mainly validates turbulence suppression, rather than whether the two can be correctly separated when "real motion and pseudo-motion coexist."
- Backbone capacity is an obvious confounding factor. CAMO has about 5.8B parameters, far more than HATIR, DLoRAL, DGAF-VSR and other methods, and is built directly on CogVideoX1.5. The current results can show that the final system is strong, but it is not yet easy to determine how much of the gain comes from motion-turbulence modeling and how much comes from the larger pretrained video backbone.
Questions for authors
The M3FD videos are generated by repeating a static image, so they contain no real motion. Could the authors add a test set that contains both real scene motion and real/simulated atmospheric turbulence? This is important for validating the paper's core disentanglement claim.
Response to Reviewer sqqU
We thank the reviewer for the thoughtful assessment and for recognizing the motivation for treating object motion and turbulence-induced pseudo-motion differently and the distinct roles of the proposed modules. We address each point below.
Q1. Meaning of “causal-role-aware” and interpretation of the components. We thank the reviewer for drawing attention to the scope of this term. In CAMO, “causal-role-aware” refers to the distinct roles of the learned components in restoration. The turbulence component guides LR latent rectification before diffusion, while the object-motion component guides cross-frame refinement after diffusion. The training objectives encourage this separation without imposing a unique physical decomposition. Fig. 11 (Appendix A.1) shows that the object-motion component tends to follow coherent structures and moving boundaries, while the turbulence component exhibits more spatially irregular responses. In Figs. 10 and 19, injecting the learned turbulence component into HR videos produces SynLR sequences that more closely match the observed LR sequences than either the original HR videos or the random blur-and-distortion control. These results support the interpretation that the learned component captures turbulence-related degradation patterns.
Q2. Reliability of TRMCP under complex motion. We agree that occlusions, rotations, scale changes, and fast nonrigid motion can leave large residuals after translation compensation, while slowly varying turbulence may elicit weaker responses. TRMCP estimates translation separately in overlapping patches so that compensation can adapt to spatially varying motion. The resulting phase, radiative, and edge residuals measure local coherence, and CAMO combines their fused score with latent motion uncertainty to estimate reliability (Sec. 3.2). Fig. 12 (Appendix A.3) and our additional analysis in Table R1 show that the mean fused score increases with turbulence strength over the tested range.
Table R1. TRMCP component responses across turbulence strengths. Values are mean ± sample standard deviation across 50 videos at each setting. Normalization scales are held fixed across settings. Smaller r0 indicates stronger turbulence.
Q3. Evaluation when real motion and turbulence coexist. We agree that the repeated-frame M³FD sequences evaluate restoration under turbulence in static scenes. FLIR-IVSR includes captured infrared sequences with real scene motion (camera and object motion) and paired turbulent LR inputs. Table 1 reports restoration performance across the test split, and Figs. 5 and 16 show temporal profiles for individual FLIR-IVSR examples. The ablation in Fig. 7 further measures the restoration benefit of the decomposition across the same split. The video demos on our anonymous project page provide additional qualitative examples of CAMO preserving moving object boundaries and reducing temporal jitter in FLIR-IVSR clips with real object and camera motion under turbulence.
Q4. Influence of the pretrained backbone. We thank the reviewer for raising the question of how much of the improvement is attributable to the CAMO design. We added a one-step restoration baseline using the same pretrained CogVideoX1.5 backbone (Table 3, Appendix A.10). Full CAMO improves PSNR from 31.6642 to 36.7342 dB (+5.07 dB) and reduces LPIPS from 0.1642 to 0.1160, with improvements in SSIM and BRISQUE as well. This comparison measures the gain of the full CAMO design with the pretrained backbone held fixed. The LMTD ablation in Fig. 7 and the separate TCLR and MCTE ablations in Table 3 provide additional evidence about the contributions of these components within the pipeline.