- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies hyperspectral image (HSI) restoration under complex corruptions in a self-supervised setting. Building on the use of diffusion models for inverse problems, the authors aim to improve the ability of self-supervised diffusion methods to handle complex corruptions in HSI. To this end, the authors propose VITTA, which combines variational inference of observation noise and its uncertainty with a Temporal Tucker Prior Module to improve restoration performance under complex corruptions. The authors then theoretically analyze error bounds of the proposed VITTA method and demonstrate better restoration performance than the compared methods in experiments involving complex corruptions.
Critical strengths
- Although extending self-supervised diffusion methods to complex corruption settings is relatively incremental, these settings represent practical problems commonly studied in HSI restoration. Moreover, the authors consider the structural differences between HSI data and ordinary images and introduce a Temporal Tucker Prior Module to provide prior information about clean HSI data. This makes the proposed method more than a straightforward application of existing diffusion methods.
- As a diffusion-based method for inverse problems, the authors provide a theoretical analysis of the proposed restoration method. Under certain assumptions, they establish an approximation result and a conditional error bound. In the context of inverse problems, these analyses help explain the performance of the proposed method.
Critical weaknesses
Critical Weaknesses
- In diffusion-based restoration, existing studies have proposed various mechanisms for modeling complex noise and sparse outliers in observations, including approaches based on non-Gaussian likelihoods. This paper instead adopts a Gaussian projection, motivated by the need to "adapt the non-Gaussian observation residual for Gaussian-formulated conditional diffusion." If this design is intended as a contribution, the authors should more clearly explain and validate its relative advantages over directly using robust non-Gaussian observation models.
- Limited experimental coverage. The paper demonstrates the performance of VITTA under fixed complex degradation settings, but does not verify whether its advantages hold under stronger or milder noise conditions, as the tested signal-to-noise ratio (SNR) range is relatively narrow. Moreover, the mixed-corruption experiments do not cover certain cases, such as Gaussian-only noise or high proportions of impulse noise. It would be important to examine the method's performance under these conditions and their effects on parameter selection, as these settings are directly related to the proposed noise modeling mechanism.
Minor concerns
- The method involves several hyperparameters, including different numbers of diffusion steps K for different tasks. Given the variation and precise settings of these hyperparameters, the authors should clarify the criteria used for hyperparameter selection and the associated tuning cost.
- In some settings in Table 1, adaptive methods outperform pretrained supervised models. The authors should further clarify whether the training and testing settings of different methods are comparable, particularly regarding how well the pretrained models match the noise distributions used in testing and how their checkpoints were selected.
Questions for authors
My questions are those raised in critical weaknesses 1 and 2 above, they are the main concerns affecting my assessment.
2 comments
Thank you for the detailed responses and additional experiments. The responses have adequately addressed my concerns.
Thanks.
Response to CW 1
Compared with directly using robust non-Gaussian observation models, we would like to clarify that the advantage of VITTA lies not in approximating non-Gaussian noise as Gaussian, but in integrating explicit non-Gaussian corruption inference with reliability-guided Gaussian conditional diffusion.
VITTA infers band-dependent dense noise and sparse heavy-tailed corruption via variational inference, then applies forward-KL-optimal Gaussian projection to turn uncertainty into adaptive observation reliability. This preserves first-order and second-order statistics and quadratic risk of the affine transition, while bounding higher-order discrepancies that diffusion further attenuates in reliable channels. These advantages are further reflected in comparisons with existing restoration methods. For example, neither HLRTF nor GNRSR explicitly incorporates probabilistic noise uncertainty into diffusion sampling, whereas VITTA exploits the stronger generative priors and progressive refinement capabilities of diffusion sampling, further enhanced by temporal regularization across reverse steps. Additionally, we replaced VITTA's variational noise-adaptation component with Huber and IRLS [1], obtaining average PSNR/SSIM/SAM results of 31.254/0.8375/0.1025 (Huber) and 30.655/0.8118/0.1073 (IRLS), with 33.138/0.8911/0.0957 for VITTA. These approaches lack explicit modeling of different noise components and their associated uncertainty, resulting in being inferior to VITTA. These results demonstrate VITTA's superiority under complex degradations.
[1] Outlier-Robust Diffusion Solvers for Inverse Problems
Response to CW 2
We conducted additional experiments as required to verify VITTA’s robustness.
Weaker and stronger mixed noise: We scaled the complete corruption residual according to yα=x+α(yoriginal−x), where x denotes the clean HSI (downsampled for pansharpening), yoriginal is the observation generated under the original mixed-corruption protocol, and α controls the overall corruption intensity. Specifically, we set α=0.5 and α=1.5.
Gaussian-only noise: Independent Gaussian noise with σ=0.1.
High-density impulse noise:50–70 corruption ratios.
Results in Table R1 confirm VITTA’s robustness. Due to space limitations, more details are in Appendix L.5.
Table R1.
Best Baseline→VITTA: PSNR/SSIM/SAM.
Different degradation levels also affect VITTA's parameter selection since varying degradations require different model capacities and regularization strengths to balance noise suppression with detail preservation. For instance, increasing mixed-noise intensity shifts λtraj from 0.01 to 0, while raising impulse corruption adjusts Tucker ranks (Rs,Rλ,Rtemp) from (40,16,4) to (40,16,2). Notably, VITTA selects these parameters via no-reference NIQE and Spectral Roughness without ground truth.
Response to CW 3
VITTA selects its parameters using the no-reference metrics NIQE and Spectral Roughness without GT. Since different scenes and degradation types require different model capacities and regularization strengths, our adaptive selection strategy is reasonable and consistent with practices widely adopted in prior studies. The associated tuning cost requires approximately 16 trials on average to determine the final parameter settings. We also tuned competing methods to achieve their best possible performance.
Response to CW 4
All methods are evaluated under identical testing conditions for fairness. Importantly, the noise distributions used to train pretrained models are broadly consistent with our testing degradations, covering Gaussian noise and sparse corruptions such as impulse noise, stripes, and dead lines. For example, SERT explicitly includes non-i.i.d. Gaussian noise, Gaussian noise combined with stripes, dead lines, or impulse noise, and mixed-noise cases during training. We use the official pretrained checkpoints. Although specific noise intensities and proportions may differ, such variations are common in real HSI applications, whereas VITTA can adapt directly to the corruption characteristics of each observed scene.