- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes HPDiff, a zero-shot blind hyperspectral pansharpening framework leveraging pre-trained RGB diffusion priors without paired training data. Its pipeline combines adaptive PSF and SRF estimation via domain alignment, physical degradation, and Sobel edge-guided reverse diffusion sampling, and test-time self-supervised optimization using spatial-spectral low-rank factorization.
Critical strengths
-
Cleverly leverages low-resolution domain alignment with Softmax center-clustering for PSF and soft-gated windowing with second-order differences for SRF, effectively preventing trivial or degenerate solutions in blind degradation estimation.
-
Translates physical re-projection residuals and Sobel edge losses into posterior gradient guidance during sampling, successfully balancing rich texture generation with strict observation consistency and suppressing diffusion hallucinations.
-
Bypasses direct high-dimensional pixel prediction by factorizing outputs into spatial and spectral matrix components with orthogonality constraints, reducing parameters while preserving spectral fidelity.
Critical weaknesses
1.Fails to compare against recent (2024–2026) zero-shot diffusion and generative hyperspectral pansharpening methods, such as: (1) Xiao, Jin-Liang, et al. "Hyperspectral pansharpening via diffusion models with iteratively zero-shot guidance." 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2025. (2) Xie, Pengwei, et al. "Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening." arXiv preprint arXiv:2608.11748 (2026).
-
This framework primarily concatenates standard techniques by applying a classical Sobel filter for edge guidance and conventional low-rank factorization for spectral decoding, making the technical novelty of the guidance pipeline somewhat incremental compared to prior zero-shot diffusion frameworks.
-
Calculating backpropagation gradients at every diffusion sampling step in Stage 2 and fine-tuning parameters in Stage 3 inherently incur heavy runtime and memory overhead. Notably, the paper lacks a systematic discussion or empirical evaluation regarding computational efficiency.
-
Under realistic striping or severe Gaussian noise, the parameterized PSF and SRF estimation easily gets trapped in local minima or overfits noise.
-
Using a static PCA-derived matrix fails to model non-linear spectral mixing in complex scenes, while a fixed subspace rank lacks adaptability across varying scene complexities.
Questions for authors
-
Can the authors provide quantitative results comparing HPDiff against recent baselines, along with exact runtimes in seconds or minutes and GPU memory usage for standard-resolution images?
-
How do the estimated PSF and SRF parameters deviate in terms of root mean square error against ground truth under varying signal-to-noise ratio levels? Are there specific regularization mechanisms to prevent noise overfitting?
-
Is the representative band extraction matrix updated dynamically during diffusion sampling? Furthermore, how sensitive are SAM and PSNR metrics to variations in the subspace rank across different land-cover complexities?
3 comments
Remaining Concerns on Novelty and Practical Value
Thank you for the response. The DM-ZS and spectral-representation clarifications resolve those points, but my concern about the technical contribution remains. The component ablations demonstrate benefits from their combination; they do not sufficiently establish what methodological advance distinguishes HPDiff from existing diffusion-guided reconstruction frameworks. Furthermore, the noise analysis covers only three Pavia samples with Gaussian noise and leaves the requested stripe-noise robustness untested. These additions improve the evaluation but do not sufficiently resolve my concerns. I maintain my original rating.
Response to Reviewer BPRf
Thank you for the follow-up. We clarify the methodological distinctions and expand the noise evaluation below.
1. Technical contribution.
We clarify the distinction of CSLD through its reconstruction mapping and the resulting diffusion guidance. Let denote the current denoised detail representation. With network parameters fixed during sampling, the separable NSSD used by DM-ZS/DIDM takes the form . Although both networks are learned, the spectral factor depends only on LRHS, giving .
CSLD instead uses shared-token exchange to construct . Both factors can therefore respond to changes in the current generated details, even while their network parameters remain fixed. The differential of the reconstruction is:
Consequently, with , the observation-guidance gradient becomes:
where the superscript star denotes the Jacobian adjoint. The second term is absent from the separable NSSD mapping. It allows observation residuals to influence the generated details through the spectral factor, complementing the spatial-factor feedback path. During refinement sampling, this gradient is propagated to the diffusion state through:
Thus, the distinction concerns how the reconstruction map feeds observation constraints back into diffusion, rather than low-rank factorization itself. The reported spectral-gradient comparison gives PSNR/SAM of 35.179 dB/5.937 degrees with full propagation versus 34.909 dB/6.036 degrees with spectral-factor feedback blocked; the other four aggregate metrics also favor full propagation.
The estimated PSF/SRF operators define the observation constraints used in this process, while OPG modulates the PAN/LRHS conditioning of the denoiser.
2. Noise robustness and regularization.
We expanded the evaluation from three to eight Pavia Center patches, using one noise seed and covering Gaussian and fixed-pattern stripe noise at 30/20/10 dB. Stripes affect 4% of columns per band with widths of 1-2 pixels; both noise types have equal total power at each SNR.
The table reports PSF/SRF RMSE against ground truth after unit-sum normalization. Default regularization combines PSF smoothness and center priors with SRF smoothness and window penalties. No reg removes the four explicit penalties while retaining the parameterization constraints. Regularization reduces operator RMSE in 13/14 comparisons, including all six stripe-noise comparisons. At 20 dB stripe noise, PSF/SRF RMSE decreases from 0.01390/0.02726 to 0.01074/0.01419.
Stage-1 reconstruction improves at 30 and 20 dB, although benefits become mixed at 10 dB. These results address the previously missing stripe-noise evaluation and support regularization for stabilizing estimation. They do not establish immunity to local minima or severe noise.
Response to Reviewer BPRf
We thank the reviewer for the constructive comments. We address all five weaknesses and three questions below.
W1. Recent baselines. We would like to clarify that DM-ZS, already included in the submitted comparisons, is Xiao et al., "Hyperspectral Pansharpening via Diffusion Models With Iteratively Zero-Shot Guidance" (CVPR 2025). The correspondence is now explicit in Section 4.1. We also added the suggested DIDM method to the quantitative, qualitative, real data, and efficiency comparisons.
W2. Technical contribution. Sobel filtering and low rank factorization are established tools. Our contribution couples sample specific blind operator estimation, interacting observation conditions in OPG, and learned spatial-spectral decoding in CSLD. The estimated operators define reconstruction constraints; OPG couples PAN/LRHS information with task cues; CSLD exchanges spatial and spectral information through shared tokens. Table 3 supports their complementarity: combining OPG and CSLD improves PSNR over removing both by 1.826/1.383/0.865 dB on Pavia/Houston/Chikusei.
W3. Computational overhead. Section 4.6 and Table 7 now report full pipeline runtime, peak GPU memory, parameters, and FLOPs. We explicitly discuss the additional optimization cost and the performance-efficiency trade-off; numerical comparisons are given in Q1.
W4. Noise sensitivity. Appendix G adds operator RMSE measurements under Gaussian noise and an explicit regularization ablation (Q2). These quantify the dependence on noise level.
W5. PCA and spectral representation. HPDiff does not use PCA. Section 3.4 obtains the initial spectral lifting matrix by regularized least squares from selected LRHS bands; Section 3.6 learns the final spatial and spectral factors through CSLD. The decoder is nonlinear in its inputs, while its final synthesis remains rank constrained. We acknowledge the fixed rank as a hyperparameter and quantify its sensitivity in Q3.
Q1. Comparisons and computational costs. Tables 1-2 now include DIDM. Under known operators, HPDiff improves PSNR over DIDM by 0.909/0.330/0.863 dB on Pavia/Houston/Chikusei and ranks first in all 18 metric comparisons. Under shared estimated operators, it ranks first in 16/18 comparisons.
For a 256 × 256 Pavia image on an RTX 4090 with an i9-14900KF, Table 7 reports runtime/peak GPU memory of 313.934 s/7615.6 MB for HPDiff, 182.490 s/7201.9 MB for DIDM, 109.637 s/7601.2 MB for DM-ZS, and 39.076 s/6851.7 MB for PLRDiff. HPDiff's measurements include degradation estimation, OPG adaptation, all sampling, and CSLD optimization. Its runtime is 1.72 times DIDM's, with 5.7% higher peak memory. The additional cost supports degradation adaptation and reconstruction quality.
Q2. Operator errors and noise regularization. Table 11 reports results on three Pavia samples with two noise seeds, using unit-sum-normalized operators. For clean/30/20/10 dB conditions, the reported Default PSF RMSE means are 0.00016/0.00099/0.00200/0.00384, and SRF RMSE means are 0.00194/0.00291/0.00398/0.00479; standard deviations are also provided.
The estimator enforces non-negativity and normalization, with PSF smoothness and center priors and SRF second-order smoothness and window penalties. The No reg control removes the four explicit penalties while retaining the parameterization constraints. According to Table 11, regularization lowers operator RMSE in 7/8 comparisons. The effects at 10 dB are mixed: PSF RMSE and SAM improve, but SRF RMSE and PSNR worsen.
Q3. Matrix updates and rank sensitivity. Representative bands are selected at fixed intervals for each sample. Their indices and the initial lifting matrix E=YS⊤(SS⊤+ϵI)−1 remain fixed within a sampling pass; no PCA is involved. CSLD parameters are subsequently optimized on the observed pair, and its learned factors are used for final reconstruction and refinement sampling. This differs from keeping the final spectral representation fixed throughout reconstruction.
The three diffusion channels are distinct from CSLD rank ρ. Appendix C, Table 9 evaluates ρ=20/40/60/80/100. The best tested ranks are 80/40/100 on Pavia/Houston/Chikusei for both PSNR and SAM. PSNR varies by 1.264/0.199/0.837 dB and SAM by 0.213/0.132/0.083° across the tested ranks. These results show scene-dependent sensitivity; we do not claim automatic rank selection or unrestricted modeling of physical nonlinear mixtures.