- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes OmniHSR, a framework for cross-sensor arbitrary-scale hyperspectral image super-resolution. Instead of directly predicting spectral values, the method learns band-shared spatial operators to reconstruct high-resolution images with different numbers of spectral bands. The framework includes two modules: Cross-Spectral Mapping (CSM), which converts the input into a fixed number of spectral bands and predicts spatial operators, and Continuous Operator-Field Reconstruction (COFR), which applies these operators to the original spectral bands at arbitrary scales. The main contribution is a unified and lightweight model that can handle different sensors without additional training or adaptation. Experiments on seven datasets show that the proposed method achieves better reconstruction accuracy and computational efficiency compared with existing methods, including on unseen sensors.
Critical strengths
The paper explore an interesting band-shared operator design. The idea of predicting band-shared spatial operators instead of spectral values is interesting. This design allows the model to handle hyperspectral images with different numbers of spectral bands without changing the network architecture. It provides a useful approach to cross-sensor generalization.
The explored framework has good computational efficiency and generalization ability. The proposed method uses a lightweight network with only 0.538M parameters and can be directly applied to unseen sensors without additional training or adaptation. The experimental results show improvements in reconstruction accuracy and inference speed compared with existing methods. These advantages make the proposed approach useful for practical applications.
Critical weaknesses
- Insufficient justification of the band-shared operator prior and CSM design.
Although the band-shared operator prior simplifies the model and improves computational efficiency, applying the same spatial operator to all spectral bands may limit the reconstruction performance. Hyperspectral images contain rich spectral correlations, which are important for recovering spatial details and preserving spectral information. Although CSM uses spectral information to predict spatial operators, the reconstruction stage applies the same operator to all bands. This may limit the ability to recover band-specific spatial details. In addition, CSM resamples the input into a fixed number of 31 bands, regardless of the original band number. It is unclear whether this strategy is necessary or optimal. For sensors with many spectral bands, using multiple spectral chunks and combining their features may be more effective. Although the authors provide some ablation experiments, comparisons with spectral-aware reconstruction methods and alternative spectral feature extraction strategies are still insufficient. These limitations make the advantages of the proposed design less convincing.
- Limited improvement over simple Bicubic interpolation at large scaling factors.
Although the proposed method outperforms several existing learning-based methods, its improvement over simple Bicubic interpolation becomes very small at large scaling factors. For example, at ×48, the PSNR improvements are only 0.03 dB on Pavia U and 0.01 dB on Chikusei. The SSIM on Pavia U is also the same as Bicubic interpolation (0.483). While the improvements at smaller scaling factors are more noticeable, the results at large factors raise concerns about the actual reconstruction benefit of the proposed method. Therefore, the experimental results do not sufficiently demonstrate the effectiveness of the proposed method at large upsampling factors, especially outside the training range.
Questions for authors
Regarding the band-shared operator prior: Could the authors further explain how the proposed method effectively exploits spectral correlations for high-quality HSI reconstruction? Since the same spatial operator is applied to all spectral bands, would incorporating spectral-adaptive operators improve the reconstruction performance? A comparison with lightweight spectral-aware methods would help justify this design choice.
Regarding the CSM design: Why is it necessary to resample all spectral bands into a fixed number of 31 bands? For sensors with many spectral bands, would processing multiple spectral chunks and combining their features provide better spatial information for operator prediction? Although different values of M are evaluated in the supplementary material, could the authors clarify the advantages of the proposed CSM compared with alternative spectral feature extraction strategies?
Regarding the improvement over Bicubic interpolation: Why does the performance improvement over Bicubic interpolation become almost negligible at large scaling factors, such as ×36 and ×48? Could the authors provide further analysis or visual comparisons to demonstrate what additional spatial details are recovered by the proposed method at these factors?