- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This manuscript addresses hyperspectral image reconstruction in Coded Aperture Snapshot Spectral Imaging (CASSI). The authors propose DDUM, a physics-guided deep unrolling framework that decomposes reconstruction into three physically interpretable subproblems: integration inversion, spectral alignment, and mask demodulation. The framework incorporates intermediate-state priors and a learnable generalized physical inverse operator to improve reconstruction accuracy. Experiments on synthetic and real CASSI datasets are conducted to validate the proposed method.
Critical strengths
-
The proposed decoupled framework is motivated by the physical imaging process of CASSI. By decomposing reconstruction into three inverse subproblems and introducing intermediate-state priors, the method provides a physically interpretable formulation for hyperspectral image reconstruction.
-
The paper includes experiments on synthetic and real datasets. The reported improvements when applying the decoupling strategy to existing unrolling networks provide some evidence of its applicability to different architectures.
Critical weaknesses
- The novelty of the proposed architecture relative to MiJUN (AAAI 2025) is insufficiently justified. Both methods employ deep unrolling frameworks with U-shaped Mamba-based regularization networks and multi-scale feature extraction. In particular, the proposed SPAB in Fig. 4 appears structurally similar to the global-local attention mechanism in MiJUN, while the GeoT strategy shares the general objective of multi-directional feature modeling. Although DDUM introduces a distinct physically decoupled formulation, the manuscript does not clearly distinguish its network components from these existing designs or sufficiently establish their independent contributions.
- The experimental evidence is insufficient to fully support the claimed effectiveness of the decoupling strategy. Although MiJUN is included as a strong baseline in the quantitative comparisons, its reconstruction results are absent from the synthetic visual comparisons in Fig. 5, limiting direct qualitative assessment.While Table 5 shows performance improvements after introducing the decoupled formulation, the coupled and decoupled variants also differ in parameter counts and FLOPs. The stronger regularization network partially addresses the effect of model capacity, but the impact of additional computational overhead remains insufficiently examined.
Questions for authors
-
The architectural novelty of DDUM relative to MiJUN (AAAI 2025) remains unclear. The proposed SPAB appears structurally similar to the global-local attention mechanism in MiJUN, while GeoT shares similarities with its multi-directional Mamba modeling.
-
The ablation study in Table 7 only evaluates the removal of SPEB, SPAB, and MGF, without comparing them with similar modules from existing methods. Further comparisons with the corresponding designs in MiJUN are needed to better justify the independent contributions of these components.
-
The coupled and decoupled variants in Table 5 differ in parameter counts and FLOPs. Although the authors include a stronger regularization network as a control, the influence of additional computational costs remains unclear. Further experiments under matched parameter and computational budgets are needed to isolate the contribution of the decoupling strategy.
-
Although Mijun is included as a competitive baseline in the quantitative comparisons, its reconstruction results are absent from the synthetic visual comparisons in Fig 5. The authors should provide the corresponding visual results to facilitate a more comprehensive assessment of reconstruction details and artifacts.
5 comments
Response to Reviewer KtEk (part 2/2)
[Q3] Controlled Comparison. To isolate the benefits of our decoupled framework from increased model capacity or computational cost, we introduce two additional coupled baselines with identical parameters (0.68M) and FLOPs (72.17G):
1) Coupled + Three Priors: Retains three regularization networks but applies all of them to the final HSI.
2) Coupled + Enhanced Prior: Integrates the three networks into a single enhanced image-domain prior.
| Configuration | Params (M) | FLOPs (G) | PSNR (dB) |
|---|---|---|---|
| Coupled + Three Priors | 0.68 | 72.17 | 40.80 |
| Coupled + Enhanced Prior | 0.68 | 72.17 | 40.83 |
| DDUM (Ours) | 0.68 | 72.17 | 41.43 |
Under identical parameter and computational budgets, DDUM outperforms these coupled alternatives by 0.63 dB and 0.60 dB, respectively. These results demonstrate that the gains arise from decoupling-enabled physical-state regularization rather than increased model capacity or computational cost.
[Q4] Visual Comparison with MiJUN. MiJUN's original paper reports MiJUN-9stg (40.86 dB) as its best-performing configuration, which we therefore adopt for quantitative comparison. However, its published visualizations use MiJUN-5stg.
To provide a consistent comparison, following LRDUN (CVPR 2026), we have reproduced MiJUN-9stg using its publicly available code and added the visual results to Fig. 5 and Figs. 12–13 in the Appendix, while matching its reported quantitative performance. Some blurring and artifacts are observed, consistent with similar visual observations in LRDUN (Fig. 4). These additions enable direct qualitative comparisons under the same model configuration.
Reference: Huang, H., Guo, Y., & He, W. (2026). LRDUN: A Low-Rank Deep Unfolding Network for Efficient Spectral Compressive Imaging. CVPR 2026.
Gentle Reminder: Author Response Ready for Review
We sincerely appreciate your valuable time and constructive feedback! We hope our previous response and revisions have adequately addressed your concerns. As the discussion period is about to close very soon, we kindly invite you to review our response at your earliest convenience. We warmly welcome any remaining questions and would be delighted to provide further clarification before the deadline!
Response to Reviewer KtEk (part 1/2)
We sincerely thank the reviewer for the careful and constructive comments to improve the quality of our paper.
[Q1&Q2] Architectural Distinctions. DDUM's primary contribution lies in its physically decoupled reconstruction paradigm, rather than merely improving the Mamba architecture. As summarized in the Introduction, our contributions include: (1) Reconstruction Framework: decomposing the coupled CASSI problem into three physical inverse subproblems with dedicated intermediate-state priors; (2) Solution Mechanism: introducing a learnable generalized physical inverse to address the ambiguity of many-to-one spectral integration; and (3) Effectiveness and Generalizability: improving reconstruction performance across existing unrolling architectures. Notably, Table 5 shows that applying our decoupling framework to MiJUN's regularization backbone improves PSNR from 40.86 dB to 41.11 dB, demonstrating the effectiveness of our formulation without relying on DDUM's proposed regularizer.
Beyond the reconstruction formulation, DDUM also introduces distinct network designs:
1. SPAB vs. MiJUN's GLAM.
Structure: DDUM adopts an asymmetric U-Net, placing SPEB in the encoder and SPAB in the bottleneck and decoder, whereas MiJUN repeatedly employs GLAM-based MMIT blocks in both its encoder and decoder.
Role: Unlike MiJUN's repeated joint spatial–spectral modeling throughout its U-Net, DDUM explicitly separates spectral and spatial modeling: SPEB first exploits inter-band correlations for spectral recovery, while SPAB leverages global–local spatial dependencies to restore mask-degraded structures and fine details.
Results: Replacing SPAB with MiJUN's GLAM-based block reduces PSNR by 0.21 dB, as shown in the table below, demonstrating the effectiveness of our specialized spatial refinement design.
2. GeoT vs. MiJUN's Multi-Directional Mamba.
Structure: Unlike MiJUN's 12-direction mode-k scanning within each Mamba block, GeoT cyclically applies four geometric transformations across successive blocks, requiring only one SSM scan per block.
Advantage: By cyclically reorienting features across successive SSM blocks, GeoT captures complementary spatial–spectral dependencies without MiJUN's repeated multi-directional scans, achieving 0.10 dB higher PSNR in direct module comparisons comparison below.
3. Controlled Comparisons with MiJUN Modules. To further isolate the contributions of our network components, we replace individual DDUM modules with their MiJUN counterparts while keeping the decoupled reconstruction framework and other components unchanged.
All four substitutions reduce reconstruction performance, directly demonstrating the effectiveness of DDUM's network components relative to their MiJUN counterparts, beyond the removal-based ablations in Table 7.