- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes S$^3$-PnP, a self-supervised plug-and-play framework for scientific image restoration. Instead of relying on externally pretrained diffusion priors, the method first runs an analytical ADMM solver on the current observation and collects its intermediate denoiser inputs as instance-specific training data. A score model is then learned at test time through self-supervised denoising score matching to characterize the empirical distribution of these ADMM states. During inference, the learned score is used to correct the ADMM intermediate state before applying the original analytical prior operator, thereby combining observation-adaptive learned corrections with explicit model-based regularization. The experimental results show that the proposed method achieves competitive or superior quantitative and qualitative restoration performance compared with various analytical, self-supervised, and diffusion-based methods.
Critical strengths
- The proposed method does not rely on an external training dataset or pretrained weights, but instead learns task-specific score corrections from ADMM states generated by the current observation. This design reduces dependence on domain-specific training data and helps alleviate generalization issues caused by distribution shifts between training and test data.
- The paper evaluates the proposed method on multiple scientific imaging tasks, including reference-guided hyperspectral image restoration, single-image hyperspectral denoising, and MRI denoising. The diversity of tasks and noise settings provides relatively comprehensive empirical validation of the proposed framework.
Critical weaknesses
The methodological novelty is limited, and the core assumption behind the learned score is not fully convincing. The proposed framework mainly combines an analytical ADMM prior with a test-time learned score correction, while the score itself is obtained through standard self-supervised denoising score matching. More importantly, some ADMM intermediate states may deviate from the ideal solution, contain systematic errors, or lie in undesirable regions of the state space, yet they are still used as training targets. Consequently, the learned network estimates the score of the empirical ADMM-state distribution rather than that of an ideal ADMM-state distribution. This raises concerns about whether the learned correction truly provides a reliable direction for improving reconstruction quality.
Questions for authors
- Since some ADMM intermediate states may themselves deviate from the ideal solution, contain systematic errors, or lie in undesirable regions of the state space, these states are nevertheless still used as training targets. Consequently, the learned network estimates the score of the empirical ADMM-state distribution, rather than the score of an ideal-ADMM-state distribution.
- A score learned from a single-instance ADMM trajectory may have substantially weaker statistical modeling capability than a large pretrained diffusion prior. It is unclear whether the observed performance gains genuinely come from the proposed task-adaptive score modeling, or are largely attributable to the Deep Image Prior (DIP) effect induced by test-time network fitting.
- Since pretrained diffusion-PnP mismatch is a central motivation, the absence of DiffPIR (Zhu et al., Denoising Diffusion Models for Plug-and-Play Image Restoration) or a controlled pretrained diffusion-PnP baseline significantly weakens the experimental support for the main claim.