- Rating
- 2
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the reliability of inner Krylov refinement in covariance-aware diffusion inverse problems. The authors observe that deeper conjugate-gradient refinement often improves reconstruction quality, while a smaller measurement-space residual does not necessarily yield a more reliable image-space correction when the Jacobian-derived covariance action is imperfect. They propose KRC, a lightweight two-head MLP that predicts the immediate value of the current CG proposal and the value potentially recoverable through deeper iterations using 23 causal scalar diagnostics. A trusted-correction mechanism shadows risky proposals while allowing the internal CG recursion to continue. The controller is trained on random-mask single-pixel imaging and evaluated on random-mask and Hadamard SPI, Gaussian deblurring, and super-resolution.
Critical strengths
-
The paper identifies an important practical mismatch between numerical convergence of the inner linear solve and reliability of the transported image-space correction. The population-level trajectory study provides substantial empirical evidence that deeper CG can be beneficial while occasionally producing severe reconstruction failures.
-
The matched control experiments are carefully constructed. Fixed-depth CG, residual-based stopping, and the hand-designed controls use the same prior, sensing operator, covariance action, damping, and DDIM schedule. Reporting fifth-percentile degradation, worst-case degradation, and collapse counts in addition to average PSNR, SSIM, and LPIPS makes the reliability analysis substantially more informative.
-
The controller is lightweight at inference and uses only causal scalar diagnostics. It requires neither raw images nor learned image-feature tensors, future CG states, or ground-truth quality during deployment. Its transfer from random-mask SPI to Hadamard SPI, super-resolution, and deblurring without operator-specific retraining or recalibration is encouraging.
Critical weaknesses
-
The posterior interpretation of the controller is not fully supported by its supervision and evaluation. KRC learns ground-truth PSNR changes and selects trusted corrections using a reconstruction-quality proxy rather than a criterion derived from posterior accuracy. A proposal may therefore be preferred because it improves PSNR even if it deviates further from the nominal Gaussian-conditioned update. This is reasonable for reconstruction-oriented control, but the terms "posterior reliability" and "posterior acceptance" suggest a stronger probabilistic interpretation than the results establish. The paper should clarify this distinction or provide additional evidence connecting the selected corrections to posterior accuracy.
-
The future-value target is local to one inner CG trajectory, whereas the ultimate objective is the final reverse-diffusion reconstruction. The target measures the best value available among deeper CG proposals at the current timestep, but accepting a different proposal changes all subsequent DDIM states. The appendix acknowledges that this local oracle headroom is not a final-reconstruction oracle, yet the resulting mismatch is not quantified. A held-out rollout analysis would help determine whether locally preferred proposals and continuation decisions actually improve final reconstruction quality.
-
The contributions of the controller's individual components are not adequately isolated. The paper compares KRC against fixed-depth, residual-based, and hand-crafted controls, but does not report immediate-head-only, future-head-only, no-shadowing, or no-re-trust variants. This is particularly important because the future-value head is reported to be pessimistic on the rare harmful-but-recoverable cases, which directly motivate continued Krylov exploration. Moreover, the final controller combines the learned predictions with several calibrated and fixed policy choices, including unconditional early trust, multiple thresholds, minimum stopping depth, patience, and cumulative re-trust criteria. Without component ablations or a simpler predictor using the same 23 features, it is difficult to determine which elements are responsible for the reported improvements.
-
The PSNR-based definition of reliability and the catastrophic threshold require further justification. Both prediction targets are based on ground-truth PSNR, although the paper also evaluates SSIM and LPIPS and discusses visible reconstruction artifacts. It is unclear whether the same proposals would be considered reliable under these alternative metrics. Furthermore, the -3 dB criterion is used to define catastrophic proposals for analysis and loss weighting, and the same numerical threshold is used to report final reconstruction collapses relative to FIXED-CG2. Although a 3 dB PSNR drop approximately corresponds to doubling the MSE, the sensitivity of the conclusions to this threshold is not examined.
-
Robustness to measurement noise remains insufficiently evaluated. Appendix A specifies zero added measurement noise for the random-mask SPI protocol used to collect the controller's training trajectories, while the additive measurement-noise settings for Hadamard SPI, Gaussian deblurring, and super-resolution are not clearly reported. Since KRC relies on measurement-consistency statistics, CG residuals, and correction-growth features, it is unclear whether these reliability signals remain effective under noisy observations. Evaluating both the existing controller trained on noiseless trajectories and a controller trained on noisy trajectories, alongside matched fixed-depth and hand-crafted controls, would help distinguish zero-shot noise robustness from the effectiveness of noise-aware training.
A minor presentation issue is that Figure 1(a) and Figure 1(c) appear to contain broken mathematical glyphs for several diffusion states.
Questions for authors
-
Do the authors intend "posterior acceptance" as a claim about posterior accuracy, or simply as acceptance of an approximate conditioning correction? If the latter, would "reconstruction reliability" or "trusted conditioning update" be more precise?
-
On held-out cases, how often do locally preferred CG proposals or continuation decisions improve the final DDIM reconstruction? Can the authors quantify the disagreement between local PSNR-based targets and final reconstruction outcomes?
-
Can the authors report immediate-only, future-only, no-shadowing, and no-re-trust ablations, together with a simpler predictor using the same 23 features? In particular, what measurable benefit does the future head provide on harmful-but-recoverable proposals?
-
How sensitive are the reported catastrophe statistics and reconstruction results to the -3 dB definition and the calibrated control thresholds? Do PSNR-based trust decisions agree with SSIM- or LPIPS-based outcomes?
-
Appendix A specifies zero added measurement noise for random-mask SPI, while the measurement-noise settings for Hadamard SPI, Gaussian deblurring, and ×4/×8 super-resolution are not explicitly reported. Could the authors clarify the additive measurement-noise model and level for each experiment? More importantly, could they evaluate KRC under several controlled nonzero measurement-noise levels, comparing (i) the existing controller trained on noiseless SPI trajectories and (ii) a controller trained on noisy SPI trajectories? Evaluating both on random-mask SPI and at least one transfer task, alongside matched fixed-depth CG and hand-crafted controls using identical noisy measurements, would help determine whether the learned reliability signals remain effective under measurement noise and whether noise-aware training is necessary.