- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies the discrepancy between measurement consistency and source recovery in diffusion-based scientific imaging. It defines an unresolved subspace comprising exact null-space directions and weakly observed directions whose source-scale signal falls below the noise level, and introduces prior share as the fraction of source energy contained in this subspace. The authors construct a benchmark spanning weak-lensing mass mapping, Galaxy PSF deconvolution, real wide-field fluorescence reconstruction, MRI, and black-hole imaging, and use it to compare nine diffusion-prior solvers with classical reconstruction baselines.
Critical strengths
[1]It provides a useful way to distinguish good data fit from reliable recovery of weakly constrained components.
[2]The scientific benchmark construction and classical baselines are strong empirical contributions.
Critical weaknesses
[1]The paper does not introduce a new reconstruction method, nor does it derive a new benchmark construction principle from the proposed analysis. The two propositions largely formalize standard consequences of linear inverse problems: multiple reconstructions can be measurement-consistent due to unobservable directions, and a small measurement residual does not in general imply small reconstruction error. These conclusions follow directly from the singular-value decomposition and are closely related to classical null-space/ill-posedness arguments. The paper reframes such ambiguity under the notion of “hallucination,” but it is not clear that this framing yields substantially new theory beyond existing null-space or range-space interpretations. The main novelty therefore appears to lie in the diagnostic metric and benchmark design rather than in reconstruction methodology or inverse-problem theory.
[2]The definition of prior share appears basis-dependent in the presence of repeated singular values. Eq. (1) defines the unobservable set through individual singular directions and their source energies . However, when a singular value has multiplicity greater than one, the corresponding singular-vector basis is not unique. As written, the membership of individual directions in , and hence the resulting prior share, can depend on the arbitrary choice of basis within a degenerate singular subspace. In the reported experiments, this ambiguity is largely avoided by using a fixed Fourier basis for operators that are diagonal in that basis, but this suggests that the basis is effectively part of the definition in practice. A basis-invariant formulation would make the concept more generally applicable and theoretically cleaner. [3]The benchmark evidence is only partially representative of real inverse problems, and some comparisons appear insufficiently stable.
Questions for authors
Please refer to weaknesses.
1.The two propositions seem to follow directly from standard SVD-based properties of ill-posed linear inverse problems, namely non-uniqueness in unobservable directions and the fact that measurement residual only constrains error in sufficiently observable directions. What is the precise theoretical contribution beyond existing null-space/range-space analyses of inverse problems and hallucination? Is the intended novelty primarily the prior-share diagnostic rather than the propositions themselves?
2.Do the propositions or prior share lead to any new reconstruction rule, regularization strategy, solver adaptation, or risk guarantee? If not, should the contribution be interpreted primarily as a diagnostic and benchmarking framework?
3.While the paper documents how prior share is computed for each benchmark setting, it does not provide a systematic protocol for constructing benchmark instances with prescribed prior-share levels. Can you discuss whether such a construction protocol is feasible, and whether the current controlled suite can be extended toward it?
4.To what extent do the main conclusions persist on genuinely acquired inverse-problem measurements rather than simulated or synthetically degraded observations? In particular, could the authors clarify which results are driven by real measurements versus controlled synthetic forward models, and whether the observed residual–reconstruction mismatch is equally strong in the real-observation settings?
4 comments
Response to Reviewer wbgo (Part 2/2)
Step-by-step construction protocol. Appendix I.9 defines a three-step procedure to construct benchmark tasks at a target prior share before any reconstruction. First, for a given training set and a family of forward operators with a tunable parameter such as noise level, PSF width, or frequency mask, we compute the training image energy along each singular direction once. Second, because the unobservable energy grows monotonically as noise increases or as frequencies are masked, we use bisection on a continuous parameter or cumulative summation on discrete frequencies until the unobservable energy fraction matches the target share. Third, we fix that parameter value and generate test observations from held-out source images.
Extending the controlled suite. Applying this bisection procedure to the weak-lensing noise level yields noise standard deviations of 0.011, 0.018, 0.029, 0.042, and 0.059 for target shares of 10%, 20%, 30%, 40%, and 50%. In our controlled study, sorting the 510 unmeasured frequencies of operator O1 by training energy and unmasking them step by step creates a discrete benchmark ladder spanning 0.05% to 5.6% when the mean is measured and 67% to 72% when it is not, as detailed in Appendices I.4 and I.9.
W3 and Q4 · Evidence on real measurements and benchmark stability
Real versus simulated observations. Appendix I.6 explicitly documents the source of the observations in each benchmark task, as summarized in the table below.
| Setting | Observation source |
|---|---|
| BioSR | Real wide-field observations acquired by a physical microscope |
| MRI | Acquired multi-coil k-space data with retrospective undersampling |
| Galaxy | Real astronomical survey images with a simulated PSF blur |
| Weak lensing, black-hole imaging, controlled study | Fully simulated forward measurements |
Mismatch on real BioSR observations. On the 50 real wide-field microscope observations in BioSR, we compare each solver's relative measurement residual, PSNR, and error ratio to zero fill in the unobservable set against the SIM reference in the table below, from Tables 20 and 21 and Fig. 6. Every solver fits the wide-field data more tightly than the 16.2% SIM reference residual, yet a smaller residual still does not mean higher quality. DiffStateGrad, denoted DSG in the table, has the smallest residual at 1.75% but the worst PSNR at 21.6 dB and 2.00 times the zero-fill error in the unobservable set, because pushing the residual below the reference floor set by noise and model mismatch only overfits unmeasured frequencies. The corresponding figures can be seen here.
| Metric | DSG | DPS | RED-diff | DMPlug | DPnP | DAPS | ABMS | DMILO | SITCOM | SIM reference |
|---|---|---|---|---|---|---|---|---|---|---|
| Residual (%) | 1.75 | 4.02 | 4.52 | 6.51 | 7.13 | 7.92 | 8.50 | 9.40 | 9.97 | 16.2 |
| PSNR (dB) | 21.60 | 24.92 | 26.56 | 23.87 | 24.83 | 24.50 | 23.47 | 25.93 | 23.63 | |
| Unobservable error / zero fill | 2.00 | 0.71 | 0.40 | 1.04 | 0.67 | 0.76 | 1.00 | 0.44 | 0.98 |
Stability of the benchmark comparisons. Re-selecting hyperparameters on multiple validation images for weak lensing, Galaxy, and BioSR and evaluating 200 unfiltered weak-lensing patches confirm our conclusions, as shown in Appendices I.1 to I.3. Seven of the nine weak-lensing solvers keep the exact same test PSNR, and the physical-error ranking on the 200 unfiltered patches matches the revised Table 3. Only SITCOM shifts noticeably by 1.8 dB on weak lensing and 0.9 dB on BioSR, while the top and bottom ranks and comparisons to classical baselines remain unchanged.
We appreciate your time and valuable feedback. We hope our responses address your concerns, and we would be grateful if you could reconsider your score.
Dear Reviewer wbgo,
Thank you again for your thoughtful review. We’ve posted a reply to your questions about the basis invariance of prior share and the evaluation on real measurements. When you have a chance, we’d be grateful if you could take a look. If you have any further questions, we’d be happy to discuss them. If our reply addresses your concerns, we’d appreciate it if you could reconsider your rating.
Thank you for the detailed responses and additional analyses. I would like to emphasize that, in my view, developing a meaningful metric for evaluating data and establishing a systematic protocol for constructing benchmark data that meet specified metric levels are equally important aspects of benchmark design. Moreover, I noted that Q3 was not explicitly addressed as a separate item in the response. I see that the additional analysis in Appendix I.9 adequately addresses this concern. I will raise my score.
Response to Reviewer wbgo (Part 1/2)
Thank you for your detailed review and constructive questions. Below we address each point in detail.
W1 and Q1 · Scope of the theoretical claims
Extension beyond classical null-space analysis. In Section 2, we clarify that the two statements build on the exact null-space analysis of Bhadra et al. and extend it to a broader unobservable set containing both exact null-space modes and directions drowned in measurement noise. By combining the forward operator with the source energy spectrum, our framework quantifies how much target energy lies beyond measurement verification and provides clear error bounds, reconstruction corrections, and solver selection rules.
W2 · Basis invariance under repeated singular values
Basis-invariant formulation. For translation-invariant image populations, the Fourier basis used in our experiments already diagonalizes both the forward operator and the source second moment. To make this basis invariance explicit in general, we clarified Eq. 1 in Section 2 by specifying that within any repeated-singular-value subspace, the singular directions are aligned with the eigenvectors of the restricted source second moment and the directional energies are their eigenvalues. This specification ensures that both the unobservable set and the prior share are strictly independent of the choice of basis, and Section 2 also provides the corresponding basis-free linear MMSE error fraction. The table below compares the Fourier and empirical eigenbasis shares in percent across all tasks with repeated singular values, from Table 19 in Appendix I.5.
Comparison across tasks. On Galaxy, BioSR, and 32×32 weak-lensing patches, where training samples outnumber the subspace dimension, the empirical eigenbasis and Fourier shares agree closely, differing by at most 0.2% on Galaxy and BioSR. On full-size weak lensing, estimating a 16,383-dimensional degenerate eigenbasis from 10,000 patches causes a finite-sample drift from 7.98% to 4.68%, which we verify by subsampling at fixed patch size in Appendix I.5. Because both bases coincide analytically for a statistically homogeneous field on a periodic domain, we report the Fourier value.
Q2 · Risk guarantees, reconstruction rules, and solver selection
Error bound and risk threshold. Outside the unobservable set, Remark 2 shows that the measurement residual directly bounds the reconstruction error. Inside the unobservable set, where measurements provide no constraint, the prior share equals the expected squared error of a simple zero-fill prediction. This zero-fill error sets a clear risk threshold in Table 6, since any solver whose error in the unobservable set exceeds zero fill is adding more hallucination than signal.
Reconstruction with the training mean. This decomposition also gives a direct check on the unverified part of a reconstruction. Replacing a solver's component in the unobservable set with that of the training-set mean image leaves the measurement residual unchanged. On operator O1, the pseudo-inverse filled with the training mean reaches 29.1 dB, above seven of the nine diffusion solvers, and the same replacement lifts RED-diff from 11.5 dB to 29.0 dB, with about 9 dB of the gain coming from the 509 frequencies beyond the mean level, as shown in Appendix I.4. The replacement lowers PSNR for six of the nine solvers, so whether the training mean improves a solver's unverified components depends on the solver, as Section 5.3 reports.
Measurement design and solver selection. Before data collection, minimizing the prior share guides measurement design. Adding the image mean alone reduces the prior share of O1 from 72% to 5.6%, and targeting a 10% share on weak lensing sets the required survey noise level to 0.011. During reconstruction, comparing each solver against the zero-fill threshold in Table 6 guides regularization and solver choice, showing that RED-diff and DPnP stay below the zero fill in all three settings of Table 6, while DiffStateGrad, the solver with the smallest residual on real BioSR data, exceeds it on every image.