- Rating
- 4(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CSF-Recon, a framework that preserves diagnostic information for medical image reconstruction. The core idea is that they want to put more detailed reconstruction on lesion regions than elsewhere.
The method first trains a teacher on fully sampled images using an counterfactual alignment method, then use the grad-cam created by teacher to guide the student training for reconstruction.
Critical strengths
- This paper is well motivated and easy to follow.
- It addresses a meaningful problem: good overall reconstruction quality does not necessary mean preservation of diagnostically important details. Using the spatial guidance for reconstruction and diagnosis gives the framework a clear and coherent design,
- The results on MRI and CT datasets are promising.
Critical weaknesses
- I think the main weakness is the denefit of counterfactual alignment over simpler spatial guidance is not clearly shown. In Table 3, a direct lesion mask supervision already achieves a AUC of 0.813+-0.019, compared with 0.821+-0.018 for aligned Grad-CAM, it seems to be within confidence interval for clinically meaningful difference?
- Considering the close gap between the direct GT, i suggest adding one direct baseline using lesion supervision (i mean the mask) to train the teacher and to use the probability map to guide the student training (replace the alignment Grad-CAM) to see the performance comparison.
- Also, the restoration and refinement stages lack clear measurement consistency. Improved classification performance can not establish that the restored details faithfully reflect the anatomy.
Questions for authors
- How much does the counterfactual alignment add beyond a direct lesion map supervision?
- could you include an anatomy-guided or task oriented reconstruction baseline with comparable supervision and refinement capacity to better isolate the proposed contribution?
- How do you evaluate the restored details are consistent with the acquired measurement?
5 comments
W3 & Q3: Are the restored details consistent with acquired measurements?
A3: We agree that higher classification accuracy alone does not establish anatomical fidelity. We therefore added direct measurement-domain evaluation and an optional final soft data-consistency correction in Appendix C.13, with corresponding clarification in Section 2.4 and the Discussion.
We measure the relative residual at the acquired measurements. CT uses the projector matched to sinogram generation. MR uses the measured multicoil samples and sensitivity maps, with coarse-reconstruction phase used to initialize the complex image.
Table R4. Relative acquired-measurement residuals (manuscript Table 16).
| Output | MR residual | CT residual |
|---|---|---|
| Coarse reconstruction | ||
| Final CSF-Recon | ||
| Final + soft DC |
Table R4 shows that the original final output is less measurement-consistent than the coarse reconstruction. The added correction is inference-only, with no retraining and no reference images, annotations or diagnostic labels as inputs. It minimizes a normalized image-proximity plus measurement-residual objective using conjugate gradient and the validation-selected weight . For MR, both magnitude and phase can change during the solve. The reported residual is recomputed after output clipping.
This reduces measurement residual by 45.4% for MR and 32.2% for CT, below the respective coarse levels. We re-encode the corrected image with all network weights, the diagnostic head and the original support field fixed:
Table R5. Diagnostic performance before and after final soft DC (manuscript Table 17).
| Method | MR accuracy | MR AUC | CT accuracy | CT AUC |
|---|---|---|---|---|
| CSF-Recon | ||||
| CSF-Recon + DC |
Table R5 shows similar mean diagnostic performance after correction, with the original uncorrected model retained for the main results. These experiments demonstrate compatibility with improved acquired-data agreement; under undersampling, neither measurement agreement nor diagnostic accuracy alone guarantees the anatomical correctness of every restored detail. The revised Discussion makes this distinction explicit.
Dear Reviewer,
Thank you again for your thoughtful comments and valuable suggestions. We have revised the paper and added clarifications and experiments in response to your feedback. When you have a chance, we would greatly appreciate hearing whether our response addresses your concerns. Please let us know if you have any remaining questions or would like further clarification. We would be happy to address them during the discussion.
Thank you for your time and consideration.
Best regards,
The Authors
Thank you for your careful review and valuable suggestions, which have helped us improve the paper! We have revised the manuscript in response to your feedback. Below, we address each weakness (W) and question (Q) and describe the revisions. Please let us know whether these revisions address your concerns.
Specifically, we implemented the directly lesion-supervised teacher you suggested and added paired support-supervision comparisons, direct measurement-domain evaluation, and a final data-consistency correction experiment. Changes to the main text are highlighted in purple in the revised manuscript. Tables labelled R are numbered within this response; other section and table numbers refer to the revised manuscript.
W1 & Q1: Added value of alignment over direct GT-mask supervision
A1: We added support-supervision comparisons in Appendix C.11, summarized in Section 3.3.
We repeated the GT-versus-aligned comparison in three supplementary runs per modality using one newly generated random data split per modality, held fixed across three independent training seeds. Within each paired comparison, both methods use the same split and seed, with the downstream pipeline held fixed.
Table R1. GT-mask versus aligned Grad-CAM supervision, mean ± standard deviation over three training seeds (Appendix C.11, manuscript Table 12).
The paired analysis in Table R2 (manuscript Table 13) uses 5,000 cluster-bootstrap resamples over MR volumes or CT patients while retaining slice/patch-level metrics.
Table R2. Paired cluster-bootstrap comparison of aligned and GT-mask supervision (Appendix C.11, manuscript Table 13).
The paired analysis supports a CT accuracy gain of 0.0338 (95% CI [0.0096, 0.0596], p=0.0098), while MR and CT AUC comparisons are near the conventional significance boundary (p≈0.050 and 0.0514). Percentile confidence intervals and centred-bootstrap tests are not exact inverses, so their conclusions may differ near the significance threshold. This addresses uncertainty using paired predictions rather than treating seed-level standard deviations as confidence intervals.
The distinction is between learning lesion membership and learning class-dependent spatial priorities within the lesion. Direct mask supervision learns annotated extent. Counterfactual alignment encourages prediction-changing evidence to lie within that extent, producing a class-conditioned attribution target for reconstruction.
The complementary directly lesion-supervised teacher control is detailed below in W2 & Q2.
W2 & Q2: An anatomy-guided baseline with comparable supervision and refinement capacity
A2: Following your suggestion, we trained a teacher with a lesion-probability head supervised by BCE and Dice losses, alongside a cross-entropy-trained diagnostic classifier, without counterfactual optimization or alignment. Its predicted probability maps replace aligned Grad-CAM as student support targets. Crucially, this control retains the same student reconstruction architecture, six-step refiner and Local+Global diagnostic architecture, data partitions and evaluation protocol. At inference, the student predicts its own support field; neither teacher nor lesion annotations are provided.
Table R3. Directly lesion-supervised versus aligned teacher guidance with matched downstream architectures (manuscript Table 14).
With similar local fidelity, aligned guidance improves mean accuracy by 7.1 percentage points for MR and 3.2 for CT, and AUC by 0.020 and 0.018, respectively. The differences cannot be attributed to giving CSF-Recon an additional refiner or a different downstream head architecture.
For complementary baselines, Appendix C.12, Table 15 adds annotation-matched ROI-weighted U-Net and MoDL, and Table 1 includes task-oriented joint U-Net. CSF-Recon retains higher mean accuracy and AUC than the annotation-weighted controls. These broader comparisons differ in architecture; the directly supervised teacher above specifically answers your request for comparable supervision and matched refinement capacity.