- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper hypothesizes that the saturating performance of unrolled networks on the fastMRI benchmark is partly due to training converging to suboptimal solutions. The authors propose aligning the bottleneck representations of each cascade with features from a frozen vision foundation model during training. The method improves reconstruction performance, particularly for transformer-based unrolled networks, without increasing inference costs.
Critical strengths
- The proposed method improves the performance of transformer-based unrolled networks.
- The approach is relatively simple.
- The authors evaluate multiple foundation models and reconstruction architectures.
Critical weaknesses
-
E2E-VarNet already performs very well for 2D accelerated MRI reconstruction in the in-distribution setting. The gains from foundation model alignment are marginal for E2E-VarNet at 4× and 8× acceleration. Based on the reported numbers E2E-VarNet also performs better than HUMUS-Net. Hence, I see limited practical benefit.
-
Based on my experience with fastMRI and similar VarNet architectures and optimizer settings, I am concerned that the models are not trained to convergence. The fastMRI knee dataset contains approximately 35k training slices, so 300k iterations with batch size one correspond to fewer than 10 epochs. I would suggest training for at least 20–30 epochs and using a validation set for model selection.
-
The reported PSNR and SSIM values appear unusually low. For E2E-VarNet on multi-coil brain data at 8× acceleration, I would expect approximately 38 dB PSNR, consistent with results reported on the fastMRI leaderboard. This raises concerns about the training and evaluation setup.
-
The gap between HUMUS-Net and E2E-VarNet is unexpectedly large. On multi-coil brain data, the unregularized HUMUS-Net performs approximately 3.6 dB worse than E2E-VarNet, whereas results on the fastMRI benchmark suggest that the two architectures should perform similarly well. This makes it difficult to assess how much of the improvement comes from the proposed method rather than suboptimal baseline training.
-
The paper focuses a lot on the rank-collapse observation but also show that high rank does not provide better performance.
Questions for authors
-
How does the proposed method scale with dataset size? Does it consistently improve reconstruction performance across different data regimes, or is it primarily a regularization technique that benefits low-data settings?
-
What makes a vision foundation model a suitable teacher for improving MRI reconstruction accuracy? Which properties of its learned representations are expected to be beneficial?
-
The proposed method aligns each cascade's bottleneck with teacher representations extracted from the fully sampled reference. How does this compare with directly supervising each cascade output using the fully sampled image?
-
Dataset size and convergence: How many training slices are used in the experiments? Have the authors verified that the baseline models are sufficiently trained and that their performance has converged?
-
Can the authors review or clarify the evaluation setup, particularly for multi-coil brain reconstruction? The reported PSNR and SSIM values are lower than I would expect from the fastMRI benchmark.
-
In Table 1, HUMUS-Net-L experiences a drop from approximately 29.0 to 25.2 dB PSNR between 180k and 300k iterations. Can the authors explain this behavior? Is this instability common across different training runs?
-
Why does HUMUS-Net perform substantially worse than E2E-VarNet in the multi-coil brain experiments? Can the authors elaborate on this gap, given that fastMRI benchmark results suggest similar reconstruction performance?
-
What motivates reporting results at intermediate, potentially undertrained checkpoints? The computational costs of training these reconstruction models are not prohibitive, so I do not see a clear reason to emphasize intermediate iterations rather than converged performance.
-
Why do the authors consider the single-coil fastMRI knee setting? Since the fastMRI single-coil data are simulated and have limited practical relevance, I would consider focusing on multi-coil reconstruction a more meaningful setting for evaluating the proposed method.
-
The MRI inverse problem should be introduced more clearly. Equation (1) presents one possible variational formulation rather than the general MRI reconstruction problem. Moreover, effective rank should be defined when it is first introduced, rather than later in the experimental section.
3 comments
Q6-Q10
Q6. HUMUS-Net-L instability.
We now report two seeds in all three main tables. The revised results confirm that the stability of the HUMUS-Net family depends strongly on initialization.
We believe that the smaller batch size likely contributes further to the observed instability. We train with batch size 1, whereas the original HUMUS-Net recipe uses effective batch sizes of 8 and 4 for HUMUS-Net and HUMUS-Net-L, respectively. We therefore expect that using a larger batch would improve stability, but we could not perform a controlled batch size ablation in this revision and cannot establish it as the sole cause.
An additional contributing factor may be the different input fed to the original HUMUS-Net compared to our implementation. The original HUMUS-Net operates on center-cropped images and uses adjacent slice information, whereas we use the full field of view without adjacent slice information to ensure a fair comparison with E2E-VarNet.
Q7. HUMUS-Net performance gap.
The large 7.35 dB gap (volume-wise) was caused by an unstable HUMUS-Net run. We now report a second seed, for which the unregularized HUMUS-Net is approximately 0.71 dB below the unregularized E2E-VarNet. Thus, the previously reported gap is not representative of typical HUMUS-Net performance, but reflects its sensitivity to initialization under our training setup.
Table 1. Multi-coil brain at , volume-wise PSNR (dB) after 1.02M iterations, 150 test volumes, two seeds per student (first / second).
| Student | No teacher | SD | DINOv3 | DiT |
|---|---|---|---|---|
| E2E-VarNet | 36.52 / 36.64 | 36.78 / 36.76 | 36.79 / 36.84 | 36.79 / 36.89 |
| HUMUS-Net | 29.17 / 35.93 | 36.74 / 36.86 | 37.18 / 37.19 | 37.00 / 37.06 |
Q8. Intermediate checkpoints reporting.
We agree that the costs of training these architectures are smaller relative to other models, especially for E2E-VarNet. The reason we report intermediate checkpoints is to disentangle whether our alignment mechanism is purely speeding up convergence and/or whether it gives lasting gains.
Q9. Reporting single-coil knee
Our main motivation was to show whether this approach works in both the single-coil and multi-coil setting. We understand the reviewer's concerns with this dataset, however at this time we cannot provide multi-coil knee numbers.
Q10. Introducing the MRI problem and defining effective rank early.
Thanks for the suggestion. We fixed this in this draft.
Thank you for the additional experiments and clarifications. Overall, the response improves the submission, but does not sufficiently resolve my concerns about the baseline comparison and the practical and scientific significance of the proposed approach. I therefore maintain my score.
The practical advantage over a strong E2E-VarNet baseline also remains insufficiently compelling to me. In the revised brain results, the best aligned HUMUS-Net improves over the best unaligned E2E-VarNet by 0.55 dB, while alignment improves E2E-VarNet itself by 0.12–0.27 dB. However, the method introduces additional training machinery and tuning, while the strongest results also involve the larger HUMUS-Net backbone. Given the competitive performance of plain E2E-VarNet, the tradeoff between these improvements and the additional training cost and complexity needs a stronger justification.
The concern about the baseline comparison remains only partly resolved. The updated results demonstrate an improvement even for the better-performing HUMUS-Net seed. Nevertheless, the large variation between the two unregularized runs raises questions about the stability of the chosen training setup. The response identifies batch size and differences from the original training recipe as possible contributors, but does not test whether addressing these issues reduces the advantage of alignment. It therefore remains unclear how much improvement would persist under a more consistently stable training setup.
The contribution of the foundation-model teacher also remains insufficiently understood. The proposed importance of spatially structured teacher features remains a hypothesis. The dependence on training-set size also remains unexplored, limiting our understanding of when this regularization is most useful.
Q1-Q5
We thank the reviewer for their careful reading of the paper and for raising important questions.
Q1. Scaling with dataset size.
We have not performed a dataset size sweep and therefore cannot determine whether alignment provides larger relative gains in low-data regimes. We view the method as a representation regularizer rather than specifically a low-data technique. Evaluating whether this regularization becomes more beneficial as the training set decreases is an interesting direction, which we now leave for future work.
Q2. What makes a foundation model a suitable teacher?
Our initial framing did not clearly distinguish the roles of rank regularization, deep supervision, and teacher alignment. We now introduce these three regularization techniques to address the underutilized bottleneck in different ways.
We hypothesize that this spatial structure is the key property that produces the sustained gains, while the increase in effective rank is a byproduct. The broadly similar improvements across four teachers with different architectures, objectives, and training domains further suggest that the benefit does not depend on a specific teacher. We have revised the paper to clarify this interpretation.
Q3. Supervising each cascade output with the fully sampled image.
We thank the reviewer for this suggestion and extend the deep supervision baseline for all architectures in the single-coil knee experiments. Specifically, we add
LDS=∑k=18wkℓk, with wk∝exp(−τ(8−k)),
where ℓk is the SSIM loss between the k-th cascade output and the fully sampled target. The weights are normalized to sum to one, and τ increases from zero by 1/3 every 6000 iterations, gradually putting more weight on the later cascades.
Deep supervision does not consistently improve reconstruction across architectures and seeds. Moreover, the transformer bottlenecks remain low rank despite the additional supervision at every cascade output. Thus, supervising intermediate reconstructions does not reproduce the gains of foundation model alignment, suggesting that the benefit may depend on providing a dense, spatially structured feature target directly at the bottleneck.
Q4. Dataset size and convergence.
We use the whole fastMRI training split for both knee and brain (973 knee volumes and 4469 brain volumes, yielding 34742 knee slices and 70748 brain slices, respectively). We agree that our previously reported numbers were not converged. We extended the current setup to 1.02 million iterations and hope this addresses the concern.
Q5. Evaluation setup.
We thank the reviewer for identifying this discrepancy. The submitted version reported slice-wise metrics, whereas the fastMRI benchmark reports volume-wise metrics. We now use volume-wise evaluation in the main tables and move the slice-wise results to the appendix. The unaligned E2E-VarNet now achieves up to 36.64 dB PSNR.
The remaining difference from the approximately 38 dB leaderboard result may reflect differences in the experimental setup. We use randomized fastMRI undersampling masks, an 8-cascade E2E-VarNet, and only the official training split. In contrast, the referenced leaderboard model uses uniform undersampling, 12 cascades, and the combined training and validation data.