- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This work proposes SIREM, rtMRI reconstruction methods that combine image prediction branch as prior with rt speech MRI reconstruction. Overall, it seems to be premature in its current form.
Critical strengths
-
The idea that incorporate speech acoustics as prior is interesting and promising direction to rt MRI reconstruction.
-
The experiment results improves over the conventional compressed sensing methods
Critical weaknesses
-
It seems that the proposed method does not utilize temporal correlation between MRI frames, which is common and essential in existing rtMRI reconstruction frameworks (although audio encoder may implicitly employ temporal information, the explicit correlation between MRI frames are generally exploited and much more powerful). There should be an explanation to such design choices. Also, the proposed method is trained and reconstructs in lower temporal resolution (78ms/frame) compared to the original resolution the dataset provides (12ms/frame) to exploit full 13 arm rotations. It is necessary to describe that higher resolution reconstruction would be available with the proposed methods.
-
The comparison is only with the conventional compressed sensing method and E2E-VN (2020). SIREM only show the processing time advantages over the compressed sensing methods, not over E2E-VN (16.68 vs. 15.65ms). It is necessary to compare with recent dynamic MRI methods (E2E-VN is a general MRI reconstruction method not specialized for dynamic or rTMRI)
-
The weighting map (W_EbA) is constructed only from anatomical segmentation. Also, it is generated only from the initial frame and then fixed over the entire frames, which does not consider the changes between frames (e.g. object movement) It is also unclear that w_EbA is binary or continuous values. There is no justification of such design choices, and they do not seem optimal. For example, certain articular regions are more informative.
-
“Learnable sampling” seems to be misleading. It seems to apply continuous weight to 13 acquired spiral arms, which means it cannot actually reduce the number of acquisition (i.e. there is not acceleration in data acquisition time). Also, the two regularization terms operates with the opposite goals, the PSF loss term induces equal weights, L_budget applies differentiated weights.
Questions for authors
-
How does SIREM compare with the existing SOTA dynamic MRI methods? (reconstruction quality, computation time, etc)?
-
Can SIREM achieve higher temporal resolution that the dataset provides?
-
Please provide the justification to the choise of the weighting map (W_EbA)? (the choice of anatomical segmentation, choice of initial frame, etc)
-
Please provide further justification and advantages of the proposed “Learnable weights” and the two regularization terms. Also, what is the relationship with the PSF loss and actual point-spread function?
-
What is the benefit of constraining arm weights to K=2, when all the 13 arms are actually necessary? (no acceleration available)
2 comments
I thank the authors for the responses and clarifications. However, the most crucial concerns still remain.
-
Current response does not include new experimental evidence for insufficient experiment results and ablation studies. Particularly, E2E-VN is the only deep learning based baseline which is presented in 2020 and targeted for static MRI (not specialized for dynamic MRI). As the proposed method addresses speech rtMRI, it is necessary to include comparisons with more recent SOTA methods, especially with dynamic MRI methods incorporating temporal correlation.
-
The justification regarding spatial fusion still remain. Particularly, the relative weighting between audio-based branch and MRI reconstruction branch is determined by a fixed anatomical mask through the segmentation map, which requires further justification. Also, final result may not guarantee the data consistency, which is not yet discussed in the manuscript.
-
The advantage of “learned sampling” is still unclear, as it does not provide practical scan time reduction. Also, the theoretical justification of PSF regularization term and L_budget is not clear yet, and related ablation study is not provided as well (e.g. proposed vs. equal weighting)
-
Authors acknowledged that the method does not improve acquisition temporal resolution, nor incorporate temporal correlation explicitly. This remains my overall concerns regarding the practical advantages of the proposed methods.
We thank the reviewer for the detailed assessment and for highlighting the concerns.
Comparison with recent dynamic MRI methods: Our experiments include E2E-VN as a learned reconstruction baseline. SIREM achieves competitive reconstruction results, is 7.3% slower than E2E-VN, and is substantially faster than the two iterative baselines. We are also evaluating an additional learned reconstruction method under the same experimental setting and will report the results once the experiment is complete.
Frame rate and temporal modeling: The current experiments use 13-arm inputs at 12.81 fps, and the MRI branch processes each frame independently. Therefore, the present results demonstrate speech-informed reconstruction at this acquisition rate rather than increased acquisition temporal resolution. We will distinguish inference speed from acquisition frame rate more clearly and discuss explicit MRI temporal modeling as future work.
Why anatomical masks: They provide a simple and interpretable restriction on where audio may contribute. The fixed map is not a reliability estimate and does not track motion; this is a stated limitation, not a hidden assumption. We will state this limitation more clearly and discuss learned or temporally adaptive weighting as future work.
Learned spiral-arm weights: We agree that “learned spiral-arm reweighting” is more accurate than “learned sampling”. All 13 spiral arms are acquired and retained and the learned weights are applied retrospectively. In the revised manuscript (on preparation), we will use the more precise terminology and remove any implication that the current method learns a prospective sampling trajectory or reduces acquisition time
Sampling-budget interpretation: The K=2 constraint acts as a soft regularizer on the arm weights; it does not impose a physical acquisition budget or reduce acquisition time because all 13 arms are retained. We will revise the terminology and discussion to make this distinction explicit.