- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes CardioStitch, a feed-forward method that builds a 3D cardiac cine from free-breathing, ungated real-time short-axis slices. It fine-tunes VGGT with a slice-location token and a reference-slice token, predicts a dense 2D-to-3D displacement per pixel, and splats the slices into a volume. Training uses a splatting reconstruction loss with a heart-region term plus an observation-consistency loss that samples the GT volume at the predicted positions. All quantitative results come from simulated breathing (rigid translation) and simulated HRV/AF applied to gated breath-hold cine from five public datasets. The method beats static SVR and dense-temporal baselines on most metrics and runs in about 2 s. There is also a qualitative test on real scans from two subjects.
Critical strengths
- The problem is real and well framed. Breath-holds and ECG gating are a true pain point for heart failure and AF patients, and conditioning on a reference slice instead of binning cardiac phases is a clean way around the synchronization problem. Predicting geometry rather than generating pixels also means every voxel comes from an observed pixel, which matters a lot for clinical trust.
- The analysis goes beyond a results table. The loss ablation shows clearly that L_obs handles breathing and L_h handles cardiac motion, and the attention-masking experiment in the appendix (block 3 reads the reference, blocks 12-17 fix breathing) is a nice piece of evidence that the model works the way the authors claim.
Critical weaknesses
- Almost all of the numbers come from a fairly simple simulation. Breathing is modeled as a rigid 3D translation (a sin^6 curve with a random tilt), and the same motion model is used for both training and testing. Real breathing is nonrigid and has rotation, hysteresis, drift and slice-to-slice variation, and none of that is tested. The simulated AF only re-times the same 12-phase gated cycle, so real beat-to-beat changes in shape and filling are not really there. On top of that, EPE is computed after removing the per-subject mean error, and all image metrics are computed after a 6-DOF rigid registration. So I think the 0.9 mm number very likely overstates what will happen on real ungated data.
- The real-data evidence is too thin to support the clinical story. There are only two subjects (one healthy, one AF), and there is no quantitative comparison against anything, only LAX images and LV volume curves. Also, the comparison is hard to read: CardioStitch is the only method trained on this exact simulator, while the baselines are either used outside their design assumptions (static SVR on a beating heart), run with components turned off (SVRTK robust statistics), or re-implemented without official code (CiNeVol). FC-SVR and Stolt-Ansó et al. are listed in Table 1 but not compared.
Questions for authors
- How does performance change when the test-time motion differs from the training model, e.g. nonrigid or slice-specific breathing, rotation, or amplitudes outside U(11.45, 26.15) mm? Even one such stress test would help a lot.
- The location token only encodes a scalar through-plane position z_i. How would the method deal with oblique or non-parallel slices, or with different slice thickness/gap than in training?
- For the 3D cine, all non-reference slices are fixed to one frame and only the central slice changes. So under AF, base and apex motion is never observed and has to be inferred. How sensitive are the results to the choice and quality of the reference slice (e.g. a basal reference, or a reference frame with artifacts)?
- For the two prospective subjects, can you report EF/EDV/ESV against a standard breath-hold cine of the same subject?
- CiNeVol gets the exact R-peak times and the true breathing signal and still loses on most metrics. Did you check that your re-implementation reproduces the numbers in the original paper on any comparable setting?
4 comments
(Part 2/3)
Q3: Can the prospective reconstruction be quantitatively validated against standard breath-hold cine MRI?
A3: Following the reviewer's suggestion, we expanded the prospective evaluation from 2 to 13 subjects (10 healthy volunteers and 3 patients, including one AF patient), each with a separately acquired breath-hold ECG-gated cine.
Without retraining, CardioStitch recovers 89% of the reference stroke volume (95% CI: 82–96%) and achieves an EF error of 9.6 pp. Its EF is underestimated in 12 of 13 subjects, primarily due to an overestimation of ESV, consistent with the negative EF bias observed in the retrospective evaluation. The mean EDV bias is +9 mL (6%), while the mean ESV bias is +19 mL, explaining the systematic underestimation of EF.
Fetal CMR 4D, using 40 consecutive frames per slice and cardiac timing information, achieves a comparable EF error (p = 0.84) and lower EDV error (p = 0.01). However, it requires 22–49 minutes of optimization per subject, compared with seconds for CardioStitch.
These results provide quantitative evidence of CardioStitch's applicability to real free-breathing, ungated acquisitions, while also revealing its remaining functional estimation bias. We emphasize that the separately acquired gated cine is a clinical reference rather than beat-specific ground truth.
The extended evaluation is included in Sec. 5.2 (Table 4) and Appendix A.9.
Q4: Are the baseline comparisons fair given their different design assumptions, input requirements, and implementation settings?
A4: We clarify that Dangi et al. is retrained using the same data and simulator as CardioStitch, whereas the five optimization-based methods perform subject-specific reconstruction and require no population training.
The two synchronization-based baselines receive additional information unavailable to CardioStitch: CiNeVol receives the exact simulated R-peak times and respiratory signals, and Fetal CMR 4D receives the full temporal series of every slice and the nominal R–R interval.
Regarding individual configurations:
- Static SVR methods: SVRTK, NiftyMIC, and NeSVoR assume static anatomy. They are included as representative SVR methods applicable to a single slice stack, rather than methods specifically designed for asynchronous cardiac motion.
- SVRTK: Robust statistics are disabled because, in our single-stack setting, they reject every slice.
- FC-SVR: Its original training requires ground-truth slice correspondences to a static anatomy. Extending its supervision to asynchronous cardiac states would require registration-derived pseudo ground truth.
- Stolt-Ansó et al.: Its alignment objective relies on slice intersections, which are absent in a single parallel short-axis stack.
To provide an additional same-data learning-based comparison, we retrained CardioStitch without cross-slice attention using identical training settings. Its EF error increases from 7.5 to 37.2 pp under AF, demonstrating the importance of cross-slice reasoning.
We have clarified the baseline assumptions and configurations in Sec. 4 and Appendix A.10.1 and included the retrained ablation in Sec. 5.3 (Table 5).
Q5: How does CardioStitch handle different slice spacings, thicknesses, and non-parallel acquisition geometries?
A5: CardioStitch encodes physical slice positions in millimeters rather than discrete slice indices, allowing different spacings and gaps to be represented directly. Our training data cover slice spacings from 5 to 12 mm.
| slice spacing | n | EF error (pp) | Dice |
|---|---|---|---|
| 12 mm | 95 | 7.0 | 0.857 |
| 10 mm | 74 | 8.0 | 0.843 |
| 9.5–9.6 mm | 3 | 2.3 | 0.850 |
| 8 mm | 4 | 7.6 | 0.849 |
| 5–6 mm | 4 | 12.6 | 0.66 |
Performance is relatively consistent across commonly represented spacings. The four subjects with 5–6 mm spacing exhibit lower accuracy, potentially due to the limited number of thin-slice stacks in training (only 8 of 628 training subjects have spacing ≤6.5 mm). The prospective scans have a slice spacing of 10 mm and are reconstructed without any fine-tuning on the prospective subjects.
The current method moves observed pixels without explicitly deconvolving the slice profile. Consequently, slice thickness is not explicitly modeled, and the reconstructed through-plane resolution remains limited by the acquired slices and partial-volume effects.
For non-parallel slices, a scalar through-plane position is insufficient to represent the full acquisition geometry. Extending the location encoding to incorporate full spatial slice poses would be a natural direction for generalizing the framework to multi-view acquisitions.
The subgroup analysis is included in Appendix A.11 (Table A10), and the limitations regarding acquisition geometry are acknowledged in Sec. 6.
(Part 3/3)
Q6: How sensitive is CardioStitch to the position and image quality of the reference slice?
A6: We conducted two additional sensitivity analyses on 60 test subjects.
First, the model was trained using only the central slice as the reference. We moved the reference slice at test time away from the central slice toward either the apex or the base, computing EF from the ED and ES frames.
| Distance from center (slices) | 0 | 1 | 2 | 3 | 4 |
|---|---|---|---|---|---|
| EF error (pp), toward the apex | 8.6 | 10.4 | 12.5 | 15.8 | 23.6 |
| EF error (pp), toward the base | 8.6 | 10.5 | 16.1 | 25.9 | 43.5 |
The results degrade gradually as the reference moves away from the center, with greater sensitivity toward the base. A one-slice deviation increases EF error by approximately 1.9 pp (p = 0.005). However, the automatically selected central slice lies on average only 0.7 slices from the middle of the LV in the test set and contains the LV in all 13 prospective stacks.
Second, we evaluated the effect of image degradation in the reference slice.
| reference image | PSNR change (dB) | EF error change (pp) |
|---|---|---|
| half resolution | −0.14 | +1.0 |
| Gibbs ringing | −0.14 | +0.2 |
| ghosting | −0.17 | +0.6 |
CardioStitch exhibits limited sensitivity to these tested image degradations.
We acknowledge that a single reference frame cannot fully characterize arbitrary regional cardiac dynamics, particularly under arrhythmia. Extending the framework to exploit multiple temporal observations per slice is therefore an important direction for future work.
These sensitivity analyses are now included in Appendix A.3.
Q7: Has the CiNeVol reimplementation been validated, and why does it exhibit relatively large respiratory motion errors despite receiving oracle signals?
A7: CiNeVol's original evaluation uses in-house patient data and licensed XCAT phantoms that are unavailable to us. Therefore, we cannot directly reproduce its original quantitative results. Nevertheless, our implementation follows the architecture, loss functions and weights, PSF sampling, optimizer, and iteration budget described in the original paper and supplementary material.
Its performance is consistent with the expected behavior of its synchronization-based formulation. CiNeVol uses ECG-derived R-peak times to assign cardiac phases, assuming that the interval between two consecutive R-peaks corresponds to a complete cardiac cycle. Under HRV, CiNeVol achieves the lowest EF error among all evaluated methods (5.58 pp), with PSNR close to CardioStitch (24.26 vs. 24.59 dB). Under AF, truncated cardiac cycles violate the complete-cycle assumption of phase assignment, increasing its EF error to 10.50 pp.
As its authors report, CiNeVol also underestimates cardiac contraction. Consistent with this observation, our reimplementation exhibits a negative EF bias, which increases in magnitude from −2.7 pp under HRV to −8.1 pp under AF.
Regarding respiratory motion, even with oracle respiratory signals, CiNeVol achieves a through-plane EPE of 4.23 mm, with a correlation of 0.32 between estimated and true displacements. For comparison, predicting no respiratory displacement gives an EPE of approximately 4.7 mm. We hypothesize that this is related to an ambiguity in per-subject optimization: a through-plane displacement changes the observed cross-section, which can be explained by modifying the reconstructed anatomy rather than correcting the slice location.
In contrast, CardioStitch leverages a population-trained prior learned from 628 subjects to help resolve this ambiguity. Incorporating a population-level prior is also identified as a future direction in the original CiNeVol paper.
We have clarified the implementation details in Appendix A.10.1 and the functional accuracy comparison in Sec. 5.1.
We thank the reviewer again for the constructive feedback and hope that these additional experiments provide a more comprehensive assessment of CardioStitch's accuracy, robustness, and practical limitations.
Thank you for providing the additional experiments. I appreciate the author's efforts, especially the in-depth assessment of the real data and the results of the unregistered cases. This topic indeed addresses some of my past concerns.
However, I am still not completely convinced by the significant improvement brought by the baseline model. CardioStitch was specifically trained for this simulation scenario, based on the real anatomical volume. Multiple baseline models were tested under conditions where the initial design was not applicable. In particular, the performance of CiNeVol was only slightly better than without motion correction, which makes me doubt how much we can draw conclusions from this comparison. The results of the real data are useful, but EF still has a systematic underestimation problem, and the new robustness test does not truly cover more complex real-world movement scenarios. Overall, I think the test paper has improved, but my main concerns still remain, so I will keep the score at 2 points.
(Part 1/3)
We sincerely thank the reviewer for the thoughtful feedback and for recognizing the clinical motivation, the geometry-based reconstruction formulation, and the analysis of the learned cardiac and respiratory motion. Your suggestions motivated a substantially extended prospective evaluation and several additional experiments to assess the robustness and fairness of our evaluation.
Q1: Does the reported accuracy depend on rigid registration or per-subject mean-error removal during evaluation?
A1: We agree that reporting both corrected and uncorrected results is important. Following the reviewer's suggestion, we evaluated all methods without rigid registration for image metrics and without per-subject mean-error removal for respiratory EPE.
For CardioStitch, these evaluation corrections change EPE by only 0.02 mm and PSNR by 0.25 dB. CardioStitch maintains its advantage without either correction, indicating that the reported performance does not depend materially on these evaluation procedures.
We have included these results in Appendix A.11 (Table A9).
We acknowledge that the respiratory EPE is measured on simulated data with known motion, rather than on prospective acquisitions. For real scans, we have instead added independent clinical-reference comparisons, as described in Q3.
Q2: How robust is CardioStitch to respiratory motion outside the training distribution and to realistic cardiac rhythm variations?
A2: We agree that our original respiratory simulation represents a simplified model of real breathing. As suggested, we evaluated the unchanged model on all 180 test subjects under six out-of-distribution respiratory settings.
Even at twice the training respiratory amplitude, CardioStitch maintains substantially lower EPE than naive stacking (2.96 vs. 8.83 mm), with a PSNR reduction of only 1.2 dB relative to the in-distribution setting. Changes in respiratory waveform, AP/SI ratio, and slice-dependent amplitude have relatively small effects.
Regarding cardiac motion, our AF simulation varies beat duration and contraction amplitude within each subject's gated-cine trajectory. It isolates irregular cardiac timing but does not simulate arbitrary regional changes beyond that trajectory. We acknowledge that rotation, hysteresis, drift, non-rigid respiration, and more complex beat-to-beat cardiac motion remain important directions for further investigation.
The additional respiratory experiments are included in Appendix A.5 (Table A5), and the limitations of the respiratory simulation are acknowledged in Sec. 6.