- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper addresses longitudinal medical image forecasting by predicting a patient's future anatomical scan from baseline imaging, clinical covariates, and available prior-visit history. It highlights a critical evaluation pathology ("identity collapse"), where simply copying the baseline scan outperforms ten existing generative forecasters on standard pixel-similarity metrics (PSNR/SSIM) while failing to capture subtle regional progression. To overcome this, the authors introduce GraphMorph, a sequential three-stage framework that decouples predicting future regional geometry from rendering the future scan: (1) a spatial anatomical autoencoder encodes named segmentation masks into 3D/2D spatial tensor nodes within an anatomy graph, (2) a graph-conditioned temporal evolver advances these nodes over the requested interval under direct segmentation supervision to decode future occupancy maps ("the anatomical request"), and (3) a frozen, registration-pretrained deformation network (DiffuseMorph) steered by a ControlNet-style branch warps the baseline scan, using the predicted request as both spatial conditioning and the primary anatomical alignment target. Across multi-cohort 3D brain MRI (ADNI, OASIS-3, AIBL), 2D knee radiographs (OAI), and an extension to 2D Potts grain growth, the authors pair extensive regional-change and adherence evaluations with controlled anatomical substitutions to separate forecast accuracy from rendering fidelity.
Critical strengths
-
The paper shows that copy-forward beats every image forecaster on PSNR/SSIM and that no pixel-space forecaster matches an elapsed-time regression on core brain structures. The change-sensitive protocol (copy-forward, interval regression, tabular references, oracle substitutions) is a useful contribution independent of the method.
-
Separating the anatomical request from the frozen renderer allows forecast accuracy and rendering adherence to be measured separately. The appendices audit cross-segmenter reliability, input controls, SyN baselines, scale sweeps, and preprocessing artifacts. The paper discloses most of its own weaknesses.
Critical weaknesses
-
Δ_Region relies on a ~2.3× multiplier fitted on test predictions; without it (s = 1), rankings reverse in favor of Δ-LFM on 32 brain regions and Diffusion/Flow Matching on knee. Under an independent segmenter (FastSurfer), the raw MAE advantage over copy-forward vanishes or reverses and the correlation margin over Δ-LFM shrinks by more than half. On the knee, joint-space MAE is worse than copy-forward (9.53 vs. 8.91 pp) and tabular masks beat the native spatial request by +0.063.
-
Five brain baselines receive neither elapsed interval nor covariates; only GraphMorph and the tabular reference receive prior-visit history on the knee. The authors' own control shows that removing history drops R_chg^(32) from 0.313 to 0.224, statistically indistinguishable from Δ-LFM, while the cross-region attention mechanism, the paper's named contribution, adds only +0.019. Cited 3D longitudinal baselines (TADM-3D, AG-LDM, TimeFlow) are omitted and MambaControl is evaluated without its core module.
Questions for authors
- Would the authors report Δ_Region using the validation-fitted scale as the primary metric, with s = 1 rankings in the main tables?
- Can the no-history GraphMorph control be included in Tables 1 and 3, and all knee methods trained on the same registration-gated 25,691 pairs?
- Can the three confounded Stage 2 ablation arms (core-6, original 32-region, full-32 decode) be retrained under the deployed schedule and batch size?
- What mechanism makes zero-padding to (192, 224, 192) vs. (128, 160, 128) change interior predictions, and why was the larger canvas the validation default?
- What is the source of the 8 mm header-origin shift affecting 24.2% of test pairs but 0% of training, and can the corrected table be reported?
Suggestions for future work: Cross-region spatial message passing rather than pooled FiLM, and non-deformational progression (new lesions, intensity drift).
5 comments
Response Part II
Q2. Under an independent segmenter (FastSurfer), the MAE advantage vanishes. On the knee, MAE is worse than copy-forward (9.53 vs 8.91 pp) and a tabular forecaster beats GraphMorph by 0.063.
A: We thank the reviewer for these careful observations.
MAE is the distance between the forecast change and the measured change. It therefore counts every error together, the wrong amount of change, the wrong patients and regions, and the noise in the measurement. The measurement alone is noisy. On the brain, the two segmenters agree only at r = 0.554 on the measured change (Sec. 5.1). On the knee, consecutive changes of the same joint are anticorrelated at −0.43 (Appendix E.5).
1. MAE under FastSurfer and on the knee. In both cases the measurement noise dominates the MAE and biases it towards a forecast of no change. Under FastSurfer, our MAE differs from copy-forward by −0.039 pp [−0.152, +0.075] on the pre-specified sample (Table 2). On the knee it is 9.53 against 8.91 pp (Table 3). The MAE advantage over copy-forward therefore holds only on the brain under SynthSeg (2.61 against 3.49 pp, Table 1), and the revised limitations state this.
In contrast, correlation asks only whether the patients and regions with more measured change receive more forecast change, so a forecast of no change cannot score on it. Under FastSurfer the margin over ∆-LFM is 0.077 smaller, and it remains positive on the pre-specified sample (+0.037 [+0.002, +0.078], Table 2). GraphMorph still reads 0.328 against 0.291 for ∆-LFM when a different segmenter measures the results (Appendix L.5).
2. Tabular masks. On the knee, a tabular regressor forecasts the anatomy better than our graph (+0.063 [+0.041, +0.084] in on validation, Appendix E.3). On the brain, with 32 regions, our forecast delivered as a spatial request renders higher than the tabular forecast (0.319 against 0.286 on validation, Table 5a). Both knee images come from the same GraphMorph renderer, which accepts any anatomical forecast. The revised limitations state this with the measured difference (Table S6).
Response Part III
Q3. The baselines receive fewer inputs than GraphMorph. Without history GraphMorph falls to 0.224, indistinguishable from ∆-LFM, and the named contribution, cross-region attention, adds only +0.019. TADM-3D, AG-LDM and TimeFlow are omitted, and MambaControl lacks its core module.
A: We thank the reviewer for this analysis. We go through the points in the order raised.
1. Inputs of the baselines. We ran each baseline from its original code where available, and in their original form some take no elapsed interval or covariates. To check whether this explains the gap, we gave the elapsed interval and covariates to Flow Matching and Noise-Free Flow (Table R3). The added inputs raise both on the core, Flow Matching from 0.217 to 0.316 and Noise-Free Flow from 0.184 to 0.314, and GraphMorph stays ahead with history inputs (0.447) and without them (0.380). Over 32 regions they read 0.165 and 0.153, against 0.322 and 0.226. On the knee, adding the same inputs to Flow Matching does not close the gap either (0.129 against our 0.230).
2. History. ∆-LFM itself uses up to two prior visits (Table S36), so that comparison sets our model without history against a baseline with it. With history on both sides the comparison is 0.322 against 0.228 (Table S23), and on the 185 test pairs that have no prior visit we lead ∆-LFM by 0.238 to 0.179 (Table S7). On the three core brain structures, GraphMorph without history still reads 0.380, against 0.263 for the best image forecaster in Table 1 and 0.316 for Flow Matching with the added inputs, and on the knee it reads 0.154 against 0.119 for Flow Matching, so on the core and on the knee the lead does not depend on history. The revised Tables 1 and 3 include this model (Table R4).
3. Cross-region attention. Its gain is small but consistent, +0.019 [+0.010, +0.028] over three seeds (Table 5). Attention is one component of the forecaster. The contribution of the paper is the decomposition, forecasting the anatomy first and then rendering it. When the forecast is replaced by the identity, the core falls from 0.447 to −0.005 (Table 4). Delivered as a spatial request, our forecast is ahead of a tabular forecaster by +0.033 [+0.019, +0.050] over 32 brain regions. This gain comes from the spatial form, because the same graph forecast reduced to masks loses 0.039 [0.026, 0.053] (Table 5). The revised discussion states the size of the attention gain.
4. TADM-3D, AG-LDM and TimeFlow. Our comparison covers ten image forecasters from the main families, namely deformation, diffusion, flow matching, neural ODE and direct prediction. TADM-3D and AG-LDM are closest to two of them, Noise-Free Flow, which also predicts change from the baseline, and BrLP, whose framework and preprocessing AG-LDM extends. We retrained AG-LDM on our split with its released code, and it reads 0.105 over 32 regions and 0.028 on the core (Table R3). TADM-3D, retrained in the same way from its released code, reads 0.031 and −0.040. We do not run TimeFlow, because it extrapolates a registration between two earlier scans, which 185 of our 669 test pairs do not have, and its registration family is represented by DiffuseMorph (Table 1).
5. MambaControl. It is run as its released backbone, because the Fourier graph module is not in the released code (Appendix I.6), and Table 1 labels it MambaControl backbone.
Table R3. of the comparators with the added inputs and of the added baselines.
| Comparator change | Brain, 32 regions | Brain, core | Knee joint space |
|---|---|---|---|
| Flow Matching with elapsed interval and covariates | 0.165 | 0.316 | 0.129 |
| Flow Matching, original† | 0.121 | 0.217 | 0.119 |
| Noise-Free Flow with elapsed interval and covariates | 0.153 | 0.314 | — |
| Noise-Free Flow, original† | 0.088 | 0.184 | 0.087 |
| TADM-3D, retrained on our split | 0.031 | −0.040 | — |
| AG-LDM, retrained on our split | 0.105 | 0.028 | — |
| GraphMorph | 0.322 | 0.447 | 0.230 |
† As reported in Tables 1, 3 and S23.
Table R4. of GraphMorph with and without history inputs.
| Method | Brain, 32 regions | Brain, core | Knee joint space |
|---|---|---|---|
| GraphMorph | 0.322 | 0.447 | 0.230 |
| GraphMorph, no history inputs | 0.226 | 0.380 | 0.154 |
| ∆-LFM (uses history) | 0.228 | 0.219 | — |
| Best other image forecaster | 0.228 (∆-LFM) | 0.263 (CardiacAging) | 0.119 (Flow Matching) |
Response
We thank the reviewer for the close reading, and for recognising that the change-sensitive evaluation protocol is a contribution independent of the method and that separating the anatomical request from the renderer lets forecast accuracy and rendering adherence be measured separately. We answer the concerns below.
A: We thank the reviewer for this question. The revised Tables 1 and 3 report ΔRegion with the validation-fitted scale as the primary metric, together with the s = 1 values in the column ΔRaw (Table R1). With the validation-fitted scale, GraphMorph has the lowest ΔRegion in all three settings (1.030 over 32 brain regions, 0.825 on the brain core and 1.194 on the knee).
Why we scale? A forecast can be wrong in its overall amount of change, or in which regions and patients change most. One scale fitted on validation removes the first error, so ΔRegion measures only the second.
Without scaling (s = 1), ΔRegion also counts the first error, the error in the overall amount of change, and there we do worse. Our forecasts predict about 0.43 of the measured change, where 1 would be exact. ∆-LFM predicts 1.34 of it on the brain and Diffusion 0.74 on the knee, which are both closer to 1 (Table R2). This is why ∆-LFM has the lowest ΔRegion over 32 brain regions at s = 1 and Diffusion on the knee, while we still lead on the brain core (Table R1). The revised limitations state this under-prediction. It does not affect regional change correlation (Rchg), our headline metric, because a correlation does not change when every forecast is multiplied by the same scale factor.
Table R1. ΔRegion at s = 1 and at the validation-fitted scale (lower is better).
Table R2. Amplitude bias, the forecast change size divided by the measured change size.