- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes a framework for predicting dementia outcome from longitudinal T1 imaging data. The idea is to first get parcel-specific embeddings before longitudinal modeling. The experiments are extensive to show the effectiveness of the proposed method.
Critical strengths
The breadth of validation analyses is amazing. Even a survival analysis, robustness to preprocessing, and external-data generalizability analysis are included. Overall I don't find any major flaws in the presentation.
Critical weaknesses
-
My main concern is simply the limited methodological novelty. Learning parcel embeddings followed by longitudinal modeling seems incremental. There is a large body of literature on longitudinal MRI modeling, particularly on AD and related dementia. I don't think benchmarking classification accuracy on these public datasets represents a breakthrough.
-
The clinical interpretation remains a weakness as in most MRI-based learning frameworks.
-
A moderate concern is that the paper implies that the framework does not rely on a specific atlas, but comparing table 1 and table 2 suggests that there is a roughly 5% accuracy difference.
Questions for authors
The attention rollout visualization is not very informative. How does the saliency tell us about AD? I don't think showing regions being "influential" really helps us understand AD any better.
5 comments
Response (continued)
W2: Clinical interpretation
We thank the reviewer for raising this point. As the reviewer notes, clinical interpretation is a challenge shared by most MRI-based learning frameworks, not just SBT. It stems from the absence of regional ground truth in the publicly available dataset: MRI scans lack regional annotations of the anomalies that drive a diagnosis, so the attributions of any framework are difficult to verify directly. Likewise, it is also important to test the model's interpretations for reliability. The interpretability analyses of SBT are designed with this in mind (Sec 4.8 and Appendix Sec E) and serve two purposes:
- The first is to verify the framework’s inherent interpretability and localization capabilities of SBT. The parcel weights, produced by the model for the anatomical representations, indicate which regions the model weighs on to classify a scan. To test whether these weights can be relied on, we constructed a synthetic dataset in which the abnormal regions and their severities are known by construction. Trained only on CN/ATR labels, the model's parcel weights recover the abnormal regions and track their severity. This experiment demonstrates that the model’s parcel-level explanations are spatially aligned with the underlying abnormalities of the synthetic dataset, thereby testing SBT’s reliability.
- Second, a complementary plausible assessment in this realm is to assess anatomical concordance with the extant clinical literature and to check if the model follows the behavior. To assess the same, two tests were conducted viz cohort-level analysis and scan-level analysis (Sec 4.8 and Appendix Sec E). Cohort-level analysis, possible with our setup, showed similar expected patterns of affected regions in the dataset, consistent with the clinical literature. At the individual scan level, the parcel saliencies identify the most influential regions, and, in most cases, these fall within clinically established regions affected in AD pathology.
W3: Regarding alternative atlas
We appreciate your concern. We clarify that we don’t claim atlas independence or atlas invariance with respect to performance. The intended claim is that the benefit of anatomical contextualization persists under a different parcellation. As stated in Section 4.4, “the longitudinal advantage of SBT is preserved”. This is in concordance with the observation that using the Neuromorphometrics atlas, SBT continues to outperform the longitudinal baselines. Although the framework can adapt to different atlases, as discussed in Appendix Sec B2, “Atlas sensitivity must therefore be interpreted with respect to both anatomical coverage and volumetric support”, given HO has 69 parcels and Neuromorphometrics has 136 parcels. These properties jointly change the anatomical contexts available to the encoder and may contribute to the performance difference. The comparison therefore supports the persistence of SBT’s benefit across the two evaluated parcellations. We have clarified this in Sec 4.4 in the revised manuscript.
Q: Interpretations:
Parcel saliency expresses the explanation in anatomical units familiar to clinicians. Clinical assessment of AD starts from the patient’s functional deficits, such as impaired memory, disorientation or changes in executive function. Clinicians link these deficits to anatomically defined regions, such as the hippocampus, etc. The progression of AD is also described along such regions, starting in medial temporal structures and spreading to broader cortical areas (Braak & Braak, 1991). A high parcel saliency therefore points to a named structure with a known functional role, and a clinician can check it directly against the patient’s symptoms. For example, high saliency in the hippocampus and parahippocampal gyrus fits a patient whose main complaint is memory loss. Explanations organized by anatomy, and checked for reliability against known ground truth, remain an active area of exploration in longitudinal neuroimaging. SBT attempts to offer one. However, the current scope of SBT was to address the representation and computational limitations of longitudinal MRI modeling while preserving access to regional evidence across visits. Establishing their correspondence with individual patients’ symptoms requires further multimodal validation using cognitive assessments, clinical histories, and complementary biomarkers. We see this as a natural direction for future work, with SBT providing the regional and longitudinal outputs needed to investigate that correspondence.
We thank the reviewer again for the constructive assessment. We hope that our response will address your concerns. If you have any other questions, we will be happy to discuss them with you.
Contribution of the work
I appreciate your responses. I still feel you misspecified your core contribution and novelty. The longitudinal analysis of AD, or practically any brain disorder, is historically based on the "structure-before-time" principle. From extracting regional measures by Freesurfer and using linear mixed-effects models to model trajectories, to using CNN to extract local or global image features and using LSTM/RNN to model trajectories (also recent attention-based variants), SBT has always been a first basic design choice. On a side note, MRIs are often affinely registered beforehand, so all previous deep learning works have the capability to extract localized corresponding features.
So having "structure should shape representation formation before time is modeled" as your core hypothesis and "Structure-before-time(SBT) learning principle" as your core contribution actually trivializes your work.
I'm not denying that you might have found a specific design choice / combination of modules that might work better, but the current writing over-states, and more importantly, mis-represents the real contribution.
Response to Reviewer LKZ4
We sincerely thank the reviewer for their time and for their highly encouraging assessment of our experimental rigor. We are thrilled that the reviewer found the "breadth of validation analyses is amazing". We address your concerns below and welcome all suggestions in refining the manuscript.
W1: Regarding the novelty
We would invite the reviewer to view SBT as a representation-learning principle inspired from the biological lens of neurodegeneration in Alzheimer's disease (Sec 1). Brain regions have meaningful anatomical correspondence across visits. In AD, progression appears as subtle, region-specific trajectories that unfold unevenly over time. SBT draws on this observation to provide an anatomical inductive bias for longitudinal learning. We acknowledge the extensive literature on longitudinal MRI (Sec 2, Appendix C.3). As summarized in Fig. 1, a central challenge remains: preserving fine-grained regional evidence from high-resolution scans while keeping computation tractable as patient histories grow. Existing approaches address this challenge through spatial downsampling, restrictions to paired or fixed-length histories, or compression into global scan embeddings. These strategies make different trade-offs among spatial detail, available temporal context, and explicit regional correspondence which may discard some useful information about the disease. Bringing these requirements together is therefore a substantive representation-learning problem and is non-trivial.
SBT addresses this problem by introducing anatomical structure during representation formation, before global spatial and temporal aggregation. The aim is to retain localized evidence while supporting high-resolution inputs and irregular, variable-length histories at a manageable computational cost. Our experiments demonstrate a favorable predictive performance and inference-cost trade-off (Fig. 5B), while being interpretable at parcel-level across visits. This combination of regional specificity, longitudinal flexibility, and computational scalability is the contribution we seek to establish. To the best of our knowledge, no prior longitudinal framework offers these properties together.
We believe that characterisation of SBT as “Parcel embeddings followed by longitudinal modeling” is a fair but understated one-line summary. We would invite the reviewer to consider the many possible design choices that can fit the same description, and how they behave. Each of the following is a natural first choice:
These comparisons support a specific finding: the anatomical context, the stage at which it shapes representation formation and the aggregation method matter. Sections 4.5-4.8 test this representation principle. Furthermore, SBT demonstrates generalizability to other tasks like time-to-event analysis and other diseases like frontotemporal dementia. Together, these analyses investigate the broader utility of the SBT’s representation principle.