- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents AREION, a foundation model for atlas-agnostic representation learning from fMRI functional connectivity (FC) matrices. The method combines Brain Region Contextualizing (BRC), which incorporates spatial coordinates, functional gradients, and regional volume, with a hierarchical Transformer that models regional connectivity profiles and whole-brain interactions. The model is pretrained using masked autoencoding on multi-atlas fMRI data and evaluated on several downstream tasks, including demographic, cognitive, and disease-related prediction, as well as generalization to unseen atlases and external datasets.
Critical strengths
- The paper addresses the practical challenge of learning transferable representations across different brain atlases.
- The combination of region-level metadata and hierarchical Transformer encoding is reasonable.
- The paper is easy to follow.
Critical weaknesses
- The single-atlas and multi-atlas settings differ not only in atlas diversity but also in the number of training subjects and dataset composition. In particular, Gordon333 is used only for ABCD, while the Schaefer atlases are used for HCP/HCP-D. Therefore, the reported improvements cannot be clearly attributed to atlas diversity rather than additional data or cohort differences.
- Functional gradients are an important component of BRC, but the paper does not sufficiently explain how they are computed, which reference data are used, or how they are aligned and normalized across different atlases.
- Since FC matrices are symmetric ((F_{ij}=F_{ji})), masking only the rows of selected regions while retaining all columns in visible rows would expose some reconstruction targets through their symmetric entries. With a 75% masking ratio, approximately 25% of the entries in each masked row could remain observable. The paper does not clearly specify whether the corresponding columns are also masked.
- Some reported improvements over baselines are relatively small compared with the reported cross-validation variability. Although the paper provides results from five-fold cross-validation, it does not report paired significance tests or confidence intervals for the performance differences.
- Table 4 lists SCZ with Glasser360 as an external test setting for schizophrenia classification, but the corresponding results are not reported in the main paper or appendix.
Questions for authors
- Can the authors provide a controlled comparison between single-atlas and multi-atlas pretraining using matched training subjects and a comparable training budget?
- How are the functional gradients computed, aligned, and normalized across different atlases, particularly those unseen during pretraining?
- During masked autoencoding, are the connectivity entries corresponding to masked regions also removed from the visible rows? If not, how is information exposure through the symmetry of the FC matrix addressed?
- Can the authors provide paired statistical significance tests or confidence intervals for the main performance comparisons?
- Can the authors provide the SCZ–Glasser360 schizophrenia classification results listed as an external evaluation setting in Table 4?
We thank the reviewer for the insightful assessment of our work. All responses to the identified weaknesses can be found within our answers to the reviewer’s questions, as each weakness directly corresponds to a specific question. Therefore, detailed responses addressing all weaknesses are provided in the following question-by-question replies.
Q1: Our results indicate that the performance improvement comes from both the proposed regional contextualizing mechanism and multi-atlas pretraining. In Table 1, AREION (Single), pretrained only on Schaefer400, already outperforms all baselines on five of the six tasks, showing the effectiveness of our framework without multi-atlas pretraining. In Table 3, in which all variants share identical pretraining data, BRC outperforms alternative positional encodings, particularly on the unseen Gordon333 atlas (91.61% vs. 88.81% ACC for sinusoidal PE).
Q2: The voxel-wise functional gradient maps from the HCP cohort were used in BRC, publicly available at https://github.com/PennLINC/Brain_Organization/tree/master/PrincipleGradient. For each atlas, region-wise mean and standard deviation of the first three principal functional gradients were included in BRC. We did not compute functional gradients for each subject. Given a new/unseen atlas, its BRC could be computed directly with these group-level functional gradient maps.
Q3: In our implementation, the columns corresponding to masked regions are retained in the visible rows. The reasons are as follows: 1. Whether the columns corresponding to the masked regions are removed only affects the difficulty of pretraining task. Our experiments demonstrate that the representations learned under this setting achieve strong performance across downstream tasks. 2. Retaining the columns preserves whole-brain context. With a 75% masking ratio, masking both rows and columns would leave each visible region with connectivity to only 25% of the regions, i.e., only 6.25% of the FC matrix would be observed. The Regional Transformer Encoder would then learn from truncated connectivity profiles, whereas at inference it receives the complete profile of each region. While symmetric masking provides a good future direction to go, we anticipate that adjusting mask ratio may be needed for different masking strategies.
Q4: We performed subject-level paired comparisons between AREION and the strongest baseline for each task in Table 1, using the same subject-level cross-validation splits. We report the pooled out-of-fold performance, the paired 95% bootstrap confidence interval of the difference and the two-sided Wilcoxon signed-rank test p-value computed on per-subject errors.
AREION improves over the strongest baseline on all five tasks, and the improvement is significant on HCP Age. To assess overall improvement on a common scale, we computed each task's relative gain, (AREION−Baseline)/Baseline and took the unweighted average across the five tasks using 10,000 cohort-stratified subject-level paired bootstrap resamples—resampling subjects with replacement within each of the three cohorts (HCP, SCZ, PNC) to preserve shared-subject correlations, recomputing each task's metric and relative gain, and averaging the five relative gains per replicate. This yields a mean relative improvement of +4.07% (95% CI [+0.96%, +7.65%], two-sided p = 0.009).
Q5: We provide the SCZ-Glasser360 schizophrenia classification results as below:
This result further demonstrates the strong transferability to external dataset and unseen atlas of our proposed framework.