- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
AnatoQ adapts frozen brain foundation models to atlas-defined regional representations through an Atlas-Guided Q-Former (AGQ), combining atlas-initialized queries, global cross-attention, and regional-volume pretraining. Experiments on ADNI/OASIS report improvements across four backbones and several tasks, alongside attribution analyses.
Critical strengths
- Relevant problem: Bridges generic spatial features and anatomically defined regions.
- Practical design: A lightweight adapter preserves pretrained backbones.
- Promising results: Improvements across four CNN/Transformer encoders and multiple tasks, particularly MedicalNet.
- Useful analyses: Aggregation ablations, attribution visualizations, and stability measurements.
Critical weaknesses
-
(Major) Attribution faithfulness is not established. Sections 4.3–4.4 interpret saliency as identifying structures driving predictions. Yet global cross-attention allows each region-labeled token to access the entire brain. Moreover, mean pooling gives all region tokens identical output gradients, so Appendix E.1's scores chiefly reflect mean-centered token features weighted by shared channel gradients. Table 3 and Figure 3 show stable, anatomically plausible patterns, not faithful spatial localization. Controlled regional occlusion/perturbation tests are needed.
-
(Major) Generalization claims exceed the evidence. Four backbones demonstrate architectural compatibility, but evaluation is limited to ADNI and OASIS. OASIS supports only AD classification; all regression tasks use ADNI. This limited evaluation does not substantiate the general-purpose capabilities claimed in the abstract, nor establish robustness under cohort or task-distribution shifts. Please add targeted external-transfer results or narrow the claims.
-
(Major) Possible pretraining/test-subject overlap. Appendix A.3 states that regional-volume pretraining can use “all subjects” without diagnostic labels. However, it uses subject-specific MRIs and 120 gray-matter regional volumes associated with downstream phenotypes. If test subjects were included, evaluation would be transductive rather than strictly unseen-subject generalization. Please disclose overlap across stages and, if present, report subject-disjoint results.
-
(Major) Atlas guidance and the spatial-resolution explanation lack controlled support. In Figure 2, MedicalNet's generic Q-Former nearly matches full AGQ despite its fine token grid; coarser BrainIAC/SwinUNETR show greater benefits from atlas initialization, while Static Atlas markedly outperforms AGQ on SAM-Med3D. These results are not convincingly explained by the proposed token-resolution argument. Please test controlled token resolutions and randomized/spatially perturbed atlases with matched capacity, supervision, and optimization to isolate anatomically correct guidance.
-
Reproducibility inconsistencies. Appendix A.1 lists 1,013 OASIS subjects, but Table A2 totals 813 (451 CN + 362 AD); the remaining 200 are unaccounted for. Table A6 reports ~75k/~133k/~298k regression-head parameters at feature dimensions 384/512/768, despite describing linear heads (a single-layer scalar head would require only d+1). Please specify architectures and counts; the supplementary reference code does not resolve this.
-
Unexplained main/ablation discrepancies. For MedicalNet/ADNI, Table 1 reports AGQ gains over mean pooling of +8.5 ACC and +5.2 AUC points, whereas Figure 2 suggests ~+4.5 ACC and ~+10.0 AUC. These substantial discrepancies raise concerns about experimental variability or unstable model convergence. Please clarify whether the evaluation protocols differ and provide evidence, such as multi-seed results or convergence analyses, to establish the reliability of the reported improvements.
Questions for authors
- What are the exact regression-head architectures and parameter counts? Why do Table 1 and Figure 2 differ—were splits, seeds, checkpoints, and settings identical?
- What evidence supports transfer to independent cohorts or substantially different task distributions, beyond backbone compatibility?
- Did anatomical pretraining include downstream test subjects? If so, can the authors clarify the setting and provide subject-disjoint evaluation?
3 comments
For Reviewer Uvgp with the Question 2
For Question 2, we thank the reviewer for this important question. Our evaluation goes beyond compatibility with different pretrained backbones by including an independent cohort evaluation on OASIS and multiple downstream prediction tasks.
Specifically, Stage-1 anatomical pretraining uses only ADNI images without diagnostic or cognitive labels. In addition to the downstream evaluation on ADNI, we further evaluate AGQ on OASIS, an independent external cohort, where it improves AD classification accuracy over mean pooling on three of the four pretrained encoders (+1.5 to +8.3 percentage points; Table 1).
Importantly, this evaluation is intended to examine the generalizability of the proposed aggregation framework beyond the original ADNI cohort, rather than merely demonstrating compatibility with different encoder architectures.
Furthermore, our evaluation covers multiple downstream prediction targets, including AD diagnosis, chronological age, MMSE, ADAS11, ADASQ4, and RAVLT-immediate. As illustrated in Figure 3, AGQ exhibits distinct task-relevant regional attribution patterns across these prediction targets, which are consistent with established neuroimaging findings. These observations suggest that its anatomically structured representations can capture different task-related associations rather than relying exclusively on a fixed set of predictive regions.
Together, the independent OASIS evaluation, multiple downstream tasks, and results across four pretrained encoders provide complementary evidence of the generalizability of AGQ across datasets, prediction targets, and backbone architectures.
For Reviewer Uvgp with the Question 3
For Question 3, we thank the reviewer for raising this important question. We would like to explicitly clarify that downstream test subjects are excluded before any model training or Stage-1 anatomical pretraining is performed.
All datasets used in our experiments consist of baseline scans without repeated subjects. The test set is separated first, and no test-subject images or information are used during Stage-1 regional GMV pretraining, Stage-2 downstream training, or model optimization.
Although Stage-1 pretraining does not require diagnostic or cognitive labels, this does not mean that held-out test subjects are included. Anatomical pretraining is performed exclusively on the designated training subjects, ensuring strict subject-level separation throughout the training and evaluation pipeline.
Therefore, our experiments do not follow a transductive adaptation setting, and the reported test results reflect generalization to entirely unseen subjects. We will explicitly clarify this data-splitting procedure in the revised manuscript to eliminate potential ambiguity.
For Reviewer Uvgp with the Question 1
For Question 1, we thank the reviewer for raising these important questions regarding the regression-head implementation, parameter accounting, and experimental reproducibility.
(i) Regression-head architecture and parameter counts. We clarify that the downstream regression head is implemented as a lightweight multilayer perceptron (MLP). Specifically, its architecture is:
BatchNorm1d(d) → Linear(d, h) → GELU → LayerNorm(h) → Linear(h, 1)where h=max(⌊d/2⌋,32) and d denotes the encoder feature dimension. The corresponding trainable parameter count is dh+2d+4h+1, including the learnable affine parameters of the BatchNorm and LayerNorm layers.
We will explicitly add the MLP architecture and its hidden-dimension definition to the revised manuscript to improve reproducibility.
(ii) Differences between Table 1 and Figure 2. We clarify that both Table 1 and Figure 2 report average performance over five data splits. However, the two experiments use separately generated sets of five data splits, rather than the same five partitions. Therefore, although the number of splits is identical, the actual data partitions differ, which can lead to numerical differences in the reported average performance.
Importantly, other experimental settings, including random seeds and model checkpoints, are kept consistent between the two experiments. Thus, the numerical differences primarily arise from the independently generated data partitions, rather than changes in the random seed, model initialization, or checkpoint selection.
Table 1 presents the main performance evaluation, whereas Figure 2 focuses on controlled architectural ablation experiments to investigate the contributions of different components of AnatoQ. We will clarify the use of independently generated data splits and the consistency of the other experimental settings in the revised manuscript to improve transparency and reproducibility.