- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work proposes BrainNorm, a normative foundation model trained on approximately 66,000 healthy T1-weighted scans to learn a latent space for a semantic atlas.
Critical strengths
The paper is well written, and the model outperforms fully fine-tuned baselines on age estimation, parcel identification, and disease classification.
Critical weaknesses
However, several concerns remain regarding atlas construction, anatomical coverage, model validity, and figure accuracy.
Questions for authors
- The rationale for combining the AAL3, JHU, and HO atlases to construct a unified brain atlas is unclear. Please explain why these atlases are considered complementary for achieving whole-brain coverage, whether this is an established practice, and whether the resulting atlas construction has been rigorously validated.
- The authors should clarify why 218 anatomical parcels are sufficient to represent the entire brain volume. Please provide evidence that these parcels provide adequate anatomical coverage and resolution, and clarify whether the parcellation has been reviewed or validated by experienced neuroscientists or physicians.
- The validity of the model’s claimed superiority is not sufficiently demonstrated. In Figure 4A, BrainNorm appears to underperform several other methods in terms of MAE, whereas the paper claims superior age-estimation performance compared with end-to-end supervised baselines across datasets. The authors should reconcile this apparent discrepancy and provide a more comprehensive experimental analysis, including clear comparisons, statistical significance, and an explanation of the evaluation protocol.
- The legend in Figure 5B does not appear to correspond to the curves shown in the figure. In particular, the purple and green curves indicated in the legend cannot be identified in the plotted image. Please verify and correct the legend and figure.
3 comments
Response (Continued)
Q3: Regarding MAE plot
- Thanks for raising this concern. We would like to clarify the reading of Fig 4A. The apparent confusion comes from the orientation of the MAE axis in the radar plot. All radar plots in the manuscript follow one convention: a point further from the centre means better performance. To follow this convention, the MAE axis is inverted, so a model plotted nearer the outer ring has a lower MAE. We have clarified this in the figure’s caption of the revised manuscript.
- These results are also reported in the Supplementary Table A11. For clarity, we again report these results of MAE across cohorts below:
| Model | UKB | MCSA | ADNI | AIBL | MIRIAD | NIFD | PPMI |
|---|---|---|---|---|---|---|---|
| 3D-ViT | 4.23 | 9.06 | |||||
| BrainIAC | 6.76 | 18.49 | |||||
| BrainMVP | 4.15 | 4.70 | |||||
| BrainHarmony | 4.15 | 5.05 | |||||
| RadFM | 4.83 | 5.55 | |||||
| NeuroVFM | 4.25 | 5.93 | |||||
| Neuro-JEPA | 4.64 | 6.24 | |||||
| MedicalNet | 4.16 | 8.75 | |||||
| y-Aware | 4.17 | 5.43 | |||||
| BrainNorm (No FT) | 4.14 | 3.94 | |||||
| BrainNorm (CN-only FT) | 4.69 | 3.66 |
- Regarding the evaluation protocol, as mentioned in Sec 4.3, all the foundation/ pretrained models considered as baselines were finetuned end-to-end for age prediction task. Whereas for BrainNorm, it is evaluated in two ways: (i) freeze the pretrained model weights and directly perform retrieval-based age estimation (No FT), or, (ii) finetune the model with only the CN subjects of the downstream cohorts using the same pretraining objective and then freeze the weights and perform retrieval-based age estimation (CN-only FT).
- For statistical significance check, we report delta MAE, 95% confidence interval, and p-value in Appendix Fig. A2 of the revised manuscript for all downstream cohorts across all baselines for age prediction. On ADNI, BrainNorm without fine-tuning yielded lower MAE than all baselines (p < 0.05). With fine-tuning, BrainNorm achieved lower MAE than all pretrained baselines on AIBL, MIRIAD, NIFD and PPMI (p < 0.05). Numerous comparisons also reached p < 0.001, as detailed in the figure.
Q4: Regarding few-shot plot
Thanks for raising this concern. We would like to clarify the legend and plot in Fig 5B. For all the baselines, few-shot results are plotted as curves in shades of grey. Whereas, for BrainNorm, the few shot results are plotted as scatter plot, i.e., the circles indicate Finetuned+LP, triangles indicate Pretrained+LP, and, the color of these circles and triangles differentiates the representations, i.e., green indicate BrainNorm_M1 and purple indicate BrainNorm_M2. We have also updated the legend for better readability to avoid any confusion in the updated manuscript. Thank you for this suggestion.
We thank the reviewer again for the constructive assessment. We hope that our response will address your concerns. If you have any other questions, we will be happy to discuss them with you.
Follow-up
Dear Reviewer 58BD,
Thank you once again for your thoughtful and constructive review. We sincerely appreciate the time and care you have taken in evaluating our work. We have updated the manuscript with your suggestions. As the discussion period is nearing its end, we would be very grateful if you could let us know if any concerns remain. We would be happy to clarify anything further.
Best Regards,
Authors
Response to Reviewer 58BD
We thank the reviewer for their time and constructive feedback, and for recognizing the paper’s writing quality and BrainNorm’s performance across the evaluated tasks. We address your concerns below and welcome all suggestions in refining the manuscript.
Q1,2: Regarding atlas combination and coverage
Across datasets, we see nearly complete coverage of the whole-brain patches processed by BrainNorm. We have included this analysis in Appendix Table A2 of the revised manuscript.
References: