- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents a task-driven multimodal deep learning framework for infant cortical parcellation. Its main contributions lie in incorporating cross-subject homogeneity, spatial continuity, and local boundary consistency into the optimization of group-level infant cortical parcellation. Overall, the paper is well structured, the illustrations are clear, and the experimental results are convincing. I consider this a highly competitive work.
Critical strengths
- The two specially designed loss functions are well motivated by the practical requirements of the task and are supported by relatively comprehensive experimental evidence.
- The contributions are not entirely dependent on the specific architecture of SABER, as the proposed loss functions demonstrate a certain degree of transferability and can be incorporated into other clustering frameworks.
Critical weaknesses
- The authors claim to use the Hausdorff distance to evaluate the anatomical alignment between the predicted parcellation boundaries and Brodmann area boundaries. However, the actual metric appears to be a one-sided average nearest-boundary distance rather than the standard Hausdorff distance. Consequently, the improvement in anatomical alignment brought by LBoundary in Table 3 may not necessarily be attributed entirely to more accurate boundary localization. It could also be partially explained by changes in the distribution or complexity of the predicted boundaries.
- Several major technical components of SABER are closely related to existing approaches. Specifically, multi-layer graph mutual learning and vertex-level weighting can be viewed as a combination of established multimodal fusion techniques. The core idea of extends existing homogeneity objectives to individual-level features while incorporating a heuristic dynamic spatial constraint. Similarly, extends the existing Active Boundary Loss to cortical parcellation with additional local gradient-based weighting. Although these designs are well motivated and experimentally effective, it remains unclear to what extent they introduce fundamentally new insights from a general machine learning perspective. I would encourage the authors to further clarify the essential differences between the proposed loss functions and existing spatial regularization and boundary optimization methods.
3.Some minor errors may cause confusion for readers:
- In the legend at the upper-left corner of Figure 1, the authors appear to have mixed up the subscripts, resulting in inconsistent labeling of the FCN and MSN modalities.
- The paper reuses the notation to represent two entirely different probability distributions, which may lead to ambiguity and confusion.
Questions for authors
The proposed model ultimately produces a single age-independent group-level cortical parcellation map covering infants aged 0–800 days, which represents a substantial developmental span. Considering that cortical structural and functional organization may differ significantly between infants at two months and two years of age, I would like to understand whether truly learns a parcellation map that generalizes well across the entire infant population, or whether it instead produces a compromise solution that is better suited to certain developmental stages represented in the dataset.
6 comments
Response to Weaknesses 2: Clarification of Methodological Contributions
We agree that several building blocks in SABER are related to established techniques, and we do not claim that each component introduces an entirely new general-purpose machine learning primitive. Rather, our contribution lies in reformulating and tailoring these techniques to address three intertwined challenges in infant group-level cortical parcellation: cross-subject adaptability, spatial continuity, and sensitivity to potential biological boundaries.
Specifically, 'Dynamic Spatial-Weighted Generalized Homogeneity Loss' shifts the optimization objective of group-level parcellation from fitting group-averaged features to jointly accommodating the individual-level feature distributions of a large number of subjects, thereby explicitly accounting for substantial inter-subject variability in infants and aiming to obtain a more representative group-level parcellation. Moreover, instead of imposing a fixed spatial constraint uniformly across all parcels, it introduces parcel-specific adaptive spatial regularization, where each parcel's spatial weight is independently adjusted according to its fragmented status. This preserves spatial continuity without unnecessarily restricting parcel shapes, allowing anatomically plausible elongated areas to emerge.
Similarly, while 'Local Gradient-Weighted Active Boundary Loss' builds upon the Active Boundary Loss (Wang et al. 2022), its essential distinction lies in how boundary supervision is constructed and applied. Rather than determining boundaries solely based on potentially ambiguous feature differences in certain regions, it incorporates independent local-gradient-based boundary evidence from both structural and functional modalities to provide additional directional guidance for boundary localization. Meanwhile, it imposes stronger alignment constraints on high-probability boundaries while relaxing them in low-probability regions, thereby adapting the strength of boundary supervision to the reliability of the available boundary evidence.
Furthermore, our two-stage fusion strategy combines early intra-/inter-modal graph information exchange with late vertex-level modality weighting to capture both structural-functional associations and spatially heterogeneous complementary information. Importantly, these components are not merely combined to increase architectural complexity. Rather, they are designed to address complementary yet interrelated requirements of multi-modal cortical parcellation.
Our ablation studies further validate their respective contributions: individual-level homogeneity optimization improves cross-subject adaptability, dynamic spatial weighting effectively reduces parcel fragmentation, and incorporating independent local-gradient-based boundary evidence further improves anatomical alignment (Table 3 and Appendix Tables 10). Moreover, integrating the proposed losses into different existing clustering frameworks yields consistent performance gains (Table 4 and Appendix Tables 11–12), supporting their applicability beyond SABER.
Response to Weaknesses 3: Resolution of Notational Ambiguities
We have revised the manuscript accordingly to address the points raised.
[1] Chi Wang, Yunke Zhang, Miaomiao Cui, Peiran Ren, Yin Yang, Xuansong Xie, Xian-Sheng Hua, Hujun Bao, and Weiwei Xu. Active boundary loss for semantic segmentation. In Proceedings of the AAAI conference on artificial intelligence, pp. 2397–2405, 2022.
Response to Question 1: Age-stratified Evaluation of Group-level Parcellation Applicability Across Entire Developmental Stages (1/3)
We thank the reviewer for this insightful suggestion, which motivated us to further investigate the effectiveness of the 'Dynamic Spatial-Weighted Generalized Homogeneity Loss' across different developmental stages. We conducted additional age-stratified evaluations at a parcellation resolution of 400. Specifically, the test set was divided into six age groups: 3M (0–144 days), 6M (145–223 days), 9M (224–318 days), 12M (319–410 days), 18M (411–591 days), and 24M (592–800 days), after which we conducted a two-part experimental evaluation:
i) We quantified the homogeneity of group-level parcellations generated by all competing methods across each age group in the test set, with all parcellations trained on the full training set (0-800 days), to first assess whether SABER achieves better age-stratified performance than other methods.
ii) We further conducted a more in-depth experiment by dividing the training set into the corresponding six age groups and independently training a model on each group to obtain age-specific group-level parcellations. We then evaluated each resulting parcellation across all six test age groups to further investigate whether a unified parcellation represents a compromise or can instead provide robust performance across different developmental stages.
We sincerely thank the reviewer for taking the time to read our manuscript so carefully. The question raised is highly important and insightful, and has motivated us to further investigate the effectiveness of our proposed method.
Response to Weaknesses 1: Recomputation of the Anatomical Alignment Evaluation Metric
We agree that, based on its computational definition, the metric originally reported in our manuscript is a one-sided average nearest-boundary distance rather than the standard Hausdorff distance. We adopted this metric from Schaefer et al. (2018), who used it to assess the alignment between anatomical and parcellation boundaries and referred to it as the average Hausdorff distance. We therefore followed the same terminology. To address the reviewer's concern, we recalculated anatomical alignment using the standard symmetric Hausdorff distance.
Specifically, for each Brodmann area, we identified all parcels overlapping with it, merged these parcels, extracted the contour of the resulting region, and calculated the symmetric Hausdorff distance between this contour and the corresponding anatomical boundary.
---- Rebuttal table 1: Quantitative assessment of anatomical alignment using standard Hausdorff distance ----
As shown in the Rebuttal table 1, SABER still achieves the best anatomical alignment among the compared methods. However, we also observe that the standard Hausdorff distance is highly sensitive to outliers and noise, as it is determined by the maximum nearest-boundary distance between the two sets of boundary vertices. Consequently, methods with fragmented parcellations tend to perform particularly poorly under this metric, as even a few spatially isolated boundary vertices can substantially increase the Hausdorff distance. In contrast, the average nearest-boundary distance is more robust to such outliers and may therefore provide a more representative assessment of the overall boundary alignment. We will incorporate these additional results and revise the corresponding descriptions in the manuscript accordingly.
[1] Alexander Schaefer, Ru Kong, Evan M Gordon, Timothy O Laumann, Xi-Nian Zuo, Avram J Holmes, Simon B Eickhoff, and BT Thomas Yeo. Local-global parcellation of the human cerebral cortex from intrinsic functional connectivity mri. Cerebral cortex, 28(9):3095–3114, 2018.