- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work proposed BrainLRR to combine ROI-profile masking with low-rank regularization of subject representations. It is well-motivated, as reported and substantiated across four clinical tasks.
Critical strengths
The motivation is clear, and the method is evaluated on four clinical tasks, together with a BrainNetCNN generalization study.
Critical weaknesses
- BrainLRR performs worse than several competing methods on the PPMI PD-versus-HC task, but the paper does not adequately analyze this result.
- The paper does not sufficiently explain the Bernoulli masking choice or the use of the nuclear norm as a surrogate for rank.
Questions for authors
1- The colored boxes in Figure 2 appear to represent entities with different physical meanings. For example, the pink box seems to denote both the MLP classifier and the LRR loss. Please clarify the meaning of each color and box in the figure or caption.
2- In Eq. (1), please explain why the binary mask is sampled from a Bernoulli distribution. The authors should clarify how the Bernoulli parameter is determined and whether alternative masking strategies were considered.
3- In Eq. (6), the authors should provide a clearer mathematical justification for using the nuclear norm. Directly minimizing is an NP-hard and non-convex problem. Under suitable conditions, the nuclear norm, defined as the sum of singular values, serves as the convex envelope of the rank function over the unit spectral-norm ball, analogous to the role of the norm as a convex relaxation of the norm. This relaxation makes low-rank recovery computationally tractable. Please explain this rationale and clarify the conditions under which the nuclear norm is used as a surrogate for rank.
4- Under the “PPMI: PD versus HC” setting in Table 1, BrainLRR performs substantially worse than several SOTA methods. The authors should provide additional analysis and discussion of this result, including possible explanations related to dataset characteristics, preprocessing, hyperparameters, or statistical significance.
5- The tables appear incomplete, and their formatting is inconsistent. For example, in Table 1 under “ADNI: NC versus AD,” the best AUROC result is not highlighted in bold. Please carefully check all tables and ensure that the reported metrics, best results, and formatting conventions are complete and consistent.
6- In Table 2, 11 baseline methods are compared on ABIDE, whereas only the “BNT-style” method is included for the other three datasets. This limited comparison is insufficient to robustly demonstrate the effectiveness and generality of BrainLRR. Please include a broader and more consistent set of baseline methods across all datasets, or provide a clear justification for the current selection.
Q1: We thank the reviewer for pointing to this closely related work. Our regularizer adopts the OLÉ objective (Lezama et al., CVPR 2018), including its per-class norm floor (Δ = 1); we have revised the manuscript to state this explicitly Sec 3.6 and related Work to state this explicitly and to credit OLÉ for the formulation. Our contribution is not a new objective but a training pipeline for data-scarce FC diagnosis that combines input-level ROI-profile masking with this geometry-aware loss, guiding the model to separate diagnostic classes from limited data. Individual FC patterns vary substantially across subjects and acquisition sites, so models trained on limited clinical samples can overfit these non-diagnostic variations. LRR counters this with a low-rank inductive bias: subjects sharing a diagnosis are encouraged to occupy compact embedding subspaces, while within-class heterogeneity is retained. ROI-profile masking is complementary, regularizing the ROI dimension at the input level, whereas LRR regularizes the subject dimension in embedding space. Ablations confirm both contributions: on ABIDE, removing ROI masking lowers AUROC from 79.1 to 75.9, and removing LRR lowers it to 77.9 (Table 3). Both components are not specific to BNT, adding to BrainNetCNN improves AUROC on four tasks(Table11).
Q2: Metric and paired-effect inconsistencies. We thank the reviewer for identifying these issues. The FBNETGNN results in Table 2 were cited from Kan et al. (NeurIPS 2022, Table 1). We acknowledge the inconsistency among the originally reported accuracy, sensitivity, and specificity. To address this, we re-ran FBNETGNN with the authors' official implementation on the same ABIDE data and test split (5 runs; all metrics from the final epoch, as for our other models): AUROC 74.4 ± 1.7, Acc 69.0 ± 2.6, Sens 68.9 ± 6.8, Spec 69.1 ± 3.0. Table 2 is updated accordingly.
Paired-effect inconsistencies. Thank you for highlighting this issue. Table 2 reports the main evaluation, whereas Table 10 presents a separate matched evaluation on split 101. Its bootstrap intervals quantify test-subject sampling uncertainty conditional on that split and the fitted models. For NC–AD, the main evaluation favors BNT over BrainLRR (93.5 ± 1.6 vs. 91.6 ± 1.9 AUROC), corresponding to a BrainLRR–BNT difference of −1.90 points. The additional split-101 evaluation instead yields +3.32 points (95% BCa CI: [0.87, 6.91]; 65 test subjects). This interval supports a positive difference within that evaluation, but does not establish a consistent advantage across splits and runs. Both PD and NC–AD have small test sets (37 and 65 subjects, respectively). Limited sample sizes, together with potential heterogeneity across the four pooled PD cohorts, may contribute to variability. We have clarified the dataset’s performance in Section 4.2, paragraph 4 and Supplementary C5.
Q3.Foundation-model convergence and modality alignment. We thank the reviewer for raising this concern. The original 10-epoch fine-tuning budget was chosen for computational feasibility and is specified in Appendix B. To assess whether longer training would close the performance gap we extended BrainLM fine-tuning to 50 epochs with validation-based checkpoint selection. AUROC increased by 4.2 points on NC–AD FC and 1.4 points on PD time series, but decreased by 2.9, 0.6, and 3.3 points on ABIDE time series, ABIDE FC, and NC–MCI FC, respectively. All configurations remained far below BrainLRR on their corresponding tasks. Thus, longer training benefited some configurations but did not close the observed performance gaps under the evaluated settings.
For modality-appropriate inputs concern, We considered each model’s input requirements and evaluated closer alignment where feasible. In our Table1, we evaluated BrainLM with ROI time series to better match its pretraining input. AAL-424 was unavailable for ABIDE, so CC200 was used. On PD, BrainLM using its original AAL-424 atlas achieved 56.2 ± 3.0 AUROC, versus BrainLRR's 68.0 ± 2.3 using CC200. Additionally, the LLaMA adapter and matched FC encoder-only classifier achieved the same rounded four-task mean AUROC (70.8), Thus, the aggregate improvement is matched by the learned FC encoder alone, with no additional aggregate advantage from LLaMA in this configuration.
Overall, foundation-model gaps still persist under validated convergence and modality-appropriate inputs.