- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces PR-EC to estimate each person’s effective brain connectivity from resting-state fMRI. It first uses a self-supervised spatiotemporal attention model to estimate connectivity. It then combines estimates from similar participants to create a reference for each person. Finally, a refinement network uses this reference and data-quality information learned from the training set to adjust individual connections. The authors test disease classification on ABIDE-I, ABIDE-II, and ADHD200 and identify ASD-related connectivity differences that appear in both ABIDE datasets.
Critical strengths
1.The motivation is reasonable: subject-level EC from short, noisy rs-fMRI is unstable, and similarity-weighted borrowing from neighbors is a sensible alternative to a single global prior. The leakage-aware design deserves credit: references are drawn only from training folds, labels are not used for graph construction, and QC is not needed at inference.
- The cross-cohort analysis requires FDR-significant effects in the same direction in both ABIDE-I and ABIDE-II. That is a more defensible replication criterion than top-k overlap, and the paper candidly reports that top-k overlap is near zero.
Critical weaknesses
-
The paper never validates EC against any ground truth, such as directed-network simulations or known pathways. Its only evidence is classification.
-
The classification gains are marginal. On ABIDE-I, PR-EC’s ACC (60.39) is below FSTA-EC (60.86). In the ablation (Table 2), the full model versus no MPR/QSR changes by +0.9, +0.6 and +0.25 ACC across the three datasets, while fold SDs are about 5. On ABIDE-II, MPR alone (61.96) beats the full model (60.62).
-
There are no significance tests, and only one seed (42) is used.
-
Absolute performance (~60% ACC on ABIDE) is below what plain Pearson FC with a linear classifier typically reaches, and a plain FC baseline is absent even though FC is an input to the population graph.
-
The sensitivity analysis was done on test folds, which the authors acknowledge, and window length and epoch counts differ per dataset without a stated selection procedure.
-
The population reference uses phenotypic information that may be associated with diagnosis. This makes it unclear how much of the classification gain and the reported ASD differences comes from fMRI connectivity versus the additional phenotypes. Please specify the variables used in each dataset, report the proportion of neighbors sharing each subject’s diagnosis, and include an ablation using only age, sex, and site. Comparing group differences before and after refinement would also help assess whether the procedure amplifies diagnosis-related patterns.
-
Equations 46–47 use minibatch-averaged attention for feature fusion during training, whereas individualized EC is extracted from subject-specific attention. Individual attention therefore contributes to reconstruction through the batch average, rather than serving as a separate connectivity matrix for each subject. Please explain why this training objective supports the interpretation of individual attention as EC and compare it with subject-specific feature fusion.
-
Appendix B.3, Equations 74–75, appears to reuse A_tar for both the target EC and the perturbation matrix, making the definitions inconsistent with Equation 8 in the main text. Please correct the notation and clarify which formulation the implementation uses.
Questions for authors
- Which phenotypic variables were used on each dataset? What fraction of each subject’s top-K neighbors share its diagnosis, compared with the base rate? Please rerun classification and the ASD replication analysis using only age, sex and site in the phenotypic view.
- Please add a plain Pearson-FC baseline, report paired significance tests against FSTA-EC and the no-MPR/QSR variant, and report multiple seeds.
- Since training uses the minibatch-averaged W_I, why should the per-subject W read out at inference be subject-specific and directional? 4. Can you validate PR-EC on simulated data with known directed connectivity?
- How were window length, stride and epoch counts chosen per dataset? Was any of this done using test folds? Please correct Eqs. 74–75 to match Eq. 8.
6 comments
W3 & W4 & Q2. Pearson FC Baseline, Statistical Significance, and Multi-Seed Evaluation
Although PR-EC incorporates Pearson FC as one of the information sources for constructing the multimodal population similarity graph, directly using Pearson FC for disease classification also represents an important baseline comparison. Therefore, we added a Pearson FC + Linear SVM baseline, using the same subjects, data preprocessing, and cross-validation protocol as PR-EC.
To address the concerns regarding statistical significance and random seeds, we further conducted repeated ten-fold cross-validation with five random seeds (1, 3, 10, 42, and 123) on ABIDE-II (975 subjects), the largest dataset in our study. For PR-EC, the complete training pipeline was independently executed for each seed. In addition, based on the corresponding seed-level ten-fold mean results, we performed two-sided paired statistical tests comparing Full PR-EC against FSTA-EC and Initial EC.
Table R2. Multi-seed classification performance on ABIDE-II.
| Method | ACC (%) | AUC (%) | p (ACC vs. Full) | p (AUC vs. Full) |
|---|---|---|---|---|
| Pearson FC | 55.82 ± 1.01 | 57.59 ± 1.74 | \ | \ |
| FSTA-EC | 57.27 ± 2.99 | 61.58 ± 3.82 | 0.1173 | 0.1962 |
| Initial EC | 58.36 ± 0.82 | 63.16 ± 1.61 | 0.000071 | 0.0167 |
| Full PR-EC | 60.00 ± 0.81 | 64.80 ± 1.31 | \ | \ |
As shown in Table R2, across five random seeds, Full PR-EC achieved the highest mean ACC (60.00%) and AUC (64.80%), outperforming Initial EC by 1.64 percentage points on both metrics, with statistically significant differences (p = 0.000071 and 0.0167, respectively). It also exceeded Pearson FC by 4.18 and 7.21 points, and FSTA-EC by 2.73 and 3.22 points, respectively, although the latter differences were not statistically significant. These results support the effectiveness of the complete PR-EC framework while characterizing its variability across random initializations.
W5 & Q5. Hyperparameter Selection
Due to space limitations, the original paper did not sufficiently explain the rationale behind some of these choices, and we would like to provide further clarification here. First, the window length and stride were primarily determined by differences in rs-fMRI time-series lengths across datasets. Since scan durations vary among subjects in multi-site datasets, we adapted these settings according to the shortest valid time series after preprocessing in each dataset. This allows subjects with shorter sequences to be included in EC estimation while using overlapping windows to make better use of temporal information from longer recordings. Accordingly, slightly different window lengths and strides were adopted across datasets, rather than being optimized based on test-set classification performance.
The number of training epochs was mainly predetermined based on prior training experience and kept fixed throughout the main experiments. In addition, while reviewing our experimental configurations, we identified a typographical error in Appendix C.6 concerning the number of initial EC pretraining epochs for ABIDE-I. The actual setting was 81 epochs rather than 101 epochs, and we will correct this in the revised manuscript. I sincerely apologize if this has caused any confusion.
The sensitivity analysis presented in Figure 7 was conducted post hoc, after the main experimental configuration had been finalized, and was not used for hyperparameter selection in the main experiments. This analysis was intended solely to examine how model performance varies under different parameter settings, rather than to select the final configuration based on test-fold results.
W6 & Q1. Phenotypic Information and Its Impact on Classification and ASD Connectivity Analyses
We would like to clarify that PR-EC does not use diagnostic labels, symptom scores, or disease-specific questionnaires to construct the population similarity graph. The phenotypic inputs include Sex, FIQ, and PIQ for ABIDE-I/II, and Gender, Age, Full4 IQ, and Handedness for ADHD200. Our existing modality ablation (Figure 6) shows that combining PH and FC improves F1 to 61.10%, compared with PH-only (58.32%) and FC-only (60.92%) on ABIDE-I.
To further address this concern, we analyzed same-diagnosis neighbor proportions against training-set diagnostic base rates (Table R3). Higher diagnostic agreement among neighbors does not imply label usage, but may reflect disease-related similarities captured by non-diagnostic features. We also conducted an additional Age/Sex/Site phenotypic ablation across all three datasets, keeping other configurations unchanged, to assess the influence of phenotypic feature selection. Following the reviewer's suggestion, we have added the Age/Sex/Site phenotypic ablation and neighbor diagnostic consistency analysis to Appendix C.7 of the revised manuscript.
Table R3. Neighbor diagnosis consistency and classification performance under different phenotypic configurations.
| Dataset | PH setting | Same-diagnosis neighbors (%) | Base rate (%) | ACC (%) | AUC (%) |
|---|---|---|---|---|---|
| ABIDE-I | Original | 52.29 | 50.28 | 60.39 ± 5.12 | 66.85 ± 4.32 |
| Age/Sex/Site | 52.14 | 50.28 | 59.60 ± 4.70 | 64.60 ± 3.83 | |
| ABIDE-II | Original | 53.96 | 50.13 | 60.62 ± 5.14 | 66.83 ± 3.92 |
| Age/Sex/Site | 53.90 | 50.13 | 60.00 ± 4.66 | 66.33 ± 3.83 | |
| ADHD200 | Original | 56.17 | 54.16 | 58.62 ± 6.36 | 61.21 ± 5.85 |
| Age/Sex/Site | 57.21 | 54.16 | 58.24 ± 6.22 | 60.21 ± 6.93 |
As shown in Table R3, same-diagnosis neighbor proportions exceed the training-set base rates by 2.01–3.83 percentage points under the original setting. Replacing the original phenotypic features with Age/Sex/Site changes these proportions by only −0.15 to +1.04 points, suggesting that the observed diagnosis-related clustering among neighbors does not strongly depend on additional phenotypic features, such as IQ, in the original configuration. Meanwhile, the simplified setting reduces AUC by 2.25, 0.50, and 1.00 points across the three datasets, indicating that the original phenotypic features provide some downstream predictive benefits despite their limited influence on neighbor diagnostic consistency.
Furthermore, in response to the reviewer's comments, we examined the dependence of ASD-related connectivity findings on phenotypic configurations by comparing Initial EC, Original PH, and Age/Sex/Site in terms of between-group differences in connectivity and cross-cohort replication on ABIDE-I and ABIDE-II.
Table R4. ASD-related group differences and cross-cohort replication before and after refinement.
| EC representation | ABIDE-I mean |g| | ABIDE-II mean |g| | Replicated edges | ASD-enhanced | ASD-reduced |
|---|---|---|---|---|---|
| Initial EC | 0.09158 | 0.09927 | 202 | 101 | 101 |
| Full PR-EC (Original PH) | 0.09159 | 0.10221 | 213 | 111 | 102 |
| Full PR-EC (Age/Sex/Site) | 0.09158 | 0.10212 | 210 | 109 | 101 |
The results show that Initial EC, Original PH, and Age/Sex/Site identified 202, 213, and 210 cross-cohort replicated connections, respectively. Importantly, Age/Sex/Site retained 210 of the 213 connections (98.59%) identified under Original PH, all with consistent effect directions. The remaining three connections also showed no direction reversal but narrowly missed the FDR significance threshold in ABIDE-II. Moreover, mean absolute effect sizes remained nearly identical across the two refined configurations. These results support the robustness of ASD-related connectivity findings to phenotypic feature selection.
We sincerely thank the reviewer for their careful evaluation and constructive suggestions. We address each concern below. For clarity, as question number “4” appears twice in the review, we have renumbered the questions sequentially while preserving their original order and content. We appreciate the reviewer’s understanding.
W1 & Q4. Ground Truth Validation of EC
Actually, We have addressed this concern in detail in our response to Reviewer tigW's W1 & Q1, and summarize the key points and findings here. Our original evaluation focused on clinical datasets because individual-level EC ground truth is generally unavailable in real rs-fMRI data, while common simulation datasets lack the phenotypic and QC information required to evaluate the complete MPR/QSR framework. Nevertheless, we agree that the initial EC estimator's directional recovery capability should be independently validated.
Following your suggestion, we conducted additional five-fold out-of-fold experiments on four simulated networks (Sim1–Sim4) from Sanchez-Romero et al. (2019), with pretraining restricted to training subjects and ground truth used solely for evaluation (page 8, lines 385–387 and 423–431; page 9, Table 2).
Table R1. Individual-level directed connectivity recovery on simulated networks.
The results show that the initial EC estimator achieved directed AUPRC of 0.78–0.89 and direction accuracy of 63.89%–75.56% across four simulated networks, exceeding the 50% chance level. Symmetrization consistently reduced AUPRC, further supporting its directional recovery capability. Furthermore, we conducted an FC-guided MPR experiment on NetSim Sim21, the FC-guided MPR reference improved F1 from 0.58 to 0.66, reduced SHD from 5.90 to 5.02, and increased ground truth strength correlation from 0.22 to 0.37. Together, these results provide complementary ground truth evidence for the initial EC estimator and MPR, beyond downstream classification performance.
W2. Magnitude and Stability of Classification Performance Improvements
We thank the reviewer for highlighting the variation in module-level improvements. We emphasize that PR-EC aims to refine individualized EC representations using population and QC information without diagnostic labels, rather than directly optimizing classification. Accordingly, we report ACC, AUC, SEN, and F1 to assess downstream utility from multiple perspectives, rather than treating classification performance as direct evidence of EC estimation accuracy.
Furthermore, following Reviewer KKzu's suggestion, we conducted additional five-fold inductive experiments (see our response to Reviewer KKzu's Q1 and Table R4), with the initial EC estimator pretrained exclusively on training subjects. Full PR-EC improved mean AUC over Initial EC by approximately 2.1, 1.7, and 3.7 percentage points on ABIDE-I, ABIDE-II, and ADHD200, respectively. Although these gains vary across datasets and their 95% confidence intervals include zero, the inductive evaluation, ground truth connectivity recovery experiments, and clinical results provide complementary evidence for the utility of PR-EC in individualized EC representation learning.