- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
P-MEGA combines a scan-conditioned graph autoencoder with a probabilistic low-rank participant effect inferred from multiple scans. Experiments on HCP and PNC report improved connectome reconstruction, and target-excluded support-swap tests show that same-participant support improves residual reconstruction over matched or random donors. The paper also examines downstream prediction and network-level organization of the learned effects.
Critical strengths
- The target-excluded support-swap experiment provides meaningful evidence of participant-specific information beyond demographic matching and generic corrections.
- Evaluation on two cohorts with participant-separated cross-validation, multiple training seeds, and retrained component ablations supports the reported reconstruction gains.
Critical weaknesses
- The interpretation of the participant effect as a distinct stable trait requires further justification because the scan-conditioned population pathway can also retain participant information.
- Training with a fixed support count within each cohort leaves the explicit log K dependence in Equation (7) underdetermined at other support sizes.
- The central transfer experiment does not establish the method's comparative advantage. Table 3 demonstrates participant-specific information by changing support identity within P-MEGA, but does not compare against the deterministic participant variant or LMM-VAE under the same target-excluded support protocol.
- The reliability of the probabilistic component's gain is unclear. Table 2 reports lower MSE than the deterministic variant in both cohorts, but only provides point estimates; uncertainty estimates for these differences are needed to assess how consistently probabilistic modeling improves reconstruction.
- Individual fingerprint reproducibility is not directly demonstrated. Section 4.6 reports stability of network-pair rankings of across-participant variability, which does not establish that the same participant's projected effect remains stable across model fits or support subsets.
- The reconstruction advantage is uneven across cohorts. Table 1 shows a 6.2% MSE improvement over the strongest HCP baseline, but only 0.6% MSE and 0.003 correlation improvements over Graph-AE on PNC, limiting the demonstrated benefit in the second cohort.
Questions for authors
- How does P-MEGA compare with the deterministic participant variant and LMM-VAE using identical target-excluded support sets?
- How consistent are the Table 2 gains over deterministic and direct high-dimensional effects across seeds and folds, with paired uncertainty estimates?
- How stable is each participant's projected effect across training seeds and disjoint support subsets, beyond the aggregate variability-map agreement?
- Is the small PNC advantage over Graph-AE consistent across paradigms, and what are its paired participant-level confidence intervals?
- Are the cognitive gains from adding the participant code reliable under paired comparisons, and do they persist with frozen encoders?
5 comments
Response to Reviewer WYeg (2/4)
W3 / Q1. Comparison under identical target-excluded support sets
Table R1 reports this comparison. In every target-excluded row the participant term is computed from the same support set: all of the participant's other paradigms (8 support scans in HCP, 2 in PNC). For LMM-VAE the participant intercept is the average of the random-effect encoder's posterior means over those scans.
Table R1. Five-fold OOF reconstruction (mean ± SD over three training seeds). The paradigm template and General FC are parameter-free and are reported without a seed SD.
| Method (what the participant term sees) | HCP MSE ↓ | HCP r ↑ | PNC MSE ↓ | PNC r ↑ |
|---|---|---|---|---|
| Paradigm template (no participant term) | 0.03075 | 0.695 | 0.06531 | 0.502 |
| Graph-AE (no participant term) | 0.02501 ± 0.00135 | 0.698 ± 0.002 | 0.03858 ± 0.00012 | 0.596 ± 0.001 |
| Graph-VAE (no participant term) | 0.03268 ± 0.00115 | 0.668 ± 0.002 | 0.04178 ± 0.00024 | 0.561 ± 0.001 |
| LMM-VAE, as in Table 1 (all scans incl. target) | 0.02116 ± 0.00045 | 0.705 ± 0.006 | 0.04139 ± 0.00128 | 0.560 ± 0.007 |
| LMM-VAE, target-excluded | 0.02107 ± 0.00059 | 0.706 ± 0.008 | 0.04415 ± 0.00133 | 0.522 ± 0.008 |
| General FC (other scans only, target-blind) | 0.02727 | 0.721 | 0.05804 | 0.582 |
| P-MEGA, population only | 0.02972 ± 0.00009 | 0.563 ± 0.007 | 0.04847 ± 0.00033 | 0.407 ± 0.005 |
| P-MEGA deterministic variant, target-excluded | 0.02212 ± 0.00017 | 0.712 ± 0.006 | 0.04119 ± 0.00011 | 0.542 ± 0.003 |
| P-MEGA, target-excluded | 0.01991 ± 0.00008 | 0.727 ± 0.004 | 0.03849 ± 0.00007 | 0.597 ± 0.002 |
| P-MEGA, complete (Table 1) | 0.01985 ± 0.00008 | 0.728 ± 0.001 | 0.03836 ± 0.00005 | 0.599 ± 0.001 |
Against LMM-VAE. Under identical target-excluded support, P-MEGA is 5.5% below LMM-VAE in MSE in HCP and 12.8% below it in PNC, with higher edge-wise correlation in both cohorts (0.727 against 0.706; 0.597 against 0.522).
Against the deterministic participant variant. With the deterministic variant's participant code computed from the same support scans, P-MEGA is 10.0% below it in MSE in HCP and 6.6% below it in PNC, with higher correlation in both cohorts (0.727 against 0.712; 0.597 against 0.542). Excluding the target raises the deterministic variant's MSE by 6.4% in HCP and 5.5% in PNC relative to its complete condition (Table R4), against 0.3% for P-MEGA in both cohorts.
W4 / Q2. Paired uncertainty for the Table 2 gains
Table R4 reports the deterministic, direct high-dimensional and no-participant-random-effect variants retrained with three seeds on the same five folds as the main model, together with paired participant-level differences against P-MEGA. These values replace the corresponding rows of Table 2. Table 2 reported a single training seed for each variant and for a separately trained full-model reference; Table R4 reports means over the three main-model seeds and uses the main model of Table 1 as the reference, which is why both the variant and the reference values differ from Table 2.
Table R4. MSE in the complete condition (mean ± SD over three training seeds) and paired difference (variant minus P-MEGA) with 95% participant-bootstrap CI. Positive differences favor P-MEGA.
| Variant | HCP MSE ± SD | HCP Δ [95% CI] | PNC MSE ± SD | PNC Δ [95% CI] |
|---|---|---|---|---|
| P-MEGA | 0.01985 ± 0.00008 | — | 0.03836 ± 0.00005 | — |
| Deterministic participant effect | 0.02079 ± 0.00013 | +0.00094 [0.00083, 0.00101] | 0.03906 ± 0.00011 | +0.00070 [0.00059, 0.00083] |
| Direct high-dimensional effect | 0.02054 ± 0.00010 | +0.00070 [0.00062, 0.00075] | 0.03897 ± 0.00007 | +0.00061 [0.00052, 0.00069] |
| No participant random effect | 0.02603 ± 0.00043 | +0.00618 [0.00602, 0.00637] | 0.03996 ± 0.00014 | +0.00160 [0.00145, 0.00172] |
P-MEGA has lower MSE than all three variants in both cohorts, and all six intervals exclude zero. Across seeds, every difference is at least six times the larger of the two seed SDs. Across folds, each difference has the same sign in all five folds. The static-adjacency and dynamic-focused variants were retrained in the same way (MSE 0.02102 ± 0.00027 and 0.03533 ± 0.00016 in HCP; 0.03934 ± 0.00009 and 0.04508 ± 0.00013 in PNC), so every row of the revised Table 2 is a three-seed mean against the main model, and the six models are ranked identically in both cohorts.
Response to Reviewer WYeg (3/4)
W5 / Q3. Stability of each participant's projected effect
Table R3 reports both analyses: across training seeds and across disjoint support subsets.
Table R3. Individual-level reproducibility of the projected participant effect.
| Measure | HCP | PNC |
|---|---|---|
| Across seeds (same participants, same split, support fixed): within-person r / between-person r, centred | 0.714 / 0.014 | 0.682 / 0.010 |
| Network-pair ICC(2,1) across seeds, median [quartiles] | 0.752 [0.715, 0.780] | 0.769 [0.734, 0.799] |
| Disjoint paradigm subsets (same model): within-person r / between-person r, centred | 0.552 / 0.002 | 0.386 / 0.001 |
Across training seeds. Within each outer fold, the held-out participants and their support (all of the participant's scans) are fixed, and the three training seeds give three fits. For each fit we compute in connectome space and subtract the mean effect of that fold's training participants. Within-person r is the Pearson correlation across edges between the same participant's centred effects under two seeds; between-person r is the same correlation for different participants. Values are averaged over 15 comparisons (5 folds × 3 seed pairs). A participant's effect correlates at 0.714 (HCP) and 0.682 (PNC) between independently trained models, while the between-person value is near zero (0.014 and 0.010).
At the network level. ICC(2,1) (two-way random effects, absolute agreement, single measure; Shrout & Fleiss, 1979) is computed with participants as targets and the three training seeds as raters. For each participant and each network pair, the summary is the mean absolute value of the centred effect over the edges in that block; within-network blocks are included, giving 66 pairs in HCP and 105 in PNC. ICCs are computed within each fold on its held-out participants; we report the median over network pairs, averaged over the five folds. The median is 0.752 in HCP and 0.769 in PNC.
Across disjoint support subsets. With the model fixed, a participant's paradigms are split into two disjoint subsets and the effect is inferred from each (11 randomly sampled splits per model in HCP, 165 comparisons; 3 splits per model in PNC, 45 comparisons). Effects are centred as in the across-seed analysis, by subtracting the mean effect of the fold's training participants inferred from the same paradigm subset. Averaged over all splits, a participant's effect agrees across disjoint data (0.552 in HCP, 0.386 in PNC), while the between-person value is near zero (0.002 and 0.001).
Table R3 will be added to Section 4.6.
W6 / Q4. PNC advantage over Graph-AE by paradigm
Yes. Table R5 gives paired participant-level differences between complete P-MEGA and Graph-AE in PNC for each paradigm.
Table R5. P-MEGA (complete) minus Graph-AE in PNC. Negative ΔMSE and positive Δr favor P-MEGA. Intervals are 95% participant-bootstrap CIs; p is from the participant-level permutation test with 1,000 permutations.
| Paradigm | ΔMSE [95% CI] | p | Δr [95% CI] |
|---|---|---|---|
| Emotion identification | −0.00021 [−0.00033, −0.00009] | ≤ 0.001 | +0.0030 [+0.0022, +0.0039] |
| n-back | −0.00017 [−0.00027, −0.00007] | ≤ 0.001 | +0.0029 [+0.0020, +0.0038] |
| Rest | −0.00027 [−0.00042, −0.00012] | ≤ 0.001 | +0.0028 [+0.0019, +0.0038] |
| All paradigms | −0.00021 [−0.00030, −0.00014] | ≤ 0.001 | +0.0029 [+0.0023, +0.0035] |
The advantage has the same sign and a similar size in all three paradigms, and every interval excludes zero for both MSE and correlation. Table R5 will be added to Appendix D alongside the per-paradigm results.
In PNC, the advantage over Graph-AE extends beyond reconstruction. P-MEGA's scan representation gives the highest sex AUROC among the PNC models (0.724, against 0.679 for Graph-AE), and adding the participant code gives the lowest reading-achievement RMSE (0.960 for , against 0.976; Table 4). The participant pathway carries person-specific information in this cohort: same-participant support explains the held-out target residual better than a matched donor by 0.0346 in residual r [0.0325, 0.0371] (Table R6, in our response to Reviewer sYH3), and adding to lowers reading-achievement RMSE under both fine-tuned and frozen encoders (Table R7).
Response to Reviewer WYeg (1/4)
Thank you very much for the review and for framing each concern as a concrete check. All five questions name a comparison or an uncertainty estimate that can be computed, and we have computed every one of them. In brief: under identical target-excluded support P-MEGA stays ahead of LMM-VAE and the deterministic variant, every paired interval for the ablation gains excludes zero, individual effects are reproducible across seeds and disjoint data, and the PNC advantage over Graph-AE has the same sign in all three paradigms.
W1. Participant effect and the population pathway
The population pathway is scan-conditioned and can carry participant information, as Section 3.4 notes. Three results characterize what the participant effect holds in addition.
It adds information beyond the population pathway. In the support swap the target scan and its population prediction are fixed, so whatever that pathway retains is identical in every condition. Same-participant support still explains the target residual better than matched or random support in both cohorts (Table 3; recomputed in Table R6, in our response to Reviewer sYH3).
It is not tied to the scan it helps reconstruct. Inferred only from the participant's other paradigms, the effect recovers nearly all of the reconstruction gain: excluding the target changes MSE by 0.3% in both cohorts (Table R1).
It is stable for the individual. The same participant's projected effect correlates at 0.714 (HCP) and 0.682 (PNC) across independently trained models, against 0.014 and 0.010 between participants, and it agrees more within than between people when inferred from disjoint paradigm subsets (Table R3).
W2. Fixed support count and the log K input
Correct. Training uses each participant's full scan set, so the support count is constant within a cohort (9 in HCP, 3 in PNC), and the count coefficient in Eq. (7) is identified only at that count, as Appendix H.5 states.
Table 1 is evaluated at the training count. The target-excluded rows of Table R1 are evaluated one count below it (8 support scans in HCP, 2 in PNC), and MSE changes by 0.3% in both cohorts relative to the complete condition. Table 3 averages over support counts starting from one. The support-swap comparison in Table 3 holds support count and paradigm composition equal across true, matched and random support, so the log K input is identical in the conditions being compared and the contrast depends only on whose scans are encoded. The evidence vector itself is a mean over the support scans and is defined at any count.
Table R8 reports the target-excluded MSE of the current model at each support count. The error decreases monotonically with the support count, from 0.02408 with one support scan to 0.01991 with eight in HCP, with most of the change reached by four (0.02047), and from 0.04106 with one to 0.03849 with two in PNC. The exact posterior of Appendix H.3 is defined at every support count without a learned count coefficient; with the trained model, its target-excluded error falls monotonically from 0.02043 at K = 1 to 0.01936 at K = 8 in HCP and is below the amortized error at every count (Table R2b, in our response to Reviewer NZMY).
Table R8. Target-excluded MSE of P-MEGA by support count K, averaged over the support subsets used in Table 3 (mean over three training seeds). The K = 8 (HCP) and K = 2 (PNC) entries are the target-excluded rows of Table R1, shown with their seed SD.