- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors introduce BrainSaber which is a novel framework for the generation of fMRI brain atlases. It relies on a pretrained autoencoder enabling "reconstruction-based information decomposition" (RID). Through a structured method of masking, reconstructions of the autoencoder are compared between single and double patches which aims to decompose reduntant, unique, and synergistic contributions. These in turn appropriately inform a graph which finally is used for clustering into parcels. This constitutes a novel approach to the creation of brain atlases and the authors evaluate their atlases in a broad set of assessments, which includes downstream utility. Specifically, parcels are shown to have strong properties using standard metrics (such as separability, homogeneity, repeatability) as well as enabling improved predictive performnace.
Critical strengths
The paper takes a fresh and novel approach to brain atlases, which are very widely used but (to my knowledge) their generation does not enjoy nearly the same amount of attention as many other branches. Second, the authors provide a broad set of evaluations.
Critical weaknesses
- The contribution of RID itself does not seem to be validated, e.g. by running the entire pipeline exactly as is but instead slotting in something like standard FC instead of RID
- For some evaluations the paper does not make it clear where the large improvements come from. Somewhat similar to 1, but I can't really tell in the comparison of BrainSaber to Schaefer atlas what is being compared; is it truly only the parcels which are different? If so, deltas of +7% are in my experience fairly unheard of; after all, only the boundaries are moved around here. Similarly for backbone performance, while the paper has interesting ideas for the atlas generation, the autoencoder does not seem special - are general setup differences (eg number of frames) driving this effect? I cant tell.
Questions for authors
- Could the authors try to isolate the contribution of RID itself (see weakness 1)
- Could the authors add appropriate controls for the downstream evaluations? How controlled is the comparison to schaefer and to the other backbones?
- Fig 11 shows the gain from a single patch is tiny. But this seems to form the basis for their atlas creation. I would expect this gain to be mostly driven by spatially local information; would it be possible to see the gain based on proximity? And if long-range gain on this metric is low, what does that imply for the captured "global and long range information flow" (fig 1) of the atlas
10 comments
Response to Q3: Distance-Resolved Reconstruction Gains
Q3. Single-patch reconstruction gain as a function of distance
We performed a distance-resolved analysis using 101 validation participants, 100 distinct source locations per participant, and 12 evaluation windows. Source and scored target patches both contained 64/64 valid voxels, and the visible source was excluded from evaluation. Distance was measured between patch centers.
Table R3-4 reports single-source normalized reconstruction error and BrainSaber's improvement over the all-masked condition. Gains are in percentage points, with 95% CIs from 10,000 participant-level bootstrap resamples.
Table R3-4. Single-patch reconstruction error and gain by source–target distance.
| Distance group | Distance | BrainSaber error ↓ | Omni error ↓ | BrainSaber gain ↑, 95% CI |
|---|---|---|---|---|
| Near: immediate neighbors | 8–16 mm | 0.975 | 3.20 [1.83, 4.55] | |
| Intermediate: beyond immediate neighbors | 16–24 mm | 1.034 | 5.43 [4.49, 6.36] | |
| Intermediate: beyond immediate neighbors | 24–32 mm | 1.026 | 5.01 [4.43, 5.62] | |
| Farther: beyond immediate neighbors | 32–40 mm | 0.995 | 3.15 [2.84, 3.49] | |
| Farther: beyond immediate neighbors | 40–48 mm | 0.970 | 1.53 [1.38, 1.69] |
The distance groups are descriptive labels within the displayed 8–48 mm range. BrainSaber retains positive gains beyond the 26-neighbor region: improvements at 16–48 mm range from 1.53 to 5.43 percentage points, with all 95% CIs above zero. Thus, one visible patch provides additional predictive information for non-neighbor targets.
BrainSaber also has lower mean reconstruction error than Omni in every displayed bin. This supplementary comparison matches the visible spatial source footprint while retaining each model's native temporal context.
These results show that BrainSaber's reconstruction-derived connectivity extends beyond immediate spatial neighbors and captures predictive links to more distant, non-neighbor regions (16–48 mm).
Thank you to the authors for their comments and additional analyses.
Overall, it seems plausible that RID adds value. However, as things stand, I am keeping my current score, as I still don't find the results clear and interpretable:
-
RID/FC Controls: Thank you for the FC controls. For the dowstrean comparison (r3-2): likely due to small test sample sizes, errors on gains are really large (r3-3), which I assume to a significant degree relates to the splits used. Authors write "Ours uses the archived three-run Table 2 means. The new controls are point estimates from a separate fixed-split evaluation protocol." but consequently that just does not seem like a sufficiently robust evaluation for this setting. Also, how come the controls here are generally worse than schaefer in r3-3?
-
Eval controls: Thank you. Trend is quite consistent, but the CIs are informative, with 4 CIs including zero. I find the method interesting, but again, I don't think the evaluation scheme is strong enough here to understand when and to what degree the method actually helps.
-
Distance analysis: Could the authors please include the all-masked error per bin (or clarify the gain is absolute or relative %)? Why does error fall with distance, I'm not sure how to interpret this, combined with the Omni comparison having an error of approx 1.0 in every bin. The gain seems to shrink with distance - the authors claim global and long-information flow, but the results here only provide evidence of a small gain up to 40-48mm, so as it stands those claims need to be revised.
Response to Q1–Q2: RID Controls and Evaluation Protocols
We thank the reviewer for the constructive comments. We address the contribution of RID, the evaluation protocols, and the spatial extent of single-patch reconstruction gains below.
Q1. Isolating the contribution of RID with FC controls
We added FC embedding and Signal FC, which construct graphs using correlations between patch representations from the same frozen backbone and between patch-averaged BOLD time series, respectively. Both retain the final spectral embedding and spatial Ward clustering steps.
For cortical atlas-quality evaluation, all three methods use the same 300 construction participants and a separate cohort of 707 evaluation participants. At K=200, Ours achieves a lower within-parcel residual and a higher boundary merge cost than both controls on the original signals (Table R3-1).
Table R3-1. Cortical atlas quality at K=200.
These results support the benefit of reconstruction-derived connectivity over these two controls on the reported original-signal metrics.
We also report prediction results across five downstream tasks, using multi-resolution fusion at K=100, 200, 400, and 500 (Table R3-2).
Table R3-2. Downstream prediction with the FC controls.
Ours uses the archived three-run Table 2 means. The new controls are point estimates from a separate fixed-split evaluation protocol.
Q2. Controls for the backbone and atlas comparisons
Backbone comparison in the manuscript's Table 1. All models were evaluated on the same participants using the same 300 fMRI frames per participant, with identical downstream data splits and a common linear-probe hyperparameter selection procedure. We retained each model's native input configuration: BrainSaber used three 100-frame windows, DCA one 300-frame input, and SwiFT and NeuroSTORM fifteen 20-frame windows each. The backbones remained frozen, and their feature outputs were mean-pooled into participant-level representations. Thus, BrainSaber received no additional frames or observations.
Atlas comparison in the manuscript's Table 2. FC features are computed from the mean time courses of ROIs defined by each atlas. In the current main-text Table 2, all methods share participant splits, common cortical support, the four-resolution ROI–FC pipeline at K=100, 200, 400, and 500, and predictor-selection rules. The comparison therefore evaluates atlas-defined parcellations and their resulting FC features under a common downstream evaluation protocol.
As supplementary evidence on the magnitude of the reported gains, Table R3-3 summarizes a post-hoc analysis of the archived three-run Table 2 predictions. We performed 10,000 subject-cluster bootstrap resamples, sharing resampling weights for the same subject across methods and runs.
Table R3-3. Supplementary uncertainty analysis of the archived three-run Table 2 comparison with Schaefer.