- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This papaer introduce a framework called FunctionalMap and it is designed to model brain activity across different individuals, even when dealing with diverse or messy intracranial recordings. Instead of relying on traditional anatomical locations, it learns functional coordinates from neural signals. To address variations in electrode placement, channel count, and regional coverage across subjects, the authors train a CNN-based encoder with region-supervised contrastive learning to map short LFP segments into a shared 32-dimensional embedding space. These embeddings act as channel identifiers within a Transformer architecture tailored for cross-region neural signal prediction. The authors mainly evaluate the method on multi-region LFP recordings from 20 human subjects. The learned embeddings show region-specific clustering and can generalize to held-out channels. When used in the Transformer, they perform better than MNI coordinates and region labels for LFP reconstruction. The pooled model also outperforms several subject-specific baselines, including FIR, TCN, and GRU. The authors further test the method on spectral band-power prediction, a public human dataset, and mouse Neuropixels recordings for behavioral prediction. Overall, the paper explores whether learned functional coordinates can help combine neural recordings from different subjects, especially when their recording setups are quite different.
Critical strengths
- The paper considers cross-subject modeling of intracranial recordings with varying electrode placements, channel counts, and regional coverage. The proposed framework allows recordings from different subjects and sessions to be processed by a shared Transformer without subject-specific heads or fine-tuning. This provides a practical approach to aggregating heterogeneous neural recordings.
- The authors compare functional coordinates with MNI coordinates and region labels under the same Transformer architecture. The experiments show improvements in cross-region LFP prediction, with additional capacity-matched comparisons and replication on a separate public human dataset. These results provide empirical support for the usefulness of learned functional coordinates in the evaluated prediction tasks.
Critical weaknesses
- The paper mainly compares the proposed functional coordinates with MNI coordinates and region labels. Other baseline methods, such as FIR, TCN, and GRU, are only trained on individual subjects. However, there are already some related works, including Population Transformer [1], seegnificant [2], and BaRISTA [3], which also focus on modeling neural recordings across subjects with different electrode configurations. Although the authors mentioned these works in the Related Work section, they did not provide direct experimental comparisons. I understand that these methods may use different datasets or tasks, but I think comparisons with at least some of them would help better show the advantages of FunctionalMap. Also, the proposed method mainly combines existing contrastive learning and Transformer architectures. Without comparisons with these related methods, it is difficult to understand what the main methodological improvement is compared with previous studies.
- Another concern is about what the learned functional coordinates actually represent. The functional encoder is trained using region-supervised contrastive learning, which directly encourages signals from the same brain region to be close in the embedding space. Therefore, I am not fully convinced that the observed clustering results can show that the model has learned functional information beyond region identity or some basic spectral features. I think adding comparisons with simple spectral features or other self-supervised embeddings would make this claim more convincing. In addition, in Appendix A.15, some subjects are excluded when training the functional encoder, but the downstream Transformer is still trained using data from all subjects. Therefore, this experiment cannot fully demonstrate zero-shot generalization to completely unseen subjects. Since cross-subject modeling is one of the main motivations of this paper, I think a more strict leave-one-subject-out evaluation for the whole framework would be necessary.
References
[1] Chau, G., et al. (2025). Population Transformer: Learning Population-level Representations of Neural Activity. ICLR 2025.
[2] Mentzelopoulos, G., et al. (2024). Neural Decoding from Stereotactic EEG: Accounting for Electrode Variability Across Subjects. NeurIPS 2024.
[3] Oganesian, L., Hashemi, S., & Shanechi, M. M. (2025). BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural Activity. arXiv preprint.
Questions for authors
- I noticed that the paper discusses BaRISTA, Population Transformer, and seegnificant in Section 2, but none of them is included in the experiments. Since these methods also address cross-subject neural modeling with different electrode configurations, why were they not considered as baselines? I think comparing with at least some of them would help clarify the contribution of FunctionalMap.
- I find the learned functional coordinates interesting, but I wonder what they actually represent. Since the encoder is trained with region labels, could the embeddings mainly capture region-specific spectral features? Also, the coordinates are extracted from each channel's own signals, while MNI coordinates and region labels do not have access to this information. Would simple PSD or band-power features from the same 10-second segment achieve similar results? This seems like an important control.
- In Appendix A.15, the test subjects are excluded from encoder training, but the Transformer is still trained on all 20 subjects. So this seems to show encoder generalization rather than generalization of the full framework. Have the authors considered a LOSO experiment where both models are trained without the test subject?
- In Table 1, Pooled-FUNC performs much better than Single-FUNC. Could this improvement mainly come from having more training data? A pooled TCN or GRU baseline would help clarify this.
- How stable are the learned functional coordinates? For example, would different 10-second segments from the same electrode give similar embeddings? I am also curious whether they remain stable across rest, movement, or different recording sessions.
- Could the authors clarify the referencing scheme used for the micro-contact recordings? I wonder whether shared-reference effects or common neural activity could partly explain the cross-region prediction results. Would alternative referencing or temporal shifting change the results?
10 comments
Addressing Q1: Functional coordinates improve BaRISTA on the same cross-region task
Thank you for suggesting a comparison with an existing multi-subject model. We adapted BaRISTA (Oganesian et al., 2025) to reconstruct the masked VO region on the same dataset and chronological splits used in our main experiment.
We retained BaRISTA’s dilated CNN tokenizer, 250-ms patches, and 12-layer encoder with 64-dimensional tokens, four attention heads, and 10% dropout. We used 1-second windows at 1 kHz to match our original inputs and outputs, masked all VO channels, and trained directly on waveform reconstruction. The three coordinate variants used the same backbone, with about 0.83 million trainable parameters each.
| Coordinates | Left (), Pearson (mean ± SD) | Right (), Pearson (mean ± SD) |
|---|---|---|
| Region-MLP32 | ||
| MNI-MLP32 | ||
| MSC Functional32 |
Functional coordinates improved reconstruction over region labels in 17 of 18 subjects on the left (mean paired gain , Holm-adjusted ) and all 20 subjects on the right (gain , Holm-adjusted ). Compared with MNI, functional coordinates improved reconstruction in 15 of 18 subjects on the left (gain , Holm-adjusted ) and 13 of 20 on the right (gain , Holm-adjusted ). The gain over MNI was statistically significant only on the left. Although the adapted BaRISTA backbone scored lower overall than our original Transformer, both benefited from functional coordinates. Functional coordinates achieved the highest mean reconstruction score in both hemispheres with the adapted BaRISTA backbone, showing that the benefit is not specific to our Transformer.
The main contribution of FunctionalMap is a way to pool heterogeneous recordings across subjects using shared, signal-derived channel coordinates. This is particularly useful for our 50 µm microcontacts, where nearby contacts can have similar estimated MNI coordinates despite recording different signals. Our other evaluations also use small recording sites, specifically microwire LFPs from the public human movie-watching dataset and Neuropixels recordings from the Allen Visual Behavior dataset. For reference BaRISTA was originally trained and evaluated on Brain Treebank recordings from 0.8-mm sEEG contacts.
Addressing Q5: Functional coordinate stability across time, contacts, and movement
Thank you for your comment. We ran two new analyses using the frozen FunctionalMap encoder. In both, we report median cosine distances () across subjects, with 95% subject-bootstrap confidence intervals. Lower values indicate more similar coordinates.
1. Stability over time and across contacts
For each contact, we estimated its coordinate from the first 10 seconds, exactly as in the Transformer. We compared it with coordinates from up to eight later, non-overlapping 10-second clips, spanning up to about 10 minutes. We matched the time offsets across all three comparisons.
| Comparison | Left () | Right () |
|---|---|---|
| Same contact, later clip | 0.224 [0.178, 0.264] | 0.296 [0.191, 0.322] |
| Different contact, same region | 0.512 [0.411, 0.700] | 0.593 [0.534, 0.680] |
| Different contact, different region | 0.706 [0.624, 0.833] | 0.642 [0.573, 0.875] |
In all 20 subjects in each hemisphere, later clips were closer to the reference from the same contact than to time-matched clips from another contact in the same region. At the group level, different contacts in the same region were closer than contacts in different regions. This shows that the coordinates retain reproducible differences between contacts within a region, rather than mapping every contact in a region to the same location.
We also matched channel labels across separate recording sessions within each subject. Compared with the within-period baseline on the same clips, distances increased from 0.273 to 0.401 on the left and from 0.329 to 0.464 on the right. This suggests greater drift across periods, although matching labels alone does not verify physical contact identity. For context Functional coordinates are also calculated per session (first 10 seconds).
2. Stability across EMG-defined rest and movement
These clinical recordings did not follow a uniform behavioral protocol. We focused on right-hand movement, a common recorded activity. We averaged four right-hand EMG envelopes and smoothed the result over 200 ms. A 10-second clip was labeled movement if at least half its samples exceeded the recording-period median, and rest otherwise. In the sampled clips, the median fraction above threshold was about 77% for movement and 18% for rest. We compared clips from the same contact and recording period at matched time gaps across all three pair types.
| Same-contact comparison | Left, contralateral () | Right, ipsilateral () |
|---|---|---|
| Rest–rest | 0.260 [0.216, 0.294] | 0.273 [0.185, 0.319] |
| Movement–movement | 0.316 [0.223, 0.429] | 0.272 [0.198, 0.356] |
| Rest–movement | 0.287 [0.253, 0.341] | 0.329 [0.262, 0.417] |
| Paired excess across states | −0.004 [−0.021, 0.042] | +0.037 [0.006, 0.070] |
The paired excess is the rest–movement distance minus the average of the two within-state distances(behavioral state-dependent increase in coordinate distance), computed before aggregating across subjects. Across 20 recording periods, we found no detectable excess on the contralateral side and a small increase on the ipsilateral side. Together, the two analyses show that a coordinate estimated from a single 10-second clip retains contact-specific information over time, while allowing for some variation across behavioral states and recording periods.
Addressing Q4: Pooled TCN Baseline
We thank the reviewer for this important suggestion. We agree that the increased training data could contribute to the improvement of our pooled Functional Transformer. Indeed, enabling effective aggregation across subjects is a central motivation of our work. However, aggregating intracranial recordings is challenging because subjects have different numbers of electrodes without one-to-one channel correspondence.
Conventional multivariate TCNs and GRUs assume fixed input/output channel identities, making direct multi-subject training difficult without architectural modifications. Our Transformer instead uses channel-wise tokenization and attention to model interactions between arbitrary sets of recording channels. This design is consistent with recent intracranial modeling approaches such as seegnificant (Mentzelopoulos et al., 2024) and BaRISTA (Oganesian et al., 2025), which also employ Transformer-based architectures.
New experiment: Pooled TCN baseline
To directly address this concern, we implemented a channel-agnostic TCN and trained one shared model across the pooled 20-subject dataset.
Architecture: Each source electrode is processed independently using a shared five-block residual TCN (64 hidden channels, kernel size 5, dilations 1, 2, 4, 8, 16). Its features are conditioned on the frozen 32-D MSC functional coordinates and combined using masked mean aggregation, allowing variable numbers of source electrodes. A two-block TCN decoder, conditioned on each target electrode's functional coordinates, reconstructs the withheld VO waveforms. The model has 311,385 trainable parameters and uses no subject-specific heads or subject IDs.
Training and evaluation: We preserved the original preprocessing, 1-second windows with 500-ms overlap, chronological 70/15/15 splits, 25-ms patches, and masked-region prediction task. We used the same objective, MSE+0.05(1−r), with AdamW, batch size 16, learning rates of 2×10−4 for the backbone and 3×10−4 for the output head, and early stopping. Evaluation uses subject-level Fisher-z-averaged test Pearson correlation, as in Table 1.
Results (mean ± SEM):
The pooled TCN improves over the original subject-specific TCN baseline in both hemispheres. However, despite using pooled recordings and the same functional coordinate system, it remains below the pooled Functional Transformer (Δr=0.162 left and 0.108 right).
These results support two conclusions. First, non-Transformer architectures can also benefit from pooled recordings when adapted to heterogeneous electrode configurations. Second, access to more training data alone does not reproduce the performance of our Functional Transformer. Its ability to preserve individual channel representations and model their interactions provides an important architectural advantage over this pooled TCN implementation.