- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
UniPopT asks whether intracranial EEG (iEEG) actually improves scalp-EEG decoding when both modalities share one model, extending the Population Transformer recipe: a frozen single-channel TS2Vec encoder embeds each electrode, a spherical positional encoding (r, θ, φ about the anterior commissure, plus depth, modality, domain, and segment slots) places scalp electrodes and patient-specific contacts in one frame, and a PopT aggregator is pretrained on a bimodal corpus (TUH + five NEMAR iEEG datasets; 1,136 h scalp + 691 h iEEG) with next-segment and replaced-token objectives. On the official TUAB/TUEV splits UniPopT exceeds data-matched retrained baselines (89.52 AUROC vs 88.88 for the PopT recipe), and on the external Brain4FMs benchmark it obtains the best mean AUROC rank on the 8 scalp boards (2.75 vs 3.50 for REVE) and top accuracy on the 2 intracranial boards. One-change-at-a-time pretraining variants (P1–P4) localize the gain: iEEG helps through the aggregator's pre-training corpus (+2.62 AUROC, 9/9 boards, p = .001), not the encoder bank; the spherical encoding is what exploits unseen montages (advantage ~4× the Cartesian variant, growing with recording length per subject); and a Laplacian-reference-geometry analysis explains a −14.8-point dense-montage loss.
Critical strengths
- Exceptional experimental discipline and an answer to a genuinely open question. Data-matched retrained controls (P4), one-component-per-variant pretraining runs at equal compute, inclusion criteria fixed before outcomes, paired significance tests and Friedman statistics, and an explicit separation of published from retrained numbers — the decomposition of where iEEG gains enter (corpus vs encoder bank) is evidence of a kind rarely produced in this literature, and it corrects the modality-vs-volume confound in the prior BrainWave report.
- The analyses go well beyond benchmark accuracy and are practically actionable: montage × recording-length curves (dense montages pay off only with enough per-subject data), the forensics tracing a dense-montage failure to Laplacian reference spacing, and the token-space redundancy analysis (linear CKA 0.958 between bimodal and EEG-only encoders) that explains why iEEG helps at the corpus level but not the encoder level. The limitations section is candid and specific.
Critical weaknesses
- The headline claim — iEEG improves scalp decoding — remains partly confounded with corpus size: the bimodal corpus contains ~30% more recordings (4,043 vs 3,076) at matched compute. The appendix's scalp-heavy control (UNIPOPT-EX) points the right way but also changes the stride and encoder, so the modality contribution is not cleanly isolated.
- Methodological novelty is moderate (PopT machinery + spherical encoding + bimodal data), in-distribution gains are small (+0.42 TUAB AUROC; flat on TUEV), external coverage is selective (10 of 26 Brain4FMs boards, 7 of 21 datasets), and some results are very noisy (UCSD-OFF 61.44 ± 25.22), which limits the strength of per-board conclusions.
Questions for authors
- A size-matched EEG-only control (same recording count as the bimodal corpus) would separate modality from volume — is this feasible within your compute budget?
- Does the spherical encoding's advantage survive a stronger Cartesian baseline (e.g., per-axis Fourier features of xyz, or a learned MLP of xyz) rather than the integer-lookup variant?
- Is there evidence for the reverse direction (scalp pretraining improving iEEG decoding), or a specific reason the asymmetry is expected?
4 comments
Reply to Reviewer dmeq (part 2)
2. To address the concern of your second question of “Does the spherical encoding's advantage survive a stronger Cartesian baseline?”, we followed the suggestion from another reviewer who raised a similar question. That is to “test REVE’s encoding within pipeline.”. We retained UniPopT’s original training data, architecture, and training configuration, replacing only the spherical positional encoding with REVE’s 512-dimensional continuous 4D positional encoding with few adaptations (details of these adaptations will be provided in the appendix). We conducted evaluations on the in-domain TUEV dataset and Dep-STAI (as the performance difference between the 19-channel and 64-channel settings on the latter can help reveal the properties of the spherical positional encoding). The results are as follows:
| Position encoding | Dep-STAI 19-channel AUROC | Dep-STAI 64-channel AUROC | TUEV weighted F1 | TUEV |
|---|---|---|---|---|
| P3: integer Cartesian | ||||
| Adapted REVE PE | ||||
| C6: UniPopT PE |
The continuous REVE encoding improves mean 64-channel AUROC over P3 by approximately 3.28 percentage points, confirming the importance of testing a stronger Cartesian baseline. C6 retains the highest mean in the 64-channel setting and on TUEV, although its margins over REVE PE are small. REVE PE performs better in the 19-channel setting. These findings support the competitiveness of UniPopT’s encoding under a stronger, data-matched control, rather than universal or statistically established superiority of spherical encoding.
3. In response of your third question: Our study focused on whether including iEEG in pretraining improves scalp EEG decoding. Our current experiments do not isolate the reverse contribution through a matched iEEG-only control. However, there is a physiological basis for expecting the benefits to be task-dependent and potentially asymmetric.
Scalp EEG measures spatially mixed and attenuated neural activity, while iEEG provides more local measurements near the sampled generators. Simultaneous scalp–intracranial recordings show that focal events detectable intracranially can have weak or absent scalp correlates, and that their scalp visibility depends on the spatial extent and synchrony of the underlying activity. These findings demonstrate differences in the information accessible to the two recording modalities. Tao et al., 2005 · Casale et al., 2022
On this basis, we hypothesize that iEEG pretraining can expose the model to more spatially resolved examples of neural dynamics relevant to scalp decoding, whereas scalp pretraining may contribute less additional information to intracranial tasks that depend on focal activity. This provides a specific reason to expect unequal transfer benefits. Scalp recordings could still improve iEEG decoding through shared rhythms, broader spatial coverage, and greater training diversity. The expected asymmetry therefore depends on the downstream task, and its magnitude remains untested in our model.
The available evaluation resources also limit a systematic comparison. TUAB and TUEV provide established in-domain scalp evaluations with reference baselines. For the intracranial datasets used in our pretraining, we currently lack a comparable established in-domain evaluation protocol and baseline suite. Our external iEEG evaluation covers two HUP seizure-detection tasks. This uneven task coverage restricts how broadly we can assess reverse transfer or compare the two directions.
I thank the authors for their response. Most of my concerns have been addressed, and I keep my positive assessment as 3.
We are glad that our clarifications and additional experiments have addressed most of your concerns. Thank you for your positive feedback and for taking the time to review our responses
Reply to Reviewer dmeq (part 1)
We sincerely thank the reviewer for the thorough evaluation and constructive suggestions. We have conducted additional experiments and analyses to further investigate these issues and clarify our findings. Due to limited computational resources resulting from upcoming conference deadlines, we apologize for the delayed response. Some additional experiments are also still ongoing or in preparation, and we appreciate your understanding. We address each concern in detail below.
1. To address the concern raised in your Critical Weaknesses and Question 1 that the benefits of adding iEEG may be confounded by corpus size and diversity, we conducted an ablation: On top of the 3,076 TUH recordings, we added 967 scalp EEG recordings from 320 distinct subject IDs, selected from three datasets included in NeuralBench (Banville et al., 2026): Shirazi2024Hbn, Hinss2023Open, and Levy2026, contributing 710, 145, and 112 recordings, respectively. These additional recordings have a total raw duration of approximately 90.54 hours of age prediction, mental workload, and typing tasks.
The resulting EEG-only corpus, denoted EEG4043, matches the bimodal corpus in the total number of recordings (4,043), subject IDs (TUH + 320), source studies (TUH + three studies), and number of training samples for the encoder (200,400). Using EEG4043, we pretrained both the single-channel encoder and the aggregator, followed by downstream fine-tuning, with the same experimental settings as UniPopT.
The external evaluation results are presented below. Evaluation on the two intracranial HUP leaderboards is still ongoing and is therefore not included here; nevertheless, the completed scalp EEG evaluations already provide evidence relevant to this concern.
Across the seven evaluated leaderboards, EEG4043 outperforms UniPopT (C6) only on Dep-BDI, while UniPopT achieves a mean AUROC advantage of 5.08 percentage points over EEG4043 (UniPopT − EEG4043). Moreover, EEG4043 performs similarly overall to P1, the variant pretrained using only TUH data. Under these matched settings, adding scalp EEG recordings from multiple studies does not reproduce the gains obtained by adding iEEG. These findings provide evidence against an explanation based solely on the approximately 31% increase in recording count and support the contribution of complementary information from iEEG. We will add this ablation and its results later into the manuscript.
We also evaluated EEG4043 on the TUH-based downstream tasks, with the results presented below.
One possible explanation for these findings is that iEEG contributes primarily through joint dependencies across electrodes and time segments. Even if single-channel tokens from the two modalities occupy highly overlapping representation spaces, their relationships across electrodes and time segments may still differ. The aggregator is trained to determine whether two segments are temporally consecutive and to identify channel tokens that have been replaced with activity from other time points. Thus, iEEG may provide complementary signals for these pretraining tasks through activity relationships captured under different spatial sampling configurations, helping the aggregator learn more transferable contextual dependencies. This explanation is consistent with our existing representation analyses, but the specific mechanism requires further validation.