- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes PUPPET, an iEEG representation model pretrained to predict which implanted electrode produced each trial. Its main contribution is electrode-origin prediction as an alternative to reconstruction-based self-supervision. The model uses a shallow Transformer encoder, which is frozen for downstream evaluation with linear readouts. Experiments on iMindBench report improved overall AUROC over prior models, with additional comparisons against matched reconstruction objectives, architecture ablations, spectral probes, and analyses of model size, pretraining duration, and label efficiency.
Critical strengths
- The pre-training objective is intuitive and well-aligned with the characteristics of iEEG recordings. By leveraging the fact that the same implanted electrode continuously collects signals over time, the model uses the electrode source as a training target, thus eliminating the need for manual task labels or anatomical coordinates.
- The model demonstrates attractive efficiency in terms of both architecture and data requirements. Strong results can be achieved by freezing the encoder and employing a simple linear classifier.
Critical weaknesses
- Omission of directly relevant work. The novelty is not sufficiently established. The PPi [1] already employs self-supervised pre-training by determining whether two segments of SEEG signals originate from the same channel. The paper fails to cite or compare against this work, leaving the advantages of a multi-class electrode-based objective over existing channel-discrimination objectives unproven.
- The scope of comparisons for the pre-training objective is limited. Controlled experiments primarily focus on reconstruction-based objectives, neglecting more closely related alternatives such as cross-time contrastive learning for individual electrodes or pairwise channel discrimination. Additionally, the supervised baselines could be strengthened by including representative models like EEG Conformer [2] or DBConformer [3], adapted appropriately for this context.
- The underlying mechanism for effectiveness remains unclear. Electrode identity inherently encodes information regarding the patient, the session, and the recording conditions. Current evidence is insufficient to distinguish whether the model is learning neural functional features or stable characteristics related to signal amplitude, spectral content, or noise.
- The scope of generalizations is limited. Evaluations are confined to language, auditory, and visual decoding tasks during movie-watching scenarios, which is insufficient to support broad generalizations across the full spectrum of iEEG tasks.
- The primary innovation is concentrated on the pre-training objective. Since the architecture largely follows existing designs, the paper must provide more rigorous validation to demonstrate the independent contribution of its approach relative to similar existing methods. [1] Yuan, Zhizhang, et al. "PPi: Pretraining brain signal model for patient-independent seizure detection." Advances in Neural Information Processing Systems 36 (2023): 69586-69604. [2] Y. Song, Q. Zheng, B. Liu, and X. Gao, “EEG conformer: Convolutional transformer for EEG decoding and visualization,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 31, pp. 710-719, 2023. [3] Z. Wang, H. Wang, T. Jia, X. He, S. Li, and D. Wu, “DBConformer: Dual-branch convolutional Transformer for EEG decoding,” IEEE Journal of Biomedical and Health Informatics, vol. 30, no. 5, pp. 4134–4147, 2026.
Questions for authors
-
Stronger supervised baselines are missing. Table 1 includes HTNet, CNN, and MLP but omits representative decoders such as EEG Conformer [1] and DBConformer [2]. The existing comparisons do not establish PUPPET’s advantage over strong supervised models.
-
Closely related prior work is omitted. PPi [3] uses same-channel versus different-channel discrimination for SEEG self-supervised pretraining. It is neither cited nor compared, leaving the novelty of electrode-origin prediction insufficiently established. The author should claim that, beyond replacing pairwise discrimination with multiclass electrode identification, what distinguishes PUPPET’s objective from PPi? What evidence shows that this change improves transfer?
-
Comparisons with related self-supervised objectives are insufficient. The matched controls mainly test reconstruction objectives, leaving other ways of exploiting channel identity unexplored.
-
Recording-specific shortcuts have not been ruled out. Electrode IDs are tied to patients and recording conditions. Stable amplitude, background spectra, or noise could support electrode identification without requiring the functional features proposed by the authors. The synthetic spectral probes do not resolve this concern.
-
The evaluated tasks cover multiple features, but share a narrow recording context. This limits broader claims about general iEEG representations. Can the authors provide more evidence from other iEEG tasks?
[1] Y. Song, Q. Zheng, B. Liu, and X. Gao, “EEG conformer: Convolutional transformer for EEG decoding and visualization,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 31, pp. 710-719, 2023. [2] Z. Wang, H. Wang, T. Jia, X. He, S. Li, and D. Wu, “DBConformer: Dual-branch convolutional Transformer for EEG decoding,” IEEE Journal of Biomedical and Health Informatics, vol. 30, no. 5, pp. 4134–4147, 2026. [3] Yuan, Zhizhang, et al. "PPi: Pretraining brain signal model for patient-independent seizure detection." Advances in Neural Information Processing Systems 36 (2023): 69586-69604.
6 comments
Response to Reviewer zJBX [2/3]
- W2-b / Q1 — Stronger supervised baselines (EEG Conformer, DBConformer)
W2-b: "... the supervised baselines could be strengthened by including ... EEG Conformer [2] or DBConformer [3] ..."
Q1: "... The existing comparisons do not establish PUPPET's advantage over strong supervised models."
Thank you for the suggestion. We first reported the supervised baselines that iMindBench already provides, which include HTNet, a strong decoder designed specifically for iEEG. As you suggested, we have now added EEG Conformer and DBConformer, and also ShallowFBCSPNet, each with a proper hyperparameter search: trained from scratch on every Main unit via the benchmark harness (learning rate on a x4 grid from 6.25e-5 to 1.6e-2, 6.4e-2 for ShallowFBCSPNet; early stopping on validation AUROC; App. D.2). Frozen PUPPET beats all three by 6 to 8 points, as shown in Table 1:
| Decoder | AUROC | PUPPET's gain over it, AUROC points (95% CI) | Patients PUPPET ahead |
|---|---|---|---|
| PUPPET (frozen, linear read-out) | 0.661 | reference | |
| DBConformer | 0.598 | +6.32 (+4.85 to +7.94) | 26/26 |
| EEG Conformer | 0.581 | +8.01 (+5.98 to +9.97) | 25/26 |
| ShallowFBCSPNet | 0.581 | +8.06 (+6.89 to +9.45) | 26/26 |
All significant after Holm. Frozen PUPPET with a linear read-out beats each on every dataset, and no tested learning rate brings any within 6 points. Table 1 also marks every significant difference, and Sec. 4.5 describes the setup.
- W3 / Q4 — Neural features vs recording fingerprints
W3: "... Current evidence is insufficient to distinguish whether the model is learning neural functional features or stable characteristics related to signal amplitude, spectral content, or noise."
Q4: "Recording-specific shortcuts have not been ruled out. ... The synthetic spectral probes do not resolve this concern."
Thank you; we agree that electrode identity could in principle be solved from stable per-channel properties, and that the synthetic probes do not settle this. We therefore tested each kind of shortcut you name directly, always on PUPPET's encoder, objective and data.
Spectral content. If the features were a per-channel spectral fingerprint, a model given that fingerprint should transfer as well. It does not: an MLP on each channel's log spectrum and RMS identifies electrodes almost as well as PUPPET but scores 60.7 vs. 66.1, and PUPPET pretrained on spectral tokens identifies electrodes better, also on new patients, yet transfers significantly worse (Fig. 4b and App. Table 24):
| Input tokens | Electrode-origin pretraining | iMindBench Main AUROC | Electrode ID, held-out | New patients, kNN |
|---|---|---|---|---|
| Raw waveform | yes (PUPPET, first-session model) | 66.1 | 70.4 | 58.6 |
| Raw waveform | no (linear) | 57.7 | 0.7 | 6.3 |
| Spectral fingerprint | yes | 64.6 | 72.1 | 66.3 |
| Spectral fingerprint | no (linear) | 61.1 | 47.1 | 45.0 |
| Multi-STFT | yes | 64.7 | 76.4 | 70.1 |
| Multi-STFT | no (linear) | 63.4 | 46.0 | 56.2 |
| Log spectrum + RMS | yes (MLP, no PUPPET encoder) | 60.7 | 68.7 | 47.9 |
Spectral fingerprint: each channel's log power in 40 frequency bands plus log RMS; "no" = a linear read-out of the input itself. Spectral input makes identification easier but leaves less to learn; from the raw waveform the model must build its own features, and pretraining adds +8.5 points there, against +3.5 and +1.3 on spectral input.
Amplitude and noise. A read-out of five per-channel summaries (amplitude, 1/f exponent and offset, line noise) scores 54.9 against PUPPET's 62.5 on the same units, and removing them from PUPPET's features changes it by only −0.3 points (n.s.).
Sec. 5.3 and App. H give the details.
Response to Reviewer zJBX [3/3]
- W4 / Q5 — Movie-watching tasks only
W4: "... Evaluations are confined to language, auditory, and visual decoding tasks during movie-watching scenarios ..."
Q5: "... Can the authors provide more evidence from other iEEG tasks?"
Thank you for raising this. iMindBench is indeed limited to movie watching. We therefore added four public iEEG datasets with quite different tasks: working memory, picture naming, attention switching and free recall (new Appendix J: Table 35 describes each task and Table 36 compares every model on it). Frozen PUPPET is ahead of frozen PopT-v2 and DIVER-1 on all four, and none of the models we tested, including fine-tuned PopT-v2 and supervised decoders, does significantly better on any of them. On the pretraining side, PUPPET pretrained only on AJILE12 (non-movie ECoG from another institution) matches BrainTreebank pretraining (0.659 vs. 0.661, n.s.; Table 3).
Foundation models on the four datasets, AUROC (frozen with the same linear read-out, plus PopT-v2 and BaRISTA fine-tuned end to end; learning-rate grids and the score at every learning rate in Tables 37–38; all models, including supervised decoders, in Table 36):
| Model | Working memory | Picture naming | Attention | Free recall |
|---|---|---|---|---|
| PUPPET (ours) | .679 | .641 | .977 | .586 |
| PopT-v2 (frozen) | .610* | .606* | .972 | .574 |
| PopT-v2 (fine-tuned) | .566* | .589* | .980 | .542* |
| DIVER-1 | .629* | .582* | .941* | .552* |
| BrainBERT | .585* | .585* | .975 | .558* |
| BaRISTA | .557* | .543* | .899* | .538* |
| BaRISTA (fine-tuned) | .544* | .536* | .831* | .526* |
*PUPPET significantly higher (paired patient bootstrap, Holm).
5. W5 — Independent contribution
"... the paper must provide more rigorous validation to demonstrate the independent contribution of its approach relative to similar existing methods."
Thank you; since the contribution rests on the objective, it has to hold up against similar existing methods. We believe the replies above now answer this:
- PPi and other channel-discrimination losses: reply 1 (1-a, 1-b; Table 2 and App. Table 7)
- Coarser identity targets (anatomical classes, patient identity, groups of nearby contacts): reply 1-c (Fig. 4a)
- Reconstruction objectives, including DIVER-1's: Table 2
- Stronger supervised baselines: reply 2 (Table 1)
- Recording fingerprints and nuisance properties: reply 3
- Other iEEG tasks and datasets: reply 4 (App. J)
Thank you again. We are happy to run any further control you think would settle a remaining point.
Response to Reviewer zJBX [1/3]
Thank you for the careful review. It led to new related work, three objective controls and three supervised baselines (new text in teal).
Thank you for pointing us to PPi, which we now cite. We ran matched experiments on the channel-discrimination losses you named (full PPi, its pairwise same-channel loss on its own, and per-electrode supervised contrastive learning across time), all with our encoder, data, training budget, frozen read-out and 3 seeds, and the learning rate chosen per objective (we re-implemented PPi, as its code is not public).
1-a. W1 / W2-a: comparison with PPi and other channel-discrimination losses
All three channel-discrimination losses transfer well, but electrode-origin prediction is best:
PPi is now cited in the introduction and Sec. 2, and both PPi variants are in Table 2.
1-b. Q2: what distinguishes electrode-origin prediction, and why it helps
How it differs: PPi uses a binary same-channel loss on segment pairs, plus reconstruction and context-swap losses, for seizure detection. Ours gives each training electrode one fixed label and scores every channel against all 650 electrodes: no pairs, no reference segment, no auxiliary loss.
Part of why it improves transfer: electrode-origin prediction keeps one persistent target per electrode (a learned vector that summarizes the electrode over all of training and is present at every update), whereas pairwise and contrastive losses, including PPi's, compare each sample only with the current batch. We crossed the two factors with two variants from metric learning (three seeds each; App. Table 7):
Main Overall AUROC (×100), three seeds per cell (App. Table 7). Of the 0.52-point gap to standard supervised contrastive learning, persistent targets account for about 0.33 and the softmax form for about 0.20, and only the persistent-target effect under supervised contrastive is significant (Movshovitz-Attias et al., 2017; Zhai & Wu, 2019).
1-c. Q3: other ways of using channel identity (coarser targets)
To see how specific the identity target has to be, we also made it coarser. Anatomical classes within each patient, and patient identity, all transfer significantly worse (Holm p < .05; Fig. 4a):
Main Overall AUROC, three seeds each. * Significantly below electrode-origin prediction (paired patient bootstrap, Holm p < .05).
We also tried groups of nearby contacts, to see whether anatomy matters or only how finely the target splits each patient's electrodes: any of an electrode's k nearest contacts in the same patient counts as correct (k = 1 is ours). Transfer stays flat up to about 8 contacts and drops sharply at k = 64 (Fig. 4a):