- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents BrainCodes, a lightweight EEG foundation model that combines discrete neural tokenization, masked-token prediction, spatial encoding, and a synthetic oscillation-based auxiliary objective. The authors evaluate it across 14 downstream benchmarks, including wearable EEG and reduced-electrode settings, reporting competitive performance with a compact trainable backbone.
Critical strengths
The evaluation on consumer-grade EEG hardware, including in-ear EEG and Muse headbands, is a valuable aspect of this work, as such settings remain relatively underexplored in EEG foundation model research.
Critical weaknesses
-
Methodological novelty. Discrete EEG tokenization, masked prediction, and spatial encoding have already been explored in prior work, including LaBraM, CBraMod, NeuroRVQ, BrainOmni, etc. The synthetic oscillation-based objective appears to be the most distinctive component, but its advantage over simpler frequency-aware alternatives remains unclear.
-
Motivation for discrete code prediction. The paper argues that discrete code prediction alleviates the spectral bias of waveform reconstruction. However, the prediction targets come from a frozen BioCodec tokenizer that is itself reconstruction-trained and may inherit similar biases. Moreover, although cross-entropy avoids direct amplitude weighting, the losses across RVQ stages are equally weighted despite potentially different prediction difficulties and information content. Does this necessarily encourage the preservation of subtle, low-energy oscillatory features, or could the model still prioritize more easily predictable components? It remains unclear to what extent discrete code prediction addresses the underlying limitation of reconstruction-based learning, rather than simply changing the prediction space.
-
Effectiveness of synthetic oscillation supervision. Predicting the properties of artificially injected oscillations does not necessarily guarantee better representations of naturally occurring EEG rhythms. Since the auxiliary task only requires predicting the properties of artificially injected oscillations, could the model learn features specialized for detecting these synthetic perturbations rather than capturing naturally occurring neural dynamics? It remains unclear whether the auxiliary task specifically promotes meaningful oscillatory representations or primarily facilitates synthetic perturbation detection. The natural-rhythm analysis in Appendix G is encouraging, but does not directly resolve this distinction.
-
Attribution of the lightweight performance advantage. BrainCodes achieves impressive performance with substantially fewer parameters than several competing EEG foundation models. However, it remains unclear whether this advantage arises from the proposed method or from differences in model capacity, pretraining data, and training protocols. Parameter-matched comparisons under controlled pretraining conditions would help determine whether competing architectures could achieve similar performance at the same scale. Furthermore, investigating how BrainCodes scales with model size and pretraining data would help clarify whether its lightweight design genuinely enables strong performance with fewer parameters, or instead represents a pragmatic compromise in a setting where increasing model capacity offers limited additional benefits.
-
Transfer claims. The wearable-device and sparse-montage results are encouraging. However, the sparse-montage experiments involve configuration-specific fine-tuning, making it difficult to disentangle the generalization of pretrained representations from target-specific adaptation. Evaluating transfer to unseen electrode configurations without additional backbone fine-tuning would provide stronger evidence for montage generalization.
Questions for authors
See weakness above.
5 comments
Response from the Authors (2/4)
R3-W2 · Motivation for discrete code prediction
Concern. “the prediction targets come from a frozen BioCodec tokenizer that is itself reconstruction-trained and may inherit similar biases. Moreover, … the losses across RVQ stages are equally weighted … could the model still prioritize more easily predictable components?”
Response. We tested both concerns, i.e., whether the codec’s training loss inherits the frequency-power bias of waveform reconstruction, and whether BrainCodes preferentially learns the easier RVQ stages. Three findings support our design:
- BioCodec’s loss reduces the frequency-power bias. Squared-error reconstruction emphasizes high-power components, which in EEG typically favors slow activity (He, 2014; Donoghue et al., 2020). BioCodec instead uses log-magnitude spectral losses. We measured frequency weighting by increasing the amplitude of each 2-Hz band from 1–45 Hz by 10% and recording the change in loss. The resulting log-log slope is nearly flat for BioCodec’s loss (−0.09), compared with −1.43 for squared error (Table R3-W2a). Thus, although the tokenizer is reconstruction-trained, its loss does not have the same frequency-power weighting as waveform squared error.
- Low-energy RVQ stages carry substantial spectral information. Later stages add only 17% of waveform variance, yet increase the linear decodability of beta power from 0.31 to 0.46 R², delta power from 0.14 to 0.26, and the 1/f exponent from 0.58 to 0.75 (Table R3-W2b). Equal stage weighting assigns these stages half of the code-prediction objective, despite their comparatively small contribution to waveform variance. This prevents their contribution from being reduced simply because they encode lower-energy residuals.
- BrainCodes learns late stages as well as early ones. On held-out HBN participants, masked-code prediction accuracy is similar across all six RVQ stages and context reduces uncertainty by a similar amount at each stage (Table R3-W2c). Code usage is nearly uniform within each stage, so frequent-code guessing cannot explain these accuracies. These measurements do not support the concern that training concentrates only on easily predictable early stages. Table R3-W2a. [New experiment] Log-log slope of the weight each loss gives to each frequency, measured by raising the amplitude of each 2-Hz band from 1 to 45 Hz by 10%; a slope near 0 means all frequencies are weighted equally.
| Loss weight per Hz, slope | PhysioNet-MI | EEGMAT |
|---|---|---|
| EEG spectrum (1/f) | −1.43 | −1.88 |
| Mean squared error | −1.43 | −1.88 |
| BioCodec loss | −0.09 | −0.22 |
Table R3-W2b. [New experiment] Information (decodability) carried by the first k BioCodec RVQ stages: R² of the waveform reconstruction (first row), and R² of predicting each spectral property (1/f exponent and band power) from the codes (other rows).
| First k RVQ stages | 1 | 2 | 3 | 6 |
|---|---|---|---|---|
| Waveform R² | 0.434 | 0.637 | 0.701 | 0.844 |
| 1/f exponent | 0.373 | 0.465 | 0.581 | 0.751 |
| Delta | 0.113 | 0.149 | 0.136 | 0.258 |
| Theta | 0.382 | 0.455 | 0.482 | 0.594 |
| Alpha | 0.795 | 0.831 | 0.863 | 0.892 |
| Beta | 0.083 | 0.161 | 0.310 | 0.457 |
Table R3-W2c. [New experiment] Masked-code prediction per RVQ stage on held-out HBN participants, evaluated on our official model. Chance top-1 accuracy is 1/256=0.0039.
| RVQ stage | 1 | 2 | 3 | 4 | 5 | 6 |
|---|---|---|---|---|---|---|
| Top-1 accuracy | 0.232 | 0.238 | 0.243 | 0.230 | 0.238 | 0.234 |
| CE below code frequencies (nats) | 2.11 | 2.12 | 2.12 | 2.09 | 2.11 | 2.10 |
Response from the Authors (3/4)
R3-W3 · Does BrainCodes capture natural rhythms or only synthetic bursts?
Concern. “could the model learn features specialized for detecting these synthetic perturbations rather than capturing naturally occurring neural dynamics? … The natural-rhythm analysis in Appendix G is encouraging, but does not directly resolve this distinction.”
Response. Yes. BrainCodes represents natural rhythm power and utilizes it in downstream tasks. We establish this in two steps: testing the full model on natural recordings, and repeating the analysis in a model pretrained without injection.
- The full model uses natural rhythm information downstream. Appendix G shows that frozen BrainCodes features encode naturally occurring rhythm power. To test whether this information matters for prediction, we erased linearly decodable rhythm power using LEACE and refitted the downstream probe. Balanced accuracy decreased by 0.042–0.212 across eight datasets, more than any matched random erasure (G2, revised Figure 2e). Thus, downstream performance depends on spectral information present in natural EEG, beyond synthetic bursts.
- Natural rhythms can emerge without synthetic supervision. We retrained BrainCodes without the injection objective, holding the data, initialization, data order and number of training steps fixed. This model never encountered a synthetic burst during pretraining, yet its frozen features still encode natural rhythm power. Erasing that information again produces substantially larger downstream accuracy losses than random erasure (Table R3-W3). These findings argue against an explanation based on synthetic-perturbation detection. Natural rhythms are represented and used downstream, even without injection. The controlled comparison separately shows that the injection objective increases sensitivity to narrowband rhythms (R2-W3).
Table R3-W3. [New experiment] BrainCodes pretrained without the injection objective. The drops are in the balanced accuracy of a linear probe, after erasing rhythm power (LEACE, as in G2) or after 20 random erasures of the same size.
| Dataset (chance BAC) | −Rhythm | −1/f | Random erasure, largest |
|---|---|---|---|
| EEGMAT (0.50) | −0.059 | −0.024 | −0.007 |
| EESM23 (0.17) | −0.185 | −0.126 | −0.011 |
| PhysioNet-MI (0.25) | −0.060 | −0.013 | −0.005 |
R3-W4 · Attribution of the lightweight advantage, and scaling
Concern. “it remains unclear whether this advantage arises from the proposed method or from differences in model capacity, pretraining data, and training protocols. Parameter-matched comparisons under controlled pretraining conditions would help … investigating how BrainCodes scales with model size and pretraining data would help clarify …”
Response. Our ablations support a contribution from the method and establish competitive accuracy at a small scale. The same architecture scores 0.270 mean nBAC without pretraining versus 0.498 with pretraining (Table 7); removing injection lowers it to 0.383 (Table 6). BrainCodes also leads under the shared recipe of Table 4 and the NeuroRVQ benchmark’s released protocol (G7). It outperforms the compared 3.2M–5.8M foundation models in Table 2 and EEGPT-Tiny on shared tasks, despite several baselines using orders of magnitude more pretraining data. On scale, scaling LaBraM from 5.8M to 369M parameters improved TUEV by only 0.02 BAC, within one participant-bootstrap s.d. (Appendix H), and downstream gains depend more on participant coverage than on windows per participant (Appendix D).
Response from the Authors (1/4)
We thank the reviewer for the careful assessment. Each methodological question led to additional experimentation on our part, which is now included in the revised manuscript. In addition, the reviewer may also refer to the Overview response attached as an Official Comment to all.
R3-W1 · Methodological novelty and simpler frequency-aware objectives
Response. We agree that the individual ingredients have precedents. G1 explains how BrainCodes differs in their use, particularly its independently released codec and localized oscillation supervision. Unlike objectives on spectral content, the injection loss supervises event frequency, duration and location. BrainCodes without injection is already frequency-aware through BioCodec’s spectrally trained targets (R3-W2). Removing injection causes the largest ablation drop, from 0.498 to 0.383 mean nBAC (Table 6).
Complementary comparisons. BrainCodes exceeds NeuroRVQ under its released downstream protocol (0.597 versus 0.559 mean nBAC; G7). With identical windows and linear probes, its frozen features also outperform five-band power plus the 1/f exponent on 8 of 10 datasets and on average (Table R3-W1).
Table R3-W1. [New experiment] BAC using the same logistic-regression probe and identical windows. Spectral features comprise per-channel power in five bands and the 1/f exponent, estimated from a specparam-style fit of the Welch spectrum.