- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes DeeperBrain, an EEG foundation model that injects neurophysiological inductive biases into masked-reconstruction pretraining through a volume-conduction-aware channel positional encoding, an oscillatory temporal encoding, and a dual objective combining Masked EEG Reconstruction (MER) with Neurodynamics Statistics Prediction (NSP), an auxiliary regression of nineteen signal-computed statistics. Using about 17,000 hours of public EEG and 5.8M parameters, the model is evaluated under end-to-end fine-tuning and frozen probing on twelve downstream datasets across eight BCI task categories, where it is competitive under fine-tuning and ranks best on all twelve under frozen probing.
Critical strengths
The frozen probing result is substantial. DeeperBrain wins all twelve datasets in Table 4, often by wide margins, for example 50.96 versus 37.76 on FACED and 63.36 versus 53.00 on MODMA. This addresses a documented failure mode of current EEG foundation models and is practically valuable when downstream labels are scarce.
Critical weaknesses
The fine-tuning state of the art claims are under-supported. Tables 3 and 4 report no significance tests, several margins are within about one standard deviation, the win count in Section 3.3 does not match the table, and the emotion benchmarks SEED-V and SEED-VII use within-subject trial splits, which weakens the generalization narrative.
Questions for authors
- Can you add a control pretraining run with an auxiliary target of matched dimensionality that is not neurophysiologically canonical, for example time-domain moments or random linear projections of the spectrum, to isolate whether the gain comes from neurophysiological alignment specifically?
- How does a frozen linear probe on classical handcrafted features such as the exact NSP statistics compare on these twelve tasks? Does the DeeperBrain representation exceed the information injected by NSP?
- For the probe head family in Section 2.8, was the pooling choice selected per dataset and shared across all models, or tuned per model? What learning rate budget was given to each baseline frozen probe, given that several baselines collapse to exactly chance, for example CSBrain at 20.00 on SEED-V?
4 comments
Response to Reviewer DAJw [2/n]
Q1 (Question)
"1. Can you add a control pretraining run with an auxiliary target of matched dimensionality that is not neurophysiologically canonical, for example time-domain moments or random linear projections of the spectrum, to isolate whether the gain comes from neurophysiological alignment specifically?"
Response. Yes — we ran exactly these controls. We retrained from scratch under the identical protocol (same backbone, MER, mask ratio, optimizer, 2 epochs, batch 64) with three 19-D non-canonical targets, plus the four NSP leave-one-out ablations for completeness, and evaluated all variants under one unified frozen-probing protocol (5 seeds; a single per-dataset learning rate fixed and shared across all variants). Deltas are reported relative to the paper's full-NSP average (Table 4, 12 datasets):
| Pretraining target (19-D unless noted) | Neurophysiologically canonical? | Frozen-probing avg (12 datasets) | Δ vs. full NSP |
|---|---|---|---|
| Full NSP (paper) | ✓ | 54.28 | — |
| − spectral power (14-D) | partially | 51.62 | −2.66 |
| − PLV (9-D) | partially | 51.49 | −2.79 |
| − CFC (16-D) | partially | 53.32 | −0.96 |
| − SampEn (18-D) | partially | 50.76 | −3.52 |
moments (time-domain moments) | ✗ | 51.39 | −2.89 |
shuffle (NSP targets of mismatched samples) | ✗ | 48.56 | −5.72 |
random_proj (random linear projection of the spectrum) | ✗ | 46.33 | −7.95 |
No variant matches the full NSP target, and the drop scales with how much of the target's neurophysiological structure is destroyed. The two reviewer-suggested controls are covered: random_proj — dimensionality-matched but structure-free — causes the largest degradation (−7.95), ruling out auxiliary-target regularization or dimensionality as the source of the gain; shuffle preserves the exact NSP target marginals while destroying the sample–target correspondence and still loses 5.72 points: even matching dimensionality and target statistics is not enough — the pairing between each sample and its own neurodynamics is what matters. moments keeps only coarse, first-order sample information (−2.89). Among the leave-one-out ablations, every NSP component contributes positively (−0.96 to −3.52), with the largest single-component contribution from SampEn. Overall, the full target's advantage is carried by its sample-specific neurophysiological structure: the more of that structure is removed or destroyed, the larger the degradation. This experiment is now included in the revision (Appendix G, pp. 23–24; Table 10, p. 23).
Response to Reviewer DAJw [3/n]
Q2 (Question)
"2. How does a frozen linear probe on classical handcrafted features such as the exact NSP statistics compare on these twelve tasks? Does the DeeperBrain representation exceed the information injected by NSP?"
Response. We probed the exact 19-D NSP statistics (computed with the same estimators used to build the NSP targets during pretraining — band-power ratios, PLV, CFC, and sample entropy — applied to the raw downstream signals), aggregated to a fixed 38-D sample feature (per-statistic global mean + inter-channel std; PLV is channel-broadcast by construction), with both a linear probe (LogReg, balanced) and a small MLP, selecting on validation — a strictly fair information test of "does the representation merely reproduce the injected statistics?" (12/12 tasks complete):
| Dataset (chance) | Handcrafted NSP stats | DeeperBrain frozen probe (paper Table 4) | Gap |
|---|---|---|---|
| FACED (11.11) | 14.88 | 50.96±0.37 | +36.08 |
| SEED-V (20.00) | 20.04 | 35.08±0.26 | +15.04 |
| SEED-VII (14.29) | 14.29 | 23.26±0.22 | +8.97 |
| PhysioNet-MI (25.00) | 24.50 | 56.57±0.73 | +32.07 |
| BCIC-IV-2a (25.00) | 30.47 | 51.01±2.23 | +20.54 |
| SHU-MI (50.00) | 50.69 | 60.81±1.80 | +10.12 |
| ISRUC (20.00) | 26.29 | 74.10±0.58 | +47.81 |
| MODMA (50.00) | 55.92 | 63.36±2.40 | +7.44 |
| CHB-MIT (50.00) | 50.01 | 64.95±2.55 | +14.94 |
| BCIC2020-3 (20.00) | 23.33 | 43.33±0.64 | +20.00 |
| SEED-VIG (Pearson r×100, chance 0.00) | 38.22 | 59.85±1.24 | +21.63* |
| MentalArithmetic (50.00) | 64.24 | 68.05±0.40 | +3.81 |
*SEED-VIG is a regression task: both the handcrafted probe (Ridge) and the model are evaluated with Pearson r, and the row is reported as r×100 to match the paper's presentation of this dataset. Handcrafted probes are single validation-selected probes (logistic regression or the small MLP); the logistic-regression ones are deterministic, hence no std is reported for that column.
The probes on the raw NSP statistics are at chance on 5/12 tasks, and even on the tasks where handcrafted statistics carry signal they remain 3.81–47.81 points below the model's frozen probe (average model advantage +19.87 points over the 12 tasks). The answer to the reviewer's question is therefore yes, decisively: the pretrained representation contains substantially more task-relevant information than the NSP statistics injected during pretraining — NSP acts as an alignment signal that shapes the representation, not as a ceiling on it. (FACED has 9 classes (chance 11.11); its handcrafted probe is above chance yet still 36.08 points below the model's frozen probe.) This analysis is now included in the revision (Appendix G, p. 24; full 12-row table with footnotes: Table 11, p. 24).
Response to Reviewer DAJw [4/n]
Q3 (Question)
"3. For the probe head family in Section 2.8, was the pooling choice selected per dataset and shared across all models, or tuned per model? What learning rate budget was given to each baseline frozen probe, given that several baselines collapse to exactly chance, for example CSBrain at 20.00 on SEED-V?"
Response.
- Head family / pooling: task-dependent heads (as stated in Appendix), with the pooling and output structure selected per dataset (by validation) and then fixed and shared across all models for that dataset — never tuned per model.
- Learning-rate budget: every frozen probe — DeeperBrain and all baselines — used the identical budget: AdamW (wd 5e-2), cosine annealing, lr ∈ {1, 3, 5}×10⁻⁴ selected on validation, batch 32/64 by dataset scale, 50 epochs, 5 seeds (Appendix "Evaluation protocol").
- Why some baselines collapse to near chance (e.g., CSBrain 20.00±0.00 on SEED-V): we fully share the reviewer's concern that such a low number could stem from insufficient tuning of the baseline on our side, and we therefore treated this as a priority during the discussion period and re-ran CSBrain's frozen probe on SEED-V with a deliberately expanded search — the full head family (all four classifiers), AdamW, lr ∈ {1, 3, 5}×10⁻⁴ selected on validation, 50 epochs, 5 seeds, i.e., the identical budget as every other model. Even under this best-effort protocol the best configuration only reaches BA 22.62±0.28, κ×100 = 3.49±0.36, F1 22.69±0.45. This addresses the concern in three ways: (i) the reproduction is above the paper-reported 20.00 and shows healthy seed variance, so the expanded protocol was in fact slightly more favorable to the baseline; (ii) the value still sits in the chance neighborhood of the 5-class task (20.00), with κ×100 = 3.49 ≈ 0 confirming that no discriminative signal is extractable from CSBrain's frozen features on SEED-V — the near-chance result is a property of the frozen representation, not of the evaluation or of an under-tuned reproduction; (iii) by exhaustion, since every head variant and every learning rate in the grid converges to the same chance-level band, further tuning is unlikely to change the picture. This best-effort re-evaluation has been incorporated in the revised manuscript (Appendix D, "Note on near-chance baseline results", p. 21). For reference, the same budget yields REVE 27.8 and DeeperBrain 35.08 on the same task, and DeeperBrain retains a +12.46-point margin over the reproduced CSBrain. Our unified re-evaluation of all control models applies this same protocol, and the paper-reported numbers of the original weights serve as the reference row so that all control comparisons are within-protocol.
Response to Reviewer DAJw [1/n]
We thank the reviewer for the precise reading — including catching the presentation error, which we correct below — and for the constructive control-experiment suggestions, all of which we have run.
W1 (Critical Weakness)
Response. We address the four points in turn.