- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Neural State Prediction (NSP), a self-supervised latent-predictive framework for EEG foundation models designed to eliminate low-information shortcuts during pretraining. It addresses two key shortcuts: position-conditioned prediction and local spatial-temporal interpolation. It introduces Identity Residualization (ResID) to subtract marginal channel/time means from target latents, topology-separated context and a cascaded spatial-temporal transformer (CST). NSP is pretrained on 2.2M clinical EEG segments from TUEG and evaluated across 30 downstream datasets.
Critical strengths
- NSP effectively targets volume conduction and positional identity leaks in JEPA-style architectures.
- Extensive benchmarking: NSP was evaluated across 30 datasets spanning 4 adaptation protocols (Full FT, Multi-Task FT, Frozen Backbone, LoRA).
Critical weaknesses
-
Methodological limitations in presenting, evaluating, and conceptualizing the central problem.
- Although obstructing shortcut learning is the central premise and title of the paper, the direct evaluation confirming this claim is relegated entirely to the Appendix (Figure 17 and App. H.1) rather than featured in the main body.
- Unconvincing diagnostic setup. The anti-shortcut diagnostic is evaluated on an extremely small sample of only 256 or 512 segments on a single checkpoint without reporting standard deviations, confidence intervals, or multi-seed trials while the model was pretrained on 2.2M segments. This setup raises critical concerns regarding sampling bias and lack of statistical power.
- Hidden dependency on moment regularization.The performance of NSP heavily depends on moment regularization; removing it causes an important in frozen transfer. Crucially, the authors never evaluated Figure 17 without moment regularization. This masks whether moment regularization acts as the vital crutch preventing representation collapse, improperly attributing performance gains solely to ResID rather than the complete loss formulation. This raises a fundamental question: Is moment regularization the primary driver preventing collapse, rather than the proposed anti-shortcut techniques?
-
Mathematical limits of identity residualization. ResID is an additive first-order least-squares projection and thus mathematically incapable of removing non-linear channel-time interactions. This directly connects to the evaluation limitation: evaluating leakage solely with a Linear Probe measures linear decodability, which may offer an overly optimistic view of shortcut removal. Non-linear positional shortcuts could still persist undetected without non-linear probes.
-
Topology guard is heuristic. The spatial guard of masking nearest channels (App. B.3, Table 4) is a discrete heuristic calibrated for 19-channel montages used during pretraining. This fixed discrete rule lacks physical scaling when transferring to high-density EEG downstream datasets.
-
Minor: Performance degradation on fine-grained & ERP tasks
Questions for authors
- What are the results of Figure 17 on a significantly larger, representative sample (e.g., 50000+ segments) with multi-seed error bars and with non-linear probes?
- What are the results of Figure 17 without regularization to evaluate the true anti-shortcut effect of ResID?
- How effectively does the fixed spatial guard scale to high-density downstream montages (e.g., 60–64 channels), and what are the results when using an adaptive or physical-distance-based spatial guard?
We thank the reviewer for the positive assessment and the questions about closely related methods and shortcut reduction. We provide the empirical comparisons below, followed by diagnostics and matched component controls that address the two concerns separately.
Q1. Empirical and methodological comparison with EEG2Rep and EEG-JEPA
We agree that comparisons with closely related latent-prediction methods are needed. The available results show higher aggregate means for NSP, with task-dependent exceptions.
(1) EEG-JEPA: frozen multi-task transfer on EEG-FM-Bench. We compare BAC (%) on the same 14 benchmark tasks. EEG-JEPA results are taken from its reported frozen-transfer evaluation, and NSP results are provided in Appendix E.2.
NSP has a higher mean on 9/14 tasks and a 2.10 pp higher macro BAC. It scores lower on TUEV, Siena, BCIC-2a, TUSL, and Things-EEG-2. This comparison is included in the revised Appendix E.2.9.
(2) EEG2Rep: single-task full fine-tuning.
NSP reports higher means on all three metrics. Differences in pretraining, preprocessing, and data splits limit attribution of these gaps to the method itself. The matched controls in Q2 provide the component-level evidence.
(3) Specific methodological contribution. EEG2Rep uses semantic subsequence preserving masking; EEG-JEPA uses structured electrode–temporal masking and multi-depth latent targets. NSP jointly constrains target content and visible context. Identity residualization subtracts additive channel and relative-time means from Target states. Topology-separated context excludes the two nearest spatial neighbors and adjacent temporal patches around targets. These operations respectively reduce additive positional effects and restrict immediate-neighbor information that could support local interpolation.