- Rating
- 4(+2)
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
This paper introduces MSDE, an EEG pretraining method that jointly predicts future teacher states at short and longer timescales using a causal encoder and a shared transition operator. Experiments across 20 tasks, cross-dataset evaluations, and physiological analyses support its transfer benefits.
Critical strengths
The motivation is sound. EEG tasks involve both brief events and longer-lasting rhythmic activity, making joint prediction across timescales practically relevant. Training a shared representation to support both scales may help preserve complementary information for downstream tasks with different temporal requirements.
Critical weaknesses
The variant without variance–covariance regularization is evaluated using the epoch-52 checkpoint, whereas the base protocol specifies 70 epochs. Although this is described as the last available checkpoint, the reason for using it remains unclear. The performance difference may therefore reflect both the removed regularization and the shorter training budget.
Questions for authors
Please compare MSDE with time-series foundation models used for classification, such as MOMENT, Mantis, TimEE, or Tic-FM. Consistent subject level splits, label budgets, and adaptation protocols would help establish its value beyond comparisons with EEG-specific models. If MSDE outperforms these models, please explain which aspects of its design account for the gains.
Please further clarify the motivation behind the loss design, including why each auxiliary term is needed and how it complements the multi-scale prediction objective.
6 comments
Response to Q2 and References
Q2. Motivation for auxiliary losses
As developed in Section 3.4 and Appendices B.3 and J, the auxiliary losses address three complementary requirements: discouraging constant-feature collapse while discovering discriminative EEG features, preserving variation in the pooled representation used downstream, and maintaining consistent temporal state transitions. Because the student and EMA teacher co-evolve, prediction alone can be made trivial by constant states and a constant-preserving transition.
Identity anchoring discourages constant-feature collapse and promotes discriminative feature discovery. It uses the two temporal halves of the same EEG window as a positive pair and other windows as negatives. If every window produces the same feature vector, positive and negative pairs cannot be distinguished. Window discrimination therefore discourages this trivial solution during pretraining. Comparing normalized half-window means also encourages the encoder to discover features that persist across temporal halves yet differ between windows. Anchoring thus supplies predictive training with discriminative states, while micro/macro prediction trains those states to capture future evolution; the manuscript also shows that overweighting anchoring reduces transfer performance.
Variance–covariance regularization guards against collapse of the pooled representation used downstream. Anchoring constrains directions of half-window means, whereas the downstream classifier reads full-window means. Variation among token states can disappear under this averaging: a trajectory shared by all windows can have token variance while producing identical pooled vectors. We therefore penalize low feature variance at both the token and pooled-window levels and off-diagonal covariance to discourage redundant dimensions. Applied during pretraining, the pooled variance penalty directly preserves between-window variation in the representation that the downstream classifier will read. Appendix J.1 relates this penalty to separation between pooled states.
Semigroup consistency maintains temporal coherence between direct and composed state transitions. Its motivation comes from temporal composition: the learned transition should give compatible states when advancing by a+b directly or by a followed by b. The prediction losses train transitions from encoded states to future teacher states; the composed path additionally uses the first predicted state as the input to its second step. We encourage agreement between Φ(s_t, a+b) and Φ(Φ(s_t, a), b) using Smooth L1, training both paths through the shared operator for a+b ≤ 1 s. Within the directly supervised 0.5–1.0 s range, Appendix J.2 bounds mean absolute composed prediction error using direct prediction error and path discrepancy evaluated on the same triples. This supplies a temporal-consistency constraint on the learned dynamics in addition to micro/macro endpoint supervision.
The removal ablations quantify the contribution of each requirement:
| Term | Mean FT drop when removed |
|---|---|
| Identity anchoring | 3.58 pp |
| Variance–covariance | 4.05 pp, equal 70 epochs |
| Semigroup consistency | 1.86 pp |
All three removal comparisons significantly reduce mean FT BAcc (all one-sided exact p < 0.01).
Planned manuscript revisions. We will replace the epoch-52 no-var-cov control with the completed 70-epoch results in the ablation table and training details (W1). We will report Mantis, MOMENT, TimEE and TIC-FM with their FT/ICL settings and relate their learning objectives to MSDE's multiscale future-state prediction, supported by the no-prediction, bidirectional-reconstruction and single-scale controls (Q1). In Section 3.4 and the appendices, we will clarify identity anchoring's roles in discouraging constant-feature collapse and promoting feature discovery, variance–covariance regularization's preservation of pooled and token-level variation, and semigroup consistency's alignment of direct and composed transitions. Each role will be linked to its removal ablation (Q2).
References
[1] Vasilii Feofanov et al. Mantis: Lightweight Calibrated Foundation Model for User-Friendly Time Series Classification. arXiv preprint arXiv:2502.15637, 2025.
[2] Mononito Goswami et al. MOMENT: A Family of Open Time-series Foundation Models. arXiv preprint arXiv:2402.03885, 2024.
[3] Jaris Küken et al. TimEE: End-to-end Time Series Classification via In-Context Learning. arXiv preprint arXiv:2607.07500, 2026.
[4] Juntao Fang et al. Rethinking Zero-Shot Time Series Classification: From Task-specific Classifiers to In-Context Inference. arXiv preprint arXiv:2602.00620, 2026.
Thank you for the detailed response and additional experiments. The equal duration ablation resolves my concern about the training budget confound. The added time series baselines strengthen the empirical evaluation, and the explanations of the auxiliary losses clarify their motivation and complementary roles. These revisions address my main concerns, and I will raise my score accordingly.
Response to W1/Q1
Thank you for identifying the training-duration confound and requesting comparisons beyond EEG-specific models.
W1. Equal-duration no-var-cov comparison
The regularization gain persists at equal training duration. The no-var-cov control completes the same 70 epochs as MSDE and reaches 50.74% FT BAcc versus 54.79%: +4.05 pp (95% CI [2.10, 6.12], p = 5.01e-04, 17/20 task wins). LP gives 40.42% versus 43.95%, a +3.52-pp gain (CI [1.59, 5.72], p = 0.0023). This replaces the original epoch-52 control.
Q1. Time-series baselines and sources of improvement
We evaluate all four named models on the 20-task benchmark. Mantis and MOMENT use the same FT protocol, subject-level splits, and labeled training/validation data as MSDE-Full. Hyperparameters are selected on seed-42 validation data and reused on seeds 5/10. TimEE and TIC-FM use in-context learning (ICL). MSDE-Full uses a 5.0M-parameter encoder pretrained on 21,195 source hours and reaches 56.06% mean FT BAcc.
Gains are MSDE-Full minus comparator. CIs use 100,000 task-bootstrap resamples; p values use one-sided exact paired Wilcoxon signed-rank tests over 20 task means. MSDE-Full significantly exceeds all four models under the adaptation settings shown, with 17-19 task wins. Mantis/MOMENT comparisons match FT and label access.
Mantis [1] aligns crop-and-resize views of the same sample while separating different samples. This is closely related to MSDE's identity anchoring, which aligns the two temporal halves of an EEG window while distinguishing different windows. A functionally similar consistency constraint is already part of MSDE, where it supports future-state learning. Anchoring promotes persistent, discriminative features; micro/macro prediction additionally requires the same states to encode EEG evolution across timescales.
The no-prediction control retains anchoring and variance-covariance regularization but removes future prediction. With the same encoder, 10% TUH data, and training budget, MSDE gains 4.62 pp (95% CI [2.83, 6.55], p = 2.38e-05, 18/20 wins), demonstrating the contribution beyond anchoring and regularization.
MOMENT [2] reconstructs masked signal patches, the content-recovery paradigm whose EEG limitations motivate MSDE. EEG's temporal continuity and spatial redundancy can allow recovery from nearby observations without encoding subsequent evolution. Samplewise reconstruction also rewards waveform details regardless of their relevance to downstream decoding. MSDE instead predicts learned future states from the observed past at multiple offsets, explicitly requiring temporal evolution without samplewise waveform recovery. With the same architecture and pretraining budget, MSDE exceeds bidirectional latent infilling and bidirectional raw-signal MAE by 4.10 and 4.56 pp, respectively, with 19/20 wins in both comparisons.
TimEE [3] meta-trains on synthetic classification tasks, using temporal and cross-series attention to predict query labels from labeled support series. TIC-FM [4] combines a contrastively pretrained time-series encoder, projection adapter, and in-context classifier. Both exploit temporal patterns for classification. MSDE explicitly trains EEG states to predict future states at multiple time offsets. Before downstream labels are introduced, each state must retain information for short-term changes and longer-range persistence; the no-prediction and single-scale controls test these requirements.
The encoder produces subsecond causal states integrating information across electrodes. A shared, elapsed-time-conditioned transition predicts future teacher states at micro offsets of 0.5-1.0 s and macro offsets around 1, 2, and 4 s. Joint prediction encourages retention of local event progression and rhythmic persistence, improving mean FT BAcc by 3.0 pp over micro-only and 3.7 pp over macro-only. Together, these results support learning discriminative EEG features alongside their future evolution across complementary timescales.