- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors train a diffusion model on EEG data in an unsupervised manner, then freeze it and use a linear classifier to categorize signals based on internal features extracted from various layers. Their contributions include an approach for adapting channel processing to signal covariance (CoSMO), an auxiliary task for feature learning across different layers (XLAP), and a comparison between frozen and fine-tuned models. Validation across 12 datasets demonstrated performance comparable to fine-tuned foundation models on five of them; cross-dataset transfer was not evaluated.
Critical strengths
A systematic investigation into the role of pre-training and fine-tuning: a comparison across 12 datasets reveals where frozen features are sufficient for competitive performance, and where label-based adaptation provides a significant advantage.
Critical weaknesses
Although CoSMO is presented as one of the key contributions, the ablation studies do not demonstrate a convincing, standalone improvement in balanced accuracy across the four datasets examined. Its benefits emerge primarily when combined with XLAP and in terms of certain additional metrics. Consequently, the main contribution of this work appears to be largely empirical - an analysis of the capabilities and limitations of frozen EEG representations - whereas the significance of the proposed architectural innovations is less compellingly justified.
Questions for authors
- Could you provide a more compelling demonstration of the added value of CoSMO compared to XLAP (without CoSMO) - taking into account both the variance in results and the computational costs?
- Why are the MAT results considered comparable, given that the average quality for LUCID is 6.6 percentage points lower? Can you demonstrate that this gap is practically insignificant, rather than simply falling within the range of a large variance in results?
Contribution, CoSMO ablations and cost, and the MAT comparison
Thank you for the careful review and for highlighting the value of the frozen feature study. We address CoSMO's added accuracy and cost separately from the overall results, then revisit MAT.
W1: the contribution. LUCID learns without labels from one dataset's training recordings, freezes the diffusion model, and reads its features with one linear probe. As reported in the submission, its mean balanced accuracy exceeds its untrained copy on all twelve datasets, by 4 to 34 points. The method provides EEG features for linear decoding without supervised backbone adaptation. LUCID tests no transfer. Frozen versus fine tuned comparisons provide context.
CoSMO's seperate contribution remains a design hypothesis: the paper's four dataset ablation does not establish a standalone gain in balanced accuracy. We now test its added value on four more datasets.
W1 and Q1: adding CoSMO to XLAP. The base model has neither component and the full model has both. The last column compares Full with XLAP only. CoSMO only is not shown. Scores are balanced accuracy pooled over test windows, as proportions (mean ± SD over five seeds).
How all comparisons in this response are computed. Differences are percentage points. The 95% percentile intervals use 10,000 resamples of test subjects with replacement, within class groups on COMA, Mumtaz and TUEV. Models and settings stay fixed. We average balanced accuracy over five training seeds. Separated means p < .05 after Holm correction. This p value is a bootstrap tail area whose calibration has not been measured. Not separated does not mean equal.
The last column compares Full with XLAP only at the same readout settings. All four intervals include zero. Base scores provide context.
On TUEV, XLAP only exceeds Base by +2.3 [+0.7, +3.6] points, separated under the stated procedure after Holm correction over the original four TUEV component contrasts. This provides positive evidence for XLAP on this dataset at this readout.
The displayed TUEV Full exceeds XLAP only by +4.2 points, with positive differences in all five seed pairs. This is descriptive support, since the patient interval includes zero. The difference is negative on COMA, near zero on Mumtaz and positive with a wide interval on SLEEP. CoSMO's added value therefore remains uncertain.
On the paper's original four ablation datasets (MAT, BCIC-IV-2a, SEED-V, PhysioNet-MI), Full has the highest five seed mean, above Base and XLAP only on each. This supports the combined model descriptively. CoSMO only's AUC-PR and AUROC gains on MAT are also descriptive. MAT and BCIC-IV-2a have 4 and 2 test subjects, so receive no interval. The ablation analyses for TUAB (253 test subjects), FACED and BCIC2020-3 are pending.
Q1: computational cost. At inference, CoSMO adds 16 to 18% of paramters and about 20% of operations on SLEEP, Mumtaz and TUEV. XLAP is used only during training. With XLAP enabled, adding CoSMO multiplies training time per epoch by 1.43 on TUEV, 1.47 on SLEEP and 1.65 on Mumtaz. The new datasets do not establish an accuracy return for this cost.
Q2: MAT. LUCID scores 0.7000 against fine tuned REVE's published 0.7660 (El Ouahidi et al., 2025), a 6.6 point deficit. Our tie rule favoured LUCID because of its larger seed spread (0.0731). AUC-PR is also lower (0.5984 against 0.7470).
With four test subjects we give no interval, and no equivalence margin was set in advance. We cannot show that the gap is "practically insignificant" and withdraw the tie rule and the "five ties". With fewer than five test subjects, we report per subject scores without a verdict.
Changes to the paper. We will foreground the dataset specific learner and its frozen features, add the component contrasts and costs, and replace the tie claims with measured differences.
These findings provide positive evidence for XLAP on TUEV and descriptive support for the combined model. They do not establish a general CoSMO advantage or synergy. We would welcome your perspective on this contribution and our interpretation of the component results. We will post the TUAB, FACED and BCIC2020-3 tables when their analyses finsih.
Reference
El Ouahidi et al. (2025). REVE: A Foundation Model for EEG Adapting to Any Setup with Large-Scale Pretraining on 25,000 Subjects. NeurIPS 2025.