- Rating
- 2
- Confidence
- 3(−1)
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes a test-time adaption method for EEG foundation models called Subject-Coordinate Canonicalization(SCC) which trains a subject-coordinate or subject-bias estimator on training set in units of episode (an episode contains multiple subjects and task classes so that model can learn to distinguish subject-dependent and task-related information).
This paper models latent representations produced by EEG-FMs as a composition of a subject coordinate, task-related information and residuals. Based on that, the estimator is trained to predict subject coordinate, which is defined as class-balanced subject center, obtained by first averaging the latent representations within each class and then averaging the resulting class means.
At the same time, the remaining part of the latent representations needs to align with shared task-related information, which is defined as the average task-related response of all other subjects for the same class. These two constraints encourage the estimator to learn the subject-coordinate or bias. They are denoted by and , respectively, in Equation 6. Beyond these losses, a shared classifier is trained on both the original and canonical representations, resulting in two additional losses, and , respectively.
The main contribution is the systematic diagnosis of latent representations produced by EEG-FMs, and it shows that a substantial component of cross-subject variation can be reduced by subtracting an estimated subject-related offset. Based on that finding, the author designed a pipeline to train an estimator that uses only a few context samples from the unseen subjects to predict the subject bias.
Critical strengths
-
This work provides a systematic geometric diagnosis of EEG foundation model representations and models cross-subject variation in a simple manner, as subject-related information, task-related information, and residuals.
-
Based on that, the authors propose a pipeline to train the subject coordinate estimator to reduce subject bias on unseen subjects, and this test-time adaptation method turned out to be effective compared with six baselines across three paradigms and three datasets.
Critical weaknesses
-
Detailed experimental implementation information is missing. The number of repeated runs is not reported, and how the baseline TTA methods are applied is not reported in detail. The trainable parameter groups for Source-only, all baselines, and SCC are not clear. And since no code is provided, the results and training details remain unclear.
-
Experiments are conducted only on three datasets, and those three datasets all contain a lot of subjects. However, many widely used EEG benchmarks, such as BCI Competition IV 2a, contain far fewer subjects. Hence, the robustness of this method when only a small number of source subjects is available remains unclear.
Questions for authors
-
Can the authors evaluate SCC on a small-subject benchmark such as BCI Competition IV 2a, or otherwise provide evidence that it remains effective when only a small number of source subjects is available? This would clarify whether SCC remains effective when only a small number of source subjects is available or whether its performance depends on large and diverse source populations.
-
Can the authors provide the complete implementation and evaluation protocol for Source-only, SCC, and every TTA baseline? In particular, please specify the trainable and frozen parameter groups, adaptation steps, optimizers, learning rates, hyperparameter selection procedures, number of repeated runs, and random seeds. Providing anonymized code and configuration files, if permitted, would further help verify the reproducibility and fairness of the comparisons.