- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes POSE, a target-conditioned framework for multi-dataset fine-tuning of EEG foundation models. To mitigate negative transfer from heterogeneous auxiliary datasets, POSE first performs early target-only adaptation and measures the evolving feature-distribution discrepancies between the target and candidate datasets. Experiments across 12 EEG datasets and two foundation models (LaBraM and CBraMod), with supplementary evaluations on REVE, demonstrate improvements over target-only fine-tuning and several multi-dataset training baselines.
Critical strengths
-
The observed backbone-dependent and cross-paradigm selection patterns could motivate further research on data-centric adaptation of EEG foundation models.
-
POSE provides a practical data-selection strategy without modifying the pretrained backbone or inference architecture.
Critical weaknesses
-
A central novelty of POSE is combining endpoint discrepancies with their temporal slopes. However, the main ablation compares the full framework against selection from the pretrained checkpoint (No Probe), rather than an endpoint-only selection strategy using the same target-adapted checkpoint.
-
POSE assumes that smaller feature-distribution discrepancies and favorable discrepancy trends indicate more useful auxiliary supervision. However, feature similarity does not necessarily imply compatible learning objectives, particularly across heterogeneous EEG tasks with different label spaces. It would be better to directly quantify how well its compatibility scores predict actual downstream transfer gains.
-
The primary ablation study focuses on eight classification datasets where POSE already outperforms target-only fine-tuning on both backbones. The remaining four datasets are evaluated separately under a fixed exploratory configuration. This ablation protocol may overestimate the benefits of individual components.
-
Although POSE is conceptually backbone-agnostic, all evaluated EEG foundation models are Transformer-based.
Questions for authors
1.Coule the authors evaluate POSE on non-Transformer backbones, such as the structured state-space modeling approach in CodeBrain (ICLR 2026), and alternative pretraining paradigms, such as JEPA-style predictive learning in PATCHCODE (ICML 2026)?
2.Could the authors report downstream performance for endpoint-only selection (β = 1) after the same target-only probing stage, while keeping the auxiliary weighting and training schedule identical?
3.Have the authors investigated the correlation between the proposed compatibility scores and the actual performance gains obtained by adding individual auxiliary datasets?
5 comments
Response to Reviewer vKqS (Part 2/3): Single-Source Gain Analysis & Ablation Protocol [W2, W3, Q3]
W2 & Q3: Compatibility Scores Versus Single-Source Transfer Gains
... feature similarity does not necessarily imply compatible learning objectives, particularly across heterogeneous EEG tasks with different label spaces. ... Have the authors investigated the correlation between the proposed compatibility scores and the actual performance gains obtained by adding individual auxiliary datasets?
We agree that feature proximity does not guarantee identical task objectives across different label spaces, which is why POSE uses trajectory scores for top-end selection and tail-risk filtering in multi-source adaptation rather than as an exact linear predictor of every isolated source. When label spaces differ, mid-scoring datasets can still contribute generic backbone regularization and sources interact during joint training, so global rank correlation across all 11 single-auxiliary runs is naturally moderate. Evaluating all 11 single-source additions individually under the balanced 5-fold protocol on LaBraM (MAMEM1 and SEED against a matched Target-only control) shows a positive overall rank trend (mean-score vs. mean-gain Spearman to , and fold-averaged on MAMEM1) while confirming the properties POSE actually relies on. Top-ranked candidates provide reliable positive supervision (e.g., rank-1 SEED-IV on SEED and rank-2 PhysioNet-MI with the highest single-source gain of +3.90% on MAMEM1), whereas bottom-ranked candidates capture negative transfer (e.g., worst-scored SHU-MI at -0.39% on MAMEM1 and rank-10 MAMEM1 at -0.86% on SEED). Combined with the consistent drops observed when replacing POSE's score with No Probe, Uniform Weight, or alternative selectors across our ablations and baselines, these results confirm that the compatibility score provides an effective signal for reliable multi-source adaptation.
W3: Ablation Protocol and Potential Overestimation of Component Benefits
The primary ablation study focuses on eight classification datasets where POSE already outperforms target-only fine-tuning on both backbones. The remaining four datasets are evaluated separately under a fixed exploratory configuration. This ablation protocol may overestimate the benefits of individual components.
Separating the two dataset groups was intended to make individual component contributions observable where multi-dataset adaptation is active. Because the primary purpose of an ablation study is to isolate the effect of each component, on targets where auxiliary training as a whole leaves little room for gain over Target-only (e.g., already saturated performance on TUAB), all variants cluster tightly and component-level differences cannot be meaningfully distinguished.
The remaining four datasets are not simply failure cases of POSE, and the fixed configuration in Table 9 ensures a fair comparison with active auxiliary participation. Specifically, CCD is reported separately because it is a regression task evaluated by NRMSE rather than balanced accuracy (where POSE improves over Target-only on both backbones), while targets such as HGD and TUEV also show gains on LaBraM or in the 3-fold evaluation (Table 7). On less responsive targets, strict validation thresholding can select an empty auxiliary set (), causing weighting and scheduling variants to collapse into identical target-only runs. Using a fixed setting () in Table 9 keeps auxiliary participation active for convenient observation, and POSE uses the exact same untuned configuration so the comparison is strictly fair.
Existing results in Tables 8 and 9 confirm that component benefits and their relative ordering hold across the full benchmark. On the four separated datasets in Table 9 alone, POSE still outperforms No Probe on 7 of 8 backbone and dataset pairs, outperforms or ties No Ramp on 7 of 8 pairs, and outperforms or ties Uniform Weight on 6 of 8 pairs, while matching or beating every variant on CCD. Furthermore, when combining Tables 8 and 9 across all 11 classification targets, the average gains of POSE decrease by at most 0.5% compared with the 8-dataset subset, remaining clear and consistent across both LaBraM and CBraMod (+2.32% and +1.95% over No Probe, +1.64% and +1.32% over Uniform Weight, and +1.81% to +2.09% over schedule ablations).
Response to Reviewer vKqS (Part 3/3): Non-Transformer Backbone (CodeBrain) & Pretraining Paradigms [W4, Q1]
W4 & Q1: Generalization Beyond Transformers on CodeBrain (SSM) and Diverse Pretraining Paradigms
Although POSE is conceptually backbone-agnostic, all evaluated EEG foundation models are Transformer-based. ... Could the authors evaluate POSE on non-Transformer backbones, such as the structured state-space modeling approach in CodeBrain (ICLR 2026), and alternative pretraining paradigms, such as JEPA-style predictive learning in PATCHCODE (ICML 2026)?
Evaluating POSE on the official non-Transformer CodeBrain backbone (ICLR 2026) under the balanced 5-fold protocol confirms that its benefits extend to structured state-space architectures. CodeBrain replaces self-attention with an 8-layer bidirectional S4 / spectral-convolution state-space encoder pretrained via dual temporal-frequency discrete codebook prediction. Using a common 20-epoch configuration across all six benchmarks (, , ), we compared Target-only, Meta-select equipped with the identical POSE phased schedule, and POSE (balanced accuracy in %, 5-fold standard deviation, with best per column in bold):
| Model | Variant | HGD | MAMEM1 | SEED-V | BCIC-IV-2a | SEED | SEED-IV | Average |
|---|---|---|---|---|---|---|---|---|
| CodeBrain | Target-only | 68.85 3.50 | 24.83 2.13 | 23.63 3.00 | 34.27 2.39 | 53.63 5.80 | 32.77 2.02 | 39.66 |
| CodeBrain | Meta + POSE schedule | 67.10 3.46 | 25.39 4.35 | 22.99 1.57 | 33.85 2.26 | 53.15 4.08 | 32.30 2.72 | 39.13 |
| CodeBrain | POSE | 69.03 4.20 | 27.47 5.83 | 22.90 1.73 | 34.93 3.34 | 54.24 3.91 | 33.18 1.90 | 40.29 |
Heuristic metadata grouping still induces negative transfer on a state-space backbone, whereas POSE consistently improves target adaptation. Even when given the exact POSE phased schedule, Meta-select falls below Target-only on almost every dataset, whereas POSE achieves the highest overall average (+0.63% over Target-only and +1.16% over Meta + POSE schedule) and improves performance on nearly all evaluated tasks, most notably on MAMEM1. Regarding PATCHCODE, its pretrained model weights are not publicly released, preventing a direct empirical evaluation. Nevertheless, because POSE operates solely on pooled penultimate backbone features during target-only probing without relying on attention maps or specific pretraining heads, it already generalizes across diverse pretraining objectives (neural-tokenizer masked prediction in LaBraM, continuous patch reconstruction in CBraMod, spatial-positional pretraining in REVE, and dual-domain codebook modeling in CodeBrain) and can be directly applied to JEPA-style predictive encoders once weights become available. We will include the CodeBrain evaluation in the revised manuscript.
Thank you again for your valuable suggestions, which have helped us significantly improve our empirical evaluation and manuscript clarity.
Response to Reviewer vKqS (Part 1/3): Endpoint-Only vs. Trajectory-Based Selection [W1, Q2]
We sincerely thank you for the thoughtful review and for recognizing our practical design. Below, we address each of your comments and questions point by point.
W1 & Q2: Downstream Effect of Endpoint-Only Selection (β=1) After Target-Only Probing
Combining endpoint discrepancy with its temporal slope (β=0.7) consistently improves downstream performance over endpoint-only selection (β=1) in the exact same target-adapted space. For this experiment and the new evaluations in W2 and W4 below, we adopt a subject-level balanced 5-fold cross-validation protocol across six representative benchmarks spanning motor imagery, emotion recognition, and SSVEP (HGD, MAMEM1, SEED-V, BCIC-IV-2a, SEED, and SEED-IV). Target subjects are shuffled into 5 balanced test groups so every subject is tested once across the 5 folds, with the next 2 subjects in circular order used for validation and the remaining subjects for training (strictly disjoint subjects across splits, 3 random seeds 42 to 44 averaged per fold, reporting 5-fold mean ± sample standard deviation in % across identical splits). Evaluating β∈{0,0.7,1} after the identical 4-epoch target-only probe while keeping the inverse-score weighting, phased training schedule, and hyperparameters fixed yields the following results (best per backbone and column in bold):
Across the evaluated backbones and tasks, POSE consistently outperforms both endpoint-only and trend-only selection. Relative to endpoint-only selection (β=1), incorporating the temporal slope raises average balanced accuracy by +1.31% on LaBraM and +1.90% on CBraMod, achieving clear gains on nearly all datasets (most notably on MAMEM1, SEED, and BCIC-IV-2a) while remaining virtually tied on the remaining two pairs. Conversely, relying on slope alone without an endpoint proximity anchor (β=0) degrades accuracy across every dataset on both backbones, confirming that post-probe proximity and adaptation trend provide complementary signals. We will include this controlled ablation in the revised manuscript.