- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes NeuroOnline, a framework for supervised online adaptation of EEG foundation models to address pretraining-downstream task misalignment and non-stationary distribution shifts. The framework integrates two components, including Multi-view Consistency Learning and Context-aware Representation Modulation. Experiments across 8 EEG datasets on 4 foundation models demonstrate improvements over offline fine-tuning, conventional supervised online adaptation, and a test-time training baseline.
Critical strengths
1.The motivation is convincing
2.The evaluation is comprehensive, covering 8 datasets across 4 pretrained backbones.
Critical weaknesses
1.Although the paper emphasizes strictly causal, predict-then-update learning, Table 6 reports three training epochs and a batch size of 64 for online methods. It remains unclear how these settings are implemented in a sequential data stream, whether previously observed samples are revisited, and whether predictions are always evaluated before the corresponding labels become available.
2.Multi-view consistency regularization and prompt-conditioned feature modulation are conceptually related to established representation learning and feature-wise adaptation techniques. It would be helpful to show more evidence on how such techniques reduce pretraining-downstream misalignment.
3.The computational analysis focuses on forward GFLOPs and compares NeuroOnline against an offline baseline. It would be better to account for the complete cost of online backpropagation and multi-view augmentation.
Questions for authors
See my weaknesses
5 comments
Response to Reviewer 9Dwc (2/3)
W2: Pretraining–Downstream Task Misalignment.
Response:
Alignment with downstream tasks. To provide more direct evidence of how MCL and CRM mitigate pretraining–downstream task misalignment, we conduct an additional representation-level analysis using LogME (You et al., 2021), which quantifies the compatibility between EEG representations and downstream task labels based on the marginal likelihood of a Bayesian linear model. Higher LogME indicates better alignment between the representations and downstream labels. Under the same evaluation protocol, we compare NeuroOnline with the following four configurations.
(i) Pretrained CBraMod. We extract representations from the pretrained CBraMod backbone before downstream fine-tuning.
(ii) off-FT-MLP (fullfine-tuning). We attach an MLP classification head and fine-tune the entire model end-to-end.
(iii) NeuroOnline w/o MCL. We remove both augmented views together with the consistency objective.
(iv) NeuroOnline w/o CRM. We remove the CRM module.
Results. As shown in Table R10, NeuroOnline achieves higher LogME than all ablated variants. Together with the ablation results in Table 4 (the original manuscript), these results suggest that MCL and CRM help mitigate pretraining–downstream task misalignment by making the learned representations more informative for downstream classification.
Table R10. Downstream Task Alignment of EEG Representations Measured by LogME.
| Method | BCIC-2A ↑ | BCIC-2B ↑ | MentalArithmetic ↑ |
|---|---|---|---|
| Pretrained CBraMod | -0.5324 ± 0.0000 | -0.6823 ± 0.0000 | -0.3212 ± 0.0000 |
| off-FT-MLP (fullfine-tuning) | -0.4958 ± 0.0138 | -0.6294 ± 0.0153 | -0.1967 ± 0.0309 |
| NeuroOnline w/o MCL | -0.4373 ± 0.0087 | -0.5612 ± 0.0124 | 0.0548 ± 0.0251 |
| NeuroOnline w/o CRM | -0.4239 ± 0.0092 | -0.5580 ± 0.0109 | -0.0106 ± 0.0264 |
| NeuroOnline | -0.3823 ± 0.0096 | -0.3735 ± 0.0131 | 0.2310 ± 0.0275 |
[1] You, Kaichao, et al. "Logme: Practical assessment of pre-trained models for transfer learning." International conference on machine learning. Pmlr, 2021.
Response to Reviewer 9Dwc (3/3)
W3: Computational Cost of Online Adaptation.
Response:
Computational cost. We extend our computational cost analysis to include inference latency, data augmentation time, online update time (including forward and backward propagation), and peak GPU memory consumption. As shown in Table R11, NeuroOnline incurs additional computational overhead compared with conventional online full fine-tuning, primarily due to multi-view augmentation and consistency-based optimization. Nevertheless, the increase in inference latency is relatively modest, while data augmentation introduces less than 0.5 ms of overhead per segment.
Asynchronous model updates. To avoid blocking online prediction during adaptation, we analyze NeuroOnline’s robustness to asynchronous model updates in Section 4.8 (the original manuscript). NeuroOnline can be deployed with separate inference and adaptation processes. The inference process continuously handles incoming EEG segments using the current model, while the adaptation process updates a model replica in parallel and atomically activates the updated model upon completion. Since an update may not finish immediately, inference may temporarily rely on stale parameters. We therefore simulate synchronization delays of EEG segments, where denotes the number of subsequent EEG segments processed by the currently deployed model before the updated model is activated. The corresponding delays are approximately 0, 5.3, and 10.7 minutes on Mumtaz2016 and 0, 4.3, and 8.5 minutes on BCIC-2A, respectively. The case corresponds to immediate synchronization. As shown in Fig. 3(F-G), NeuroOnline maintains comparable performance for delays of up to 128 EEG segments, with only limited degradation across the evaluated datasets. This indicates robustness to moderate parameter staleness. By decoupling inference from adaptation, the asynchronous design avoids blocking prediction while introducing only a bounded delay in deploying updated parameters, supporting practical deployment in latency-sensitive EEG applications.
Notes. We compute update time as follows:
= \frac{\text{Total online update time (including the original segments only)}}{\text{Number of Segments in the Test Stream (including the original segments only)}}.$$ $$\text{Update Time (NeuroOnline)} = \frac{\text{Total online update time (including the original segment and its time-masked and frequency-masked views)}}{\text{Number of Segments in the Test Stream (including the original segments only)}}.$$ **Table R11. Computational Cost Comparison of NeuroOnline with Offline and Online Full Fine-Tuning on BCIC-2A and Mumtaz2016.** | Method | BCIC-2A | | | | Mumtaz2016 | | | | | :--- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | | | Latency (ms) | Aug. Time (ms/seg.) | Update Time (ms/seg.) | Peak GPU Memory (GB) | Latency (ms) | Aug. Time (ms/seg.) | Update Time (ms/seg.) | Peak GPU Memory (GB) | | off-FT-MLP | 8.58 | — | — | 0.233 | 8.61 | — | — | 0.250 | | on-FT-MLP | 8.80 | — | 6.59 | 0.745 | 8.87 | — | 12.95 | 0.633 | | **NeuroOnline** | **9.99** | **0.43** | **19.15** | **4.352** | **9.43** | **0.42** | **37.66** | **4.617** |
Response to Reviewer 9Dwc (1/3)
We sincerely thank the reviewer for their helpful suggestions.
W1: Predict-then-Update Protocol.
Response:
We further clarify the online data processing and model update procedures to ensure a more transparent and reproducible evaluation protocol.
Online Update Schedule. NeuroOnline maintains a historical buffer with a capacity of 320 labeled EEG samples, managed using a first-in, first-out (FIFO) strategy. Each incoming sample is first used for prediction, and its label is revealed only afterward. The newly observed sample is then added to the buffer, with the oldest sample removed when the buffer reaches capacity. An online update is triggered every 64 newly observed samples. During each update, all samples in the buffer are used for optimization with a mini-batch size of 64 over 3 epochs. This strategy enables the model to periodically incorporate recent labeled observations while retaining historical information for continuous adaptation.
The complete online optimization configuration is summarized in Table R6. These additional details clarify the online update schedule and historical sample utilization, improving the reproducibility of our evaluation protocol.
Table R6. Hyperparameter Settings for Online Evaluation.