- Rating
- 4(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper propose a new model using State Space Model for EEG tasks. The model introduces different pre-training stage using masked reconstruction, ARM and JEPA-style loss. Their model is applied on different EEG task and show better results with less computational resources.
Critical strengths
- The paper is well written and very easy to follow. Each step of the method is clear and come with nice figure to illustrate them.
- The motivations are clearly introduced and the results show that CaMBRAIN achieves good results with less computation time.
- The method based on State Space Models are perfectly fit for EEG data.
Critical weaknesses
If all the introduction and methodology part is clear and well written, the experimental part lacks a bit a details:
- The paper should mention in the main part the pre-training dataset used.
- One claim is that CaMBRAIN is more computationally efficient. However the GFLOPS are given only for one table. I am wondering why we don't have a study of compute resource for all dataset?
- CaMBRAIN is the best for all datasets except TUAB, but the authors pass through this without explaining why. It would be interesting to have a discussion about why potentially it is failing.
- On the ablation study the case where only stage 2 is tested is not on the table. It could be nice to have this last ablation study to see if stage 1 is important. Also stage 1 and 2 comprise both of them two losses. Did you try to remove one of them ?
- My last point is on the claim "real time". If I understood properly, the signal is passed entirely to the model. So for each new record t, how do CaMBRain works ? Do it need to repass all the signal to the model? I don't really see the difference with the other model. Each model is taking a part of the signal to represent the last step. The differences comes from what you are taking to represent the last token no?
Questions for authors
-
Do you re-train all the model are take the value of the orignal papers. If yes which values ? I'm wondering how comparable are this results. If CamBRAIN needs to be retrain for each new datasets, the computational time can be high against FM.
-
If you chose a step delta, you have a delay to detect anomalies no ? Is it possible to get rid of this step and directly give time step to the model rather than passed to an encoder first ?
-
Do you think having a bigger pre-training set will increase the results ? Did you check the results with increasing number a training data to see if you reach a plateau ?
5 comments
I thank the authors for their answers that clarify most of my points. I am still concerned about the choice of fine-tuning Luna and Reve on CHB-MIT. Why only these two for this dataset ? Having different models for different datasets seems like cherry picking the good competitors for each datasets. Having a clear discussion for all these choices could help to strengthen the trust in the results.
Reply to comment by Reviewer yr1y
We thank the reviewer for the prompt follow-up and the opportunity to clarify our baseline choices.
We chose LUNA and REVE because they are two of the strongest available EEG encoders. We fine-tuned them on CHB-MIT because we wanted to evaluate their performance in continuous streaming. Adding causal EMA or trained GRU memory to their window representations did not close the forecasting gap to CaMBRAIN (Table 14). We would also like to point out LUNA and REVE do not report on CHB-MIT
On other datasets, we compare with their published results on MAT, TUAB and TUAR.
CaMBRAIN also achieves higher AUROC than LUNA and REVE in linear probing experiments (Table 18), supporting the fact that CaMBRAIN's training regiment led to better quality representations without encoder fine-tuning.
Response to Reviewer yr1y
We thank the reviewer for the constructive review and the detailed questions. We address each point below.
W1 -- Pretraining dataset in the main text
Thank you for the suggestion, we have added details of our pre-training dataset into the main text (highlighted in green).
W2 -- Compute across datasets
We have extended compute reporting to MAT, TUAB and TUAR in Table R3 below. Note that the only difference in latency comes from the numbers of EEG channels in each dataset: MAT uses 19 channels, whereas TUAB and TUAR use 22. Besides that, CaMBRAIN and all baselines are dataset-agnostic with respect to compute cost.
Table R4: GLOPS/s measurements on all datasets reported in the paper.
W3 — TUAB performance gap
Published TUAB results improve with larger bidirectional models. Our focus is continuous, real-time inference, so we prioritize a lightweight causal readout and low computation per update. Please note Parameter count alone is not a like-for-like comparison: at any time step a bidirectional model sees both past and future samples in its window, while a causal model sees only the past. We discuss causality and bidirectional processing further in the paper in §3.1 and Appendix A.19 (Table 22).
Table R5: Comparison between model size and TUAB performance.
W4 -- Stage-2-only
We provide a Stage-2-only experiment on the TUAR dataset below in Table R6. The table shows that combining both of our proposed stages of training yields the best results - we have added this row to our ablation table in the edited rebuttal pdf (highlighted in green).
Table R6: Ablation table with Stage 2-only training included. Using both stages of our proposed method yields best results.
We have not separately ablated the individual loss terms. As described in §§3.2.1–3.2.2, the masked objectives train the model to recover missing EEG content or representations from causal context, while the autoregressive objectives encourage the current hidden state to retain information predictive of future activity. We give further motivation for our training strategy and its alignment with state space models in our response to W1(a) of Reviewer HmMm.
W5 -- CaMBRAIN Streaming
CaMBRAIN processes only the EEG patch when it arrives, updates its hidden state (which compresses all previously seen context), and produces the next prediction. Earlier EEG samples are not re-computed since the recurrent hidden state are carried forward over time, keeping per-update computation constant and independent of recording duration (see Fig. 1).
Q1 -- Baseline results and evaluation
Thank you for pointing this out - we fine-tuned LUNA and REVE on CHB-MIT and have added this note in the edited rebuttal pdf. All other baseline scores are taken directly from the original papers. Please note LUNA and REVE also perform downstream fine-tuning, which we also identically follow.
Moreover, CaMBRAIN achieves higher reported AUROC on CHB-MIT than LUNA and REVE under both fine-tuning and frozen-encoder linear probing (Table 1b; Table 18).
Q2 -- Step size and anomaly-detection delay
We follow the same patch tokenization method as LUNA and REVE to enable channel-agnostic EEG inference. Bypassing this tokenizer would remove the mechanism that supports performing EEG inference on any number of channels (as discussed in W2 above). This tokenization is still causal: each token uses the current, already acquired patch, and temporal processing accesses only current and past tokens.
Q3 -- Pretraining-data scaling
Larger and more diverse pretraining data could potentially further improve performance. We trained on the full TUEG corpus (~21,000 hours), while REVE uses over 60,000 hours across 92 datasets and reports stronger TUAB performance. Despite this, our current results demonstrate strong TUAR, CHB-MIT and MAT performance (Tables 1–2) alongside compute 158× lower than REVE (Table 1b). Using a larger pre-training corpus could serve as one promising avenue of future work.