- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes a new method for using multi-objectives in Foundation model training. They tackle different limitations of existing multi-objectives method in the literature such as the impossibility of modality competition. Their method is motivated by theoretical insights and experiments over 3 backbones and different EEG datasets is done.
Critical strengths
First the paper reads well, the motivation of the work is well written and it is easy to follow where the authors wants to go. The method is also motivated by theoretical insights.
The paper tries to tackle an open question that is if multi-objectives can help for FM for EEGs.
Critical weaknesses
If the motivation are clear I am skeptical about the fact that this study and the results gives a clear conclusion of what it is interesting for EEG FM training:
- First, the superiority of MAPE is not clear in all the study. The scores are often slightly above and the increase almost everytime inside the std range. Having a statistical test to show that the increase is significant could help to prove the utility of MAPE.
- Second, an interesting part of the study is to understand if the loss used by the original authors of the model is really useful or not. For example in this workshop paper [1], the authors shows that a non-specific model Mantis is working well on EEG task. They claim that contrastive learning is helping for classification task, I'm wondering if losses of pre-training is task dependant. Adding other type of task could help to understand this behavior.
- The settings of pre-training, except for Mantis with cauker, is not the one used orignal paper. For FM pre-training, you often need a lot of data, I'm wondering if the results are robust to the number of data in the pre-training. The conclusion will be strengthened by at least a study of the size of the pre-training datasets. I understand that computationally speaking training a FM is long, but for this particular study I think it matters.
- Last, the authors claim in the abstract "lost-cost approach" and then in the limitations they say that "A limitation of our work is the inherently higher cost of pretraining". It should be clarify in the paper what the authors mean by "lost cost".
Small weaknesses:
- The colors of Figure 1 are misleading. Each Losses have a color which is also in the latent space z. In the first place we want to link the colors between them.
- OOD setting of Table 1 is never explained in the main paper nor criticised. It adds information but without any further information. Especially that in OOD settings MAPE seems to give less good results which is a setup that practitioners can deal with a lot.
- You could only have one big Table with the two and three objectives, you will avoid duplicated lines and it will avoid back and forth between the tables for the reader.
Overall this study is interesting but it lack of further experiments and metrics to emphasise the need of their method.
[1] Gnassounou et. al., Leveraging Generic Time Series Foundation Models for EEG Classification, 2025
Questions for authors
See weaknesses.