- Rating
- 2(−1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1(−1)
Read review
Paper summary
The paper proposes an architecture NeuroIntentFormer for predicting left or right based on EEG signals in an individual generalization setting.
NeuroIntentFormer resembles an ensemble setup, with a difference that the aggregation function is an MLP with access to the experts predictions as well as some input statistics.
The model showed superior BAcc against Classical feature methods, Task-specific deep models and Pretrained EEG references. In those comparisons. Considering the 95% confidence intervals obtained via bootstrap, the model did not clearly outperform most of the models.
Additional experiments showed the model relied on both the input context and the evidence, and that each expert relies on a different time region of the signal (Early, Middle and Late).
Critical strengths
The paper presents well related works and describes in a precise way the high-level architecture proposed, cleverly comparing it to expert routing and ensemble.
The BAcc obtained is relevant, outperforming various models from previous works and the benchmark is broad, including Classical feature methods, Task-specific deep models and Pretrained EEG models.
Critical weaknesses
Figure 1 proposes using the pipeline of NeuroIntentFormer to predict uncertainty and conditionally pause and allow therapist review. This is not reanalyzed by the authors in experiments and their conclusions, being only presented in Appendix G. Similarly, it is not shown how the evidence based would be beneficial for interpretability, in the sense of what would be the meaning of each expert's prediction.
Some elements of Figures and Tables don't seem to be fully described in the paper or are described but under a different name in the text:
- Shared Encoder
- Local Conv.
- Temporal Expert
- Fixed temporal profiles
- Homogeneous Transformers
- Uniform mean fusion
- channel/time consistency
It is unclear the relative importance of each of evidence sources.
Questions for authors
Were the baselines trained with the same channel-drop/time-shift views?
Could per-source ablations and the distribution of gate weights across patients and trials be run?
Can the elements described in Critical Weaknesses be better described in the text?