- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes MGNet, an EEG classification framework combining three specialized experts for temporal, spectral-spatial, and Riemannian covariance representations. A lightweight router dynamically weights these experts, while Manhattan-distance-based attention fuses their outputs. Evaluated on three BCI datasets (BCI IV-2a, BCI Challenge, and MAMEM), MGNet outperforms the evaluated baselines. The authors also investigate computational efficiency, robustness, and expert contributions through ablation studies.
Critical strengths
1.Matching expert types to known EEG mechanisms is a sensible, interpretable idea. 2. The comparison includes classical paradigm-specific pipelines (FBCSP, xDAWN, CCA/TRCA) with paired tests, which is good practice. 3. The paper reports results that don't favor it, including the router collapse in Table 6 and no_router beating the full model, and it is upfront about the limits of the router analysis.
Critical weaknesses
-
The main motivation is never tested. The paper argues that one shared encoder suffers interference across paradigms, but every main result trains a separate model per subject on a single dataset, so the model never sees more than one paradigm. The only pooled multi-paradigm experiment (Table 6) shows the router collapsing onto one expert (max weight 0.997).
-
The ablations don't support the full design.
a) On MAMEM, several reduced variants beat the full model (59.18): no_router (62.64), no_A (61.45), and no_C (64.27). Expert B alone gets 65.18
b) On BCI Challenge, no_router (81.33), no_fusion (81.04), and no_B (80.37) also beat the full model (79.77).
c) The full model is best only on BCI2a.
With these results what exactly is the motivation behind the design. These results do not support the design choices authors made which make the choices seem unncessary?
-
The router doesn't really route. Average weights are about 1/3 per expert on BCI2a and MAMEM, which amounts to doing nothing. On BCI Challenge the weight goes 0.999 to Expert A, which is collapse, and it chooses A even though B alone scores better there (76.26 vs 74.16).
-
The baseline comparison is questionable
a) MAtt (Pan et al., NeurIPS 2022 is miscited in the paper as Congedo 2017 / Huang & Van Gool 2017) evaluated on these same three datasets, and the paper says it follows MAtt's preprocessing. MAtt reported about 74.7% on BCI2a and 65.5% on MAMEM, higher than MGNet's numbers. Here MAtt is listed at 62.96% and 54.54%. Please explain this gap or report MAtt's published numbers.
b) DeepConvNet is at 35.6% on BCI2a which is near chance. Is it possible the moel was undertrained? Or is it just a lack of the model's capabilities?
-
The BCI Challenge dataset is cited as Chavarriaga & Millán (2010). It is actually the Kaggle BCI Challenge @ NER 2015 P300-speller ErrP data.
-
Fig. 2 places tangent-space mapping after fusion, while Section 3.4 places it before. Please clarify.
-
Novelty over existing multi-branch and MoE EEG models is incremental.
Questions for authors
See weakness