- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper looks at joint pretraining on EEG datasets that use different montages and sampling rates. NeuroCodeX has two parts. A Hierarchical Topographic Encoder maps channels into predefined cortical regions at three levels of detail and runs coherence-based graph convolutions over them. A Multi-Scale Quantizer splits each signal into the five classic EEG bands and gives each band its own random-projection pseudo-labels. The method is tested on TUAB, TUEV, CHB-MIT and SEED-IV against ten baselines.
Critical strengths
-
The problem is real. Anyone who has tried to pool TUH, SEED and CHB-MIT data runs straight into mismatched montages and sampling rates, and most existing work simply resamples and pads. The paper makes a clear case for modeling these differences instead, and Figure 3 illustrates the issue nicely. I think the question matters to the EEG foundation model community even if this method turns out not to be the final answer.
-
Converting band limits into FFT bins for each sampling rate, as in Equation 10, is a simple and sensible way to avoid resampling. Table 10 supports it well. Resampling everything to 200 Hz cuts TUEV balanced accuracy from 0.410 to 0.361 and SEED-IV from 0.326 to 0.294. The CHB-MIT result is also impressive, with an AUC-PR of 0.596 compared with 0.369 for CBraMod.
Critical weaknesses
-
The experiments don't isolate the main claim. No baseline is jointly pretrained on the same data, so the gains might just come from more pretraining data. Joint gains are mixed. Pretraining on all four datasets lowers TUEV kappa from 0.371 to 0.355, and adding TUEV hurts CHB-MIT AUC-PR. The abstract stresses data-scarce settings, but no experiment varies the amount of labels. I'd like to see homogenization baselines such as BIOT trained on the same data.
-
I find the baseline numbers hard to trust. On TUEV and TUAB they sit far below the original papers. LaBraM-Base gets 0.386 and 0.618 balanced accuracy here, but its paper reports 0.641 and 0.814, and CBraMod reports 0.667 on TUEV against 0.407 here. On CHB-MIT, 21 of the 24 baseline means are identical to Table 8 of the CBraMod paper, yet none of the standard deviations match. Which numbers were actually rerun?
-
Some method details look off. Equation 15 involves no masking, so the encoder predicts codes of its own input and the task may be nearly trivial. In Equation 12 the reference phase uses the first frequency bin, which is zero for every band except delta. Table 13 puts T5 in the temporal region but P7, the same electrode position, in the parietal one. Six of the seventeen fine regions are also empty for TUH data.
Questions for authors
See weaknesses.