- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work examines EEG-based auditory attention decoding (AAD) under a practical setup: auxiliary signals (EOG or ear-EEG) are accessible during pretraining but unavailable during inference. The framework consists of three stages: (i) A joint tokenizer, (ii) An EEG-only encoder, (iii) The frozen encoder outputs. The authors evaluate leave-one-subject-out cross-subject generalization and cross-dataset transfer on two datasets: AVGCAAD (EEG+EOG, 12 participants) and EARAAD (scalp EEG + ear-EEG, 15 participants). Ablation experiments and hyperbolicity analysis are also included.
Critical strengths
The problem formulation is practically meaningful. Auxiliary recordings are frequently unavailable in real deployment, so leveraging them solely for training is a sensible research goal. Testing across two datasets with distinct auxiliary modalities (EOG versus ear-EEG) matches this motivation. The tokenizer supports variable channel counts, removing the requirement for identical channel layouts when performing cross-dataset transfer.
Critical weaknesses
-
Reported accuracy values sit near chance level, and performance margins are far smaller than observed variance. The task is binary classification with a 50% chance baseline. Across-subject standard deviations on EARAAD range from 12 to 19 pp. With only 15 subjects, the standard error alone reaches roughly 3–3.5 pp. No statistical significance tests are provided. Therefore, the claim that the proposed method “outperforms a range of state-of-the-art baselines” lacks sufficient support.
-
Critical ablation supporting the core claim is absent. The main contribution of this paper is multimodal-to-unimodal representation transfer. However, Figure 3 does not test the identical pipeline with a tokenizer trained only on EEG, i.e., without auxiliary signals. Without this comparison, any observed improvements (if genuine) may merely stem from LaBraM-style masked code prediction.
-
The novelty claim is overstated, and relevant prior work is omitted. Training using a modality available only during training corresponds to the classic learning using privileged information / cross-modal distillation paradigm. A substantial body of literature already addresses missing-modality settings, including EEG studies using eye-tracking as privileged information. None of these references are cited, even though the first contribution is presented as a new formulation.
-
The paper fails to address the well-known gaze confound in AVGCAAD, and standard AAD baselines are missing. The AV-GC-AAD dataset was specifically constructed to decouple gaze direction from auditory attention direction. Its original developers reported that spatial attention direction classifiers cannot achieve statistically significant above-chance performance on this dataset, while linear stimulus reconstruction works even in cross-subject settings. Two key implications arise: (a) All baselines adopted here are direction classifiers. (b) EOG serves as the auxiliary modality for the proposed method, and EOG directly encodes the gaze signal that the dataset was designed to eliminate.
Questions for authors
-
Are performance improvements over EEGMOCE / LaBraM statistically significant via paired across-subject tests? How many individual subjects achieve accuracy significantly above chance?
-
What performance can a linear stimulus-reconstruction baseline reach under identical windowing and evaluation protocol? What are split results for gaze-congruent and gaze-incongruent conditions on AVGCAAD?
-
What happens when the tokenizer is pretrained using EEG alone (no auxiliary signals), keeping all other components unchanged? Is auxiliary data fed into the tokenizer when generating MCP target codes?
-
In every LOSO fold, is the held-out subject excluded from both pretraining stages?
-
How can a channel-permutation-invariant, mean-pooled encoder represent hemispheric lateralization? What do you get with channel embeddings added back?