- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces the Interference–Neural Confusion by adding four families of simulated electromagnetic interference to two public EEG datasets. It proposes the Sense–Gate–Calibrate (SGC) framework, combining spectral detection, STFT frequency masking, and conformal calibration. Experiments on workload and motor imagery examine how interference detectability and the loss of task information affect decoding performance.
Critical strengths
- The research problem has practical value.
- Electromagnetic interference can overlap with neural frequency bands needed by a task, so removing interference may also remove useful information. The paper examines when the method succeeds and fails.
- The controlled evaluation is reasonably systematic.
- Experiments cover different interference types, multiple interference levels, and evaluation across subjects. The paper also includes the complete four-class motor imagery task and a replication covering all 48 STEW participants.
- Both recovery and failure cases are reported.
- The narrowband interference experiments on STEW show substantial recovery. The motor imagery results, frequency-band ablations, and broadband detection failures also document cases where the method has limited effectiveness or fails.
Critical weaknesses
- The added value over conventional filtering needs clarification.
- How does detecting interference and masking the corresponding frequency bands differ substantively from conventional band-stop or notch filtering? A direct comparison under suitable narrowband conditions would help clarify this.
- The realism of the simulated interference has not been validated with measurements.
-
Interference is directly added to previously recorded EEG, assuming that the original signal remains unchanged and only additive noise is introduced. The authors should explain whether the interference considered in real environments only contaminates the recordings or may also affect the underlying brain activity. If the latter is outside the scope of this work, this should be stated, together with the real conditions represented by this noise addition.
-
The simulation also adds the same waveform to all channels, changing only its amplitude. Measurements are lacking to establish which channels and frequency bands are affected by real interference, whether channels are affected differently, and how these differences influence task decoding. Such evidence is needed to support the representativeness of the simulated interference types, parameters, and distribution across channels.
- Task coverage is too narrow to generalize the reported gains to other EEG tasks.
- Only workload and motor imagery are evaluated. Substantial recovery is mainly observed on STEW. Under F1 at SIR −10 dB, gating provides no mean gain in the main left/right motor imagery experiment. The complete four-class task shows improvements of approximately 1.8–3.5 percentage points, but these gains are limited. Increasing the number of participants and extending the motor imagery classes do not broaden the types of tasks evaluated. The evaluation should cover more representative EEG tasks to establish whether other tasks also benefit.
- Effectiveness across EEG frequency bands and tasks needs broader validation.
- EEG activity is commonly analyzed in frequency bands such as alpha, beta, and gamma, and different tasks use these bands and their associated information differently. The authors should explain which bands are affected by real interference, whether multiple bands are affected simultaneously, and what information is lost from different tasks after masking. The paper includes motor imagery band ablations and analysis of failures under broadband interference, but these results are insufficient to establish performance on other bands and tasks. Further validation should examine the overlap between interference bands and bands needed by each task, identifying when the method restores performance, provides limited gains, or removes useful information.
- Validation in real recording settings is missing.
- The authors should clarify whether STEW and BCI Competition IV 2a were collected in electromagnetically shielded environments and what filtering was applied during acquisition. Although the underlying EEG was recorded from real participants, the interference is added digitally afterward. This cannot replace validation with interference occurring during actual acquisition. At minimum, the method should be evaluated on EEG collected in an environment without electromagnetic shielding, using either public data or data collected by the authors. The authors should explain how real EMI is identified and report the decoding gains and their stability. This limitation is acknowledged, but the current simulations alone still make it difficult to assess the method’s effectiveness in real settings.
Questions for authors
-
Are there EEG recordings from real settings, particularly unshielded environments, that can be used to evaluate the method? Either public data or data collected by the authors could be used. Does the method provide stable gains on these data?
-
Does the interference in real environments mainly contaminate the recordings, or may it also affect the underlying brain activity? If the latter is outside the scope of this work, please state this. Under what real recording conditions is directly adding simulated noise a suitable model?
-
Which channels and frequency bands are affected by real interference? Is there measurement evidence supporting the assumption that interference has the same waveform across all channels and differs only in amplitude?
-
For EEG tasks beyond workload and motor imagery that use frequency bands differently, what task information is affected by the interference? When interference overlaps with bands needed by a task, under what conditions does the method work, provide limited gains, or fail?