- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors introduce Mean-Field Flow (MFF), a class-conditional EEG generator trained separately on each of 14 datasets. It combines the idea of one-step flow generation with mean-field token coupling. In the experiments, MFF showed the best quality of synthetic EEG data and could act as a data augmentation tool that improves decoding performance.
Critical strengths
- The proposed latent-free, one-step generative framework operates directly on raw EEG. The reported inference efficiency is particularly impressive, which could be useful when large quantities of synthetic EEG are required.
- The authors tested quite a lot of datasets and models, thereby giving convincing empirical results.
Critical weaknesses
- Limited depth of scientific findings and neurophysiological interpretation that are useful for the broad community.
I acknowledge the extensive evaluation across diverse EEG datasets. I feel that the work could have established substantially more meaningful scientific findings. The experiments primarily demonstrate improvements in statistical similarity and downstream classification performance, but provide limited insight into what physiologically meaningful information the generator actually learns. Although the authors evaluate spectral statistics, phase locking, and ERD-related spatial patterns, these analyses remain relatively superficial. It is unclear whether the generated signals preserve task-specific neural characteristics, distinguish meaningful neural activity from recording artifacts, or offer new insights into EEG physiology. Given the potential of generative modeling, I believe this represents a significant missed opportunity.
- Unclear practical utility and conditions under which synthetic EEG is beneficial.
The motivation of the paper is closely related to EEG data scarcity, yet the experiments do not establish when synthetic EEG generation is practically useful or how much real data it can replace. In particular, EEG exhibits substantial variability across subjects, sessions, and recording conditions. The benefit of synthetic augmentation may depend strongly on the available real-data quantity and quality, task characteristics, and whether the generated signals represent the target subject or a broader population. While the authors provide useful augmentation controls and investigate synthetic-data ratios, these experiments do not establish whether synthetic EEG is preferable to collecting additional independent real recordings, or under which circumstances the proposed approach offers meaningful data-efficiency improvements. For the field, I think people are more interested in knowing in which cases one should simply record more data from the subject/patient or when such a generative model could be used.
- Limited generalizability across datasets and decoding approaches.
Although the paper evaluates 14 diverse EEG datasets, the generative model is trained independently on each dataset. Consequently, the proposed framework does not exploit shared knowledge across subjects, tasks, or recording configurations. Its reliance on dataset-specific channel ordering further limits its applicability across electrode montages and devices. Additionally, downstream task performance gain is primarily demonstrated using neural-network classifiers, particularly pretrained CBraMod. It remains unclear whether the augmentation benefits extend to classical EEG decoding approaches or stronger foundation models. These limitations make it difficult to assess the broader applicability of the proposed framework beyond the specific datasets and evaluation configurations considered.
Questions for authors
-
Beyond matching statistical distributions, can the authors provide more detailed analyses of whether generated EEG preserves established task-specific neurophysiological markers? For example, does the model learn channel-specific comparisons of class-specific dynamics, spectral differences between subjects/ tasks, hemispheric lateralization, or clinically meaningful waveform characteristics between abnormal and normal EEG?
-
How do the authors evaluate the quality and physiological informativeness of individual generated samples? Since the training datasets may contain recording artifacts and noisy signals, how can one distinguish realistic neural activity from realistic artifacts? Could the proposed framework also help identify high-quality EEG or reveal meaningful differences between normal and abnormal conditions?
-
How do generation quality and downstream effectiveness vary with the quantity and quality of real training data? The evaluated datasets differ substantially in size and task characteristics, but this does not establish how much real data is necessary to train a useful generator. Could the authors provide controlled data-scaling experiments and investigate whether the benefits depend on task complexity, subject diversity, and data quality?
-
Can synthetic EEG meaningfully substitute for additional real recordings? For example, how does training with 80% real data plus 20% synthetic data compare with using 100% real data, when the generator is trained only on the initial 80%? Given inter-subject variability, it would also be informative to compare additional real or synthetic data originating from the target subject versus other subjects, ideally across different calibration budgets.
-
Why is the model trained independently on each dataset rather than learning a shared EEG representation across datasets? Could the authors investigate whether pretraining on larger EEG corpora enables transfer or few-shot adaptation to smaller datasets, potentially with electrode-aware representations that generalize across montages? I think a general model would be more useful to people working on different downstream tasks.
Dear Reviewer jqEp,
Thank you again for your constructive feedback and positive assessment. We have incorporated the explanation of L1’s effectiveness and the additional loss comparisons into Section 3.4 and Appendix C, with changes marked in blue. We hope these additions fully address your question and reinforce your positive assessment. We greatly appreciate your time and support.
Best,
The Authors