- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes BrainDuo, an EEG foundation model designed to improve EEG representation learning through dual-domain tokenization and structured spatiotemporal pretraining. The framework combines a shared spectrotemporal codebook, discrete and continuous supervision, and multi-scale attention mechanisms. Extensive experiments across 10 EEG tasks and 14 datasets demonstrate strong performance on general EEG benchmarks and competitive results under task-specific BCI evaluation protocols.
Critical strengths
-
The paper presents extensive experiments with well-designed evaluation protocols, covering both general EEG foundation model benchmarks and task-specific BCI settings. BrainDuo achieves consistent improvements across the general EEG benchmarks and competitive performance in several BCI-specific evaluations.
-
The paper provides detailed ablation studies to investigate the contributions of individual components. Additional analyses of pretraining versus training from scratch, pretraining data scale, and architectural configurations further support the effectiveness of the proposed design choices.
Critical weaknesses
-
In my view, the main concern with this work is what new insight or core technical contribution it offers, given the extensive prior research on EEG foundation models. BrainDuo introduces several incremental components, but I do not see a substantial conceptual difference between Duo Codebook, Duo Latent, DuoView Pretraining, and existing approaches. I appreciate the authors' extensive experiments and the strong empirical results. However, it remains unclear whether the improvements come from a genuinely new modeling insight or simply from combining and refining multiple existing techniques. Although the paper provides a number of ablation studies, the contributions of some finer-grained design choices are not sufficiently isolated. Overall, the work feels more like an extensive engineering refinement of existing methods than a significant methodological advance, and as a reader, I find the broader technical takeaway rather limited. Furthermore, I could not find publicly available code or a repository link in the submission, which raises additional concerns about the reproducibility of such a relatively complex framework with many interacting components.
-
The figures are rather difficult to follow, with dense text and multiple components compressed into limited space, particularly in Figure 1. This makes it unnecessarily difficult to understand the overall framework and its key contributions. I also find the term "BCI training skills" somewhat misleading. It initially gave me the impression that the paper involved some form of agentic or skill-learning framework, whereas these "skills" are essentially conventional BCI preprocessing and task-specific adaptation techniques. A more precise term would help avoid this confusion.
-
The paper lacks linear probing experiments, making it difficult to directly assess the representation quality of the pretrained model beyond full fine-tuning performance.
Questions for authors
- Could the authors provide an anonymized code repository? This would help reviewers reproduce and verify the experimental results.
4 comments
Thank you for the detailed response and additional experiments.
However, my primary concern regarding the limited methodological novelty of BrainDuo remains unresolved. Although the authors have provided further comparisons and explanations in the appendices, I still find that the three core components—Duo Codebook, Duo Latent, and DuoView Pretraining—are largely incremental extensions or combinations of existing techniques, rather than substantial methodological advances. As Reviewer aFYP also pointed out, similar ideas involving waveform and frequency-domain reconstruction have already been explored in CodeBrain, PATCHCODE, and TFM-Tokenizer. While BrainDuo combines these techniques differently, I remain unconvinced that such integration offers a sufficiently distinct technical insight beyond existing EEG foundation models. The additional ablations provide further evidence of empirical effectiveness, but do not fundamentally resolve this concern.
Furthermore, the integration of multiple interacting components introduces additional implementation complexity, making independent reproduction and verification particularly important. Unfortunately, the authors have not provided an anonymized code repository during the review process, and the proposed post-acceptance release does not address the current reproducibility concern.
I therefore maintain my initial rating of 2 (weak rejection).
Response to Reviewer bELw's Follow-up
We sincerely thank the reviewer for the continued discussion and for acknowledging our additional experimental evidence. We appreciate the remaining concerns regarding methodological novelty and reproducibility. We would like to further clarify how BrainDuo differs from existing EEG foundation models and why we consider its pretraining design a methodological contribution.
1. Methodological novelty beyond existing EEG foundation models
BrainDuo's contribution is not any single isolated component, but a pretraining framework that connects dual-domain tokenization, supervision at different granularities, and complementary spatiotemporal context modeling. The central idea is to use a common learned tokenizer to construct both local discrete prediction targets and broader continuous alignment targets, while learning EEG representations from distinct spatial and temporal contexts.
First, Duo Codebook and Duo Latent establish a direct connection between tokenization and backbone supervision. Existing approaches construct their learning targets differently. LaBraM uses discrete-code prediction from a separately pretrained tokenizer; CodeBrain learns separate temporal and frequency codebooks; and TFM-Tokenizer learns discrete time–frequency motif tokens. PATCHCODE additionally combines discrete-code supervision with continuous patch-level prediction from a momentum teacher.
BrainDuo instead uses a shared waveform–STFT tokenizer to provide two forms of supervision at different granularities: discrete patch prediction and continuous channel-level alignment. This allows the backbone to learn both local EEG patterns and broader temporal representations from a common target source. The contribution lies in how these targets are constructed and jointly used for pretraining, beyond simply combining existing learning objectives.
Second, DuoView introduces a distinct spatiotemporal context and masking formulation. CodeBrain combines global convolution with sliding-window attention, while CSBrain employs cross-scale temporal and regional modeling. PATCHCODE and REVE also investigate structured masking. DuoView differs by combining periodic factorized temporal/spatial attention with joint CTopo-based electrode–time neighborhoods. The same topology guides structured cluster masking, while complementary masked passes ensure that every patch is predicted from a context in which it is hidden.
The methodological contribution is therefore in how these mechanisms are organized for pretraining: Duo Codebook defines discrete and continuous targets from a common representation, Duo Latent applies them at different granularities, and DuoView provides the spatiotemporal context for learning from masked inputs. We do not claim novelty for STFT, vector quantization, attention, or structured masking individually. The contribution lies in this specific target-construction and contextual prediction formulation.
The expanded ablations support the effectiveness of these design choices across multiple EEG tasks, while also revealing task-dependent behavior. We have clarified the methodological distinctions and their supporting evidence in Appendix J.1–J.4, Table 31, and Tables 39–41 of the revised manuscript.
2. Reproducibility
We understand the reviewer's concern that the complexity of the framework makes independent verification important. We have expanded the manuscript's descriptions of the architecture, training objectives, target construction, data partitions, and evaluation protocols. We recognize that these details do not replace executable code. An anonymized repository is not available during review, and we plan to release the implementation and configurations after acceptance.
We sincerely appreciate the reviewer's careful consideration and constructive feedback. We hope these clarifications better communicate the methodological contribution and its distinction from existing EEG pretraining approaches.
Follow-up on Our Rebuttal
Dear Reviewer bELw,
We sincerely appreciate your time and constructive feedback. We hope our responses have helped clarify the concerns raised in your review and response. We would welcome your further thoughts and would be glad to address any remaining questions.
Best regards, The Authors
Response to Reviewer bELw
We thank the reviewer for recognizing the general-benchmark results and existing ablations, and for the critical questions about novelty, component attribution, presentation, and pretrained representation quality. We have expanded the methodological comparisons and component experiments and added a six-dataset frozen-feature evaluation. The additions are marked in blue.
[W1] Core technical contribution and evidence for individual components
BrainDuo contributes a coupled target-and-context design for EEG pretraining, rather than claiming that waveform reconstruction, STFT, vector quantization, or structured attention is new in isolation. Duo Codebook learns a shared waveform–STFT tokenizer. From that frozen tokenizer, Duo Latent obtains both patch-level discrete codes and electrode-level continuous targets by pooling pre-quantization features over time. DuoView then supplies factorized cyclic context and joint CTopo–time neighborhoods for predicting those targets. This differs from the target sources and context organizations of LaBraM, CodeBrain, PATCHCODE, and CSBrain, as clarified in Appendix J.1, Table 31.
To examine what each choice contributes, we extended the ablations to two additional datasets (Tables 39–41) and added an unmasked-input control (Table 38). In balanced accuracy:
The complete tokenizer has the highest reported means among the tested reconstruction variants, and CTopo outperforms random and montage-distance masking on both added datasets. Joint supervision is not uniformly better: discrete-only wins on FACED-9, whereas joint supervision wins on ISRUC-S1. Separately, masked pretraining improves TUEV balanced accuracy from 0.6118 to 0.7242 over the clean-input control (Appendix L.5, Table 38). These controls attribute benefits to specific choices without claiming that every component helps on every task or that separate ablations establish a higher-order synergy. Appendix J.4 now discusses that scope explicitly.
[W2] Figure readability and the term “BCI training skills”
We appreciate the concern about the dense overview. The original Figures 1 and 2 are retained, but Appendix J.3 adds a panel-level reading guide distinguishing tokenizer learning, the two attention-context patterns, complementary masked passes, and downstream adaptation. We also clarify the terminology in the prose: “BCI training skills” refers to task-specific preprocessing and adaptation, such as filter banks, channel selection, denoising, and trial averaging. These are established BCI procedures integrated into the evaluation pipeline, not a learned skill library or an agentic mechanism. We do not claim that the original figure density has been eliminated.
[W3] Frozen-backbone linear probing
Following the reviewer's suggestion, we added linear probing on six datasets (Appendix L.3, Table 36). The pretrained EEG encoder is frozen and only a linear classifier is trained on its representations. Balanced accuracy against CSBrain is:
BrainDuo has higher balanced accuracy on five of six datasets, with ISRUC favoring CSBrain. These results directly assess pretrained features without full backbone fine-tuning. We also clarify that the existing t-SNE figures visualize fine-tuned rather than frozen representations (Appendix J.5).
[Q1] Anonymized code repository and reproducibility
We understand the importance of executable code for reproducing the results. An anonymized repository is not available during review; we plan to release the implementation and configurations after acceptance. To make the current manuscript more useful for reproduction, the appendices clarify the target definitions, training objectives, data partitions, and evaluation protocols (Appendices A, J, and L). We recognize that these descriptions do not substitute for a runnable repository.
We appreciate the reviewer's suggestions, particularly the request for frozen-feature evaluation, which provides a more direct assessment of the learned representations. We welcome any further questions.