W1. The experimental design does not adequately isolate recording-scale pretraining from architectural advantages and downstream contextualization.
The central claim is that incorporating long-range EEG context during self-supervised pretraining produces more transferable representations than approaches that learn context only during downstream adaptation.
However, the principal comparisons evaluate frozen M²-EEG representations against conventional EEG foundation models whose pretrained representations are primarily local. The competing models do not receive comparable recording-level contextual processing within their pretrained backbones.
Although this comparison is meaningful for assessing the representations available immediately after pretraining, it does not determine whether the gains are attributable to the proposed pretraining paradigm, hierarchical architecture, longer effective receptive field, or additional representational capacity.
The paper includes a downstream temporal-aggregation comparison on NMT, but this is insufficient to establish the general advantage of recording-scale pretraining across the six evaluated tasks.
A particularly important missing comparison is an architecture-matched model with the same Macro–Micro structure trained without the proposed long-context pretraining objectives. Similarly, stronger downstream contextualization baselines—such as pretrained local EEG encoders followed by appropriately trained temporal Transformers or state-space models—would help establish the incremental value of learning context during pretraining.
The paper acknowledges that comparisons against separately trained recording-level contextualizers remain open. Nevertheless, this is central to its methodological claim rather than a peripheral future extension.
W2. The evaluation does not fully establish the robustness, efficiency, or independence of the reported improvements.
The manuscript reports results from a single pretrained checkpoint per backbone, with variation measured across independently initialized downstream runs. Consequently, the reported standard deviations do not capture uncertainty in pretraining or sensitivity to corpus composition and checkpoint selection.
This distinction is particularly important because the framework involves several sequential training stages, different sampling budgets, a learned routing mechanism, and a final contextual refinement stage. Without independent pretraining replications, it is difficult to determine how sensitive the reported advantages are to this relatively complex optimization procedure.
There are also limitations in the independence of the evaluation datasets. Several downstream datasets belong to domains represented in the pretraining corpus. Although the authors audit exact recording overlap and identifiable subject overlap, they explicitly acknowledge that cross-repository participant identities cannot be exhaustively resolved.
Some long-context results therefore support recording-disjoint transfer, but not necessarily fully subject-independent or unseen-domain generalization.
Finally, although the architecture is designed for efficient long-context processing, a complete quantitative comparison of pretraining cost, inference time, memory usage, and scaling behavior against relevant alternatives is missing. The asymptotic attention complexity is useful, but actual efficiency matters because the system still processes all Micro regions during full-coverage inference.
Together, these issues make it difficult to evaluate the reproducibility and practical cost-effectiveness of the proposed pretraining paradigm.
Response to Reviewer eoXQ
Thank you for the constructive feedback and the specific experimental suggestion. We conducted additional comparisons to address both points. The contextualized-baseline comparison uses the common rebuttal evaluation protocol and is not directly comparable to the main-paper frozen-probe results.
Weakness. Can strong downstream contextualization match M²-EEG?
We equipped frozen REVE-Large and CBraMod backbones with learned full-record Transformers under the same downstream protocol. Across three downstream refits, M²-EEG retains the highest mean performance on NMT (0.8623 vs. 0.8152/0.7772 BAcc) and Sleep (0.6383 vs. 0.5959/0.5885 participant-macro F1). Thus, the observed advantage persists when competing backbones receive learned recording-level context.
Question. How much long-context gain remains with learned downsampled Micro summaries?
We implemented the suggested construction using a learned strided convolution and linear projection of Micro features as Macro inputs. All variants were retrained under the same 8,000-update protocol rather than replacing inputs only at inference. We also trained a corresponding local-only reference for each input; the reported long-context gain is measured relative to its respective local-only reference.
Learned Micro downsampling retains approximately 41% of the measured long-context gain on both tasks, while spectral descriptors remain higher in absolute terms by +7.61 pp [+3.73, +11.49] and +6.53 pp [+4.20, +8.86]. The percentages are point estimates, and both gains move inference context as well as the input, so they are protocol-specific rather than a fully isolated estimate of the Macro-input contribution. We hope this directly addresses the question.