- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper builds on CBraMod by recombining spatial and temporal attention responses and modulating each channel–time token’s residual update with a cross-axis consistency score. Experiments cover ten downstream datasets with five seeds and systematic ablations. The method is well engineering and competitive, yet the gains are not shown to be significant and the core novelty require stronger evidence.
Critical strengths
- The proposed method avoids relying on the predefined brain-region annotations or electrode-coordinate priors, which is a practical advantage for heterogeneous EEG datasets. This design choice keeps the framework compact and broadly applicable across recording conditions.
- The paper provides the detailed descriptions of the experimental setup, including evaluation protocols and hyperparameters. These results improve reproducibility and make the empirical results easier to interpret.
Critical weaknesses
- The paper should more explicitly clarify its contributions beyond token-wise scores, since the framework appear largely incremental relative to CBraMod. Please clarify which components are genuinely novel would strengthen the claimed contribution.
- The comparison lacks parameter-matched baselines, such as a deeper or wider CBraMod at roughly the 7M scale. It is also better that consider another SOTA method REVE. Please provide more discussion about the comparison and performance gains.
Questions for authors
- Can the reported gains be attributed to the cross-axis mechanism rather than to increased capacity or random variation?
- What evidence shows that a higher cross-axis consistency score actually identifies channel–time tokens that are more important for downstream classification, rather than merely applying an input-dependent but functionally arbitrary scaling?
6 comments
Response to Reviewer oiPj [2/4]
Weakness 2: The comparison lacks parameter-matched baselines, such as a deeper or wider CBraMod at roughly the 7M scale. It is also better that consider another SOTA method REVE. Please provide more discussion about the comparison and performance gains.
CBraMod controls at comparable capacity. We evaluated two expanded CBraMod baselines: (i) a deeper model with 19 encoder layers, and (ii) a wider-FFN model that retains 12 encoder layers while increasing the FFN intermediate dimension from 800 to 1340. Both expanded baselines were evaluated across the ten datasets using five fine-tuning seeds.
For consistency, we count trainable parameters used in the encoder-side forward pass, including the patch encoder and excluding reconstruction and downstream classification heads. Under this convention, the default public CBraMod implementation contains approximately 4.88M parameters, which differs from the approximately 4M reported in the original paper. The expanded models contain 7.70M (+2.82M) and 7.48M (+2.60M) parameters, respectively.
| Model | Active backbone parameters | Ten-dataset mean BA |
|---|---|---|
| Reproduced CBraMod | 4.88M | 71.83% |
| Deeper CBraMod, 19 layers | 7.70M | 72.23% |
| Wider-FFN CBraMod, FFN dimension 1340 | 7.48M | 71.05% |
| AxisBrain | 7.46M | 75.96% |
Increasing depth provides a modest gain over the reproduced baseline, while widening the FFN does not improve it; neither reaches AxisBrain’s performance. Thus, increasing backbone capacity alone does not reproduce the proposed method’s improvement under the evaluated settings. We will incorporate these controls and their dataset-level results into the revised manuscript.
Selection of additional foundation-model baselines. Our baseline selection aimed to reduce confounding from pretraining resources, downstream adaptation protocols, and additional data augmentation, making the comparisons more informative about methodological contributions.
REVE is highly relevant, but it was pretrained on more than 60,000 hours from 92 datasets, exceeding AxisBrain’s approximately 9,000 pretraining hours by more than sixfold. Its reported downstream adaptation also includes Mixup augmentation. Consequently, directly comparing the published results would combine differences in algorithms with differences in training resources and adaptation procedures.
A comparison that also controls for pretraining resources would require pretraining these models on a common corpus under comparable training budgets, followed by evaluation under a common downstream protocol. We regret that we could not complete this broader evaluation within the available computational resources and time.
Response to Reviewer oiPj [3/4]
Question 1: Can the reported gains be attributed to the cross-axis mechanism rather than to increased capacity or random variation?
We respectfully refer the reviewer to our response to Weakness 2, where we present the capacity-controlled CBraMod comparisons and discuss their implications for attributing the observed performance gains.
Response to Reviewer oiPj [1/4]
We thank the reviewer for recognizing the practical advantages of avoiding electrode-coordinate and predefined brain-region priors, as well as the detailed experimental reporting. We particularly appreciate the requests to clarify the methodological contributions and provide capacity-controlled comparisons. These comments motivated additional experiments and helped us refine the rationale and scope of our claims. Below, we address each concern and present the additional comparisons.
Thank you for asking us to clarify the contributions beyond token-wise scoring. We acknowledge that the manuscript did not sufficiently explain what the proposed modifications contribute or distinguish them clearly from the components inherited from CBraMod. We will revise the contribution statements and methodological rationale accordingly.
Our goal is to improve EEG transfer while preserving a simple, single-stage masked-reconstruction pipeline. We deliberately chose CBraMod as a relatively simple Transformer backbone with factorized spatial and temporal attention. We retain its patch encoder, ACPE, and reconstruction objective. Our methodological contribution concerns two cooperating components that determine how the attention-derived responses are recombined and incorporated into the residual update.
1. Additive response recombination for effective use of expressive capacity. The proposed recombination retains the original response as a direct term and learns an additive spatial–temporal mixing correction:
R=Xcc+WxXcc+bx.
Although this has the same affine expressive power as a projection-only alternative, identical function classes do not ensure identical learned solutions. Our design preserves the original attention response through a direct path and allows additional mixing to be learned as a correction to that response. This provides a simple, optimization-oriented structure designed to make more effective use of the available expressive capacity.
Table 3 demonstrates the practical importance of this choice: mean BA increases from 71.83% for our reproduced CBraMod to 73.44% with additive recombination, whereas replacing the response with the projection alone gives 69.42%. Thus, the contribution is not an enlarged affine function class, but an effective parameterization for learning and applying the spatial–temporal correction.
2. Cross-axis agreement for allocating residual refinement strength. Residual scaling itself is established. Our main contribution is a structured rule that determines token-wise gain from the relationship between complementary channel–time contexts.
The score is computed from the current encoder layer’s learned Xcc representations, not raw EEG. Although an individual token already contains attention-aggregated spatial and temporal information, its representation does not explicitly expose the relationship between the two axis-level summaries. We therefore construct a time-indexed cross-channel descriptor using learned-query pooling and a channel-indexed temporal descriptor by averaging that channel’s representations over the segment. The descriptors are projected into a jointly learned comparison space, where their normalized agreement determines the score.
The design motivation is that agreement with one axis alone can be misleading. Persistent channel-specific contamination can agree with that channel’s temporal context, while contamination affecting several channels at one interval can agree with the corresponding cross-channel context. Comparing the complementary summaries provides a cross-check: it asks whether the pattern summarized across channels is compatible with the temporal context of the channel at their intersection.
This motivates assigning less additional gain when the contexts conflict and more when they agree. The bounded multiplier (1+Sct) preserves the response Rct at every position while varying its additional amplification. The proposed configuration achieves 75.96% mean BA, compared with 73.44% for additive recombination without modulation, supporting the practical contribution of this context-dependent refinement.
This cross-check may mitigate misleadingly high gain caused by an axis-specific distortion provided that the complementary summary is not dominated by that distortion. If both summaries are dominated by the same contamination, their agreement may remain high. We therefore interpret the score as learned contextual compatibility, with this potential limitation, rather than as an independently established measure of physiological importance.