- Rating
- 3(+1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The proposed method, SCoRE, combines Euclidean alignment with shared processing of original/reflected EEG, a learned involutive input reflection, and a Householder output reflection. It guarantees logit equivariance and evaluates nine datasets, including three newly collected cohorts.
Critical strengths
- The equivariance hypothesis is distinctive and mathematically sound.
- Strong performance with a compact model, multiple ablations, and β-lateralization analyses make it more informative than a generic architecture study.
Critical weaknesses
(1) There is insufficient physiological justification for generalized reflection equivariance. The proposed reflection-equivariant formulation is mathematically interesting and physiologically motivated for left–right motor imagery, where bilateral neural activities underpin it. However, the manuscript extends the same principle to sleep staging, depression detection, mental arithmetic, SSVEP, and aesthetic judgment without establishing that these tasks exhibit corresponding reflection-equivariant neural representations. The reported improvements therefore support the effectiveness of a reflection-constrained learning strategy, but do not necessarily establish reflection equivariance as an intrinsic property of brain activity across tasks. A comparison with randomly initialized involutive transformations and other capacity-matched two-view learning strategies would help determine whether the improvements arise from meaningful physiological structure or more general regularization effects. (2) Need clarifications on the cross-subject generalization protocol. The method incorporates Euclidean alignment using subject/session-specific covariance estimates. The manuscript should clarify whether covariance estimation uses all target-session trials, including those subsequently evaluated. If so, the reported zero-shot results are not generalizable. Strictly prospective generalization to an unseen subject should be evaluated. The authors should distinguish these settings and ideally evaluate performance under causal or limited-calibration alignment protocols. This distinction is important for assessing the practical value of SCoRE in online BCIs and other prospective EEG applications.
Questions for authors
- Can the authors explain what physiological reflection-equivariant relationships are expected in these tasks (beyond motor imagery) ? In particular, how should the learned output reflection be interpreted when the class labels have no natural left–right lateralization?
- Have the authors compared SCoRE against randomly initialized involutive transformations or other learned orthogonal transformations with comparable model capacity?
- Can the authors clarify whether this covariance is computed using the entire target test session, including trials subsequently used for evaluation?
- How does performance change when alignment is estimated using only a limited initial calibration segment or updated causally during online decoding?
- For the high accuracy on the Mumtaz depression dataset, can the authors confirm that all training, validation, and test partitions are strictly subject-disjoint (given the substantial subject-specific variability and potential recording confounds in clinical EEG)?
8 comments
Q2: Random involutions and other learned transformations
A2: As clarified in A1, the gain of SCoRE comes from its structural design, not from a physiological preset. Changing the initialization of (mentioned in W1) therefore does not remove this structure. In fact, our released code already offers several initializations of the input reflection. This comparison helps make the study more solid. Following your suggestion, we ran it on five datasets (Revisions: lines 1776–1781, Appendix C.12; lines 1799–1806, Table 32).
| Initialization of | BCI-IV-2a | PhysioNet-MI | HMC | MAT | Mumtaz |
|---|---|---|---|---|---|
| Predefined pairing (bilateral) | 68.49 ± 1.56 | 63.95 ± 0.77 | 79.79 ± 0.30 | 78.47 ± 2.62 | 97.44 ± 0.56 |
| Perturbed predefined pairing | 67.64 ± 0.93 | 63.57 ± 0.90 | 79.24 ± 0.95 | 77.88 ± 1.28 | 97.22 ± 1.26 |
| Random electrode pairing | 67.91 ± 1.73 | 63.79 ± 0.51 | 79.25 ± 0.91 | 77.53 ± 3.04 | 96.36 ± 0.87 |
| Random involution | 67.90 ± 0.93 | 64.65 ± 0.30 | 78.71 ± 1.97 | 78.85 ± 3.71 | 96.11 ± 0.84 |
The effect of initialization exists but is minor, with differences within 1.33 points. A well-matched initialization can give slightly higher or more stable results, as the bilateral pairing does on BCI-IV-2a and Mumtaz. On PhysioNet-MI and MAT, the random involution is the best. Overall, no initialization is consistently better, and the model is robust to this configuration choice.
Other learned transformations. As you suggested, further ablations on other learned transformations and two-view strategies help clarify the source of the gain. The table below compares SCoRE with an orthogonal transformation and two-view regularization on the same five datasets (Revisions: lines 1809–1825, Appendix C.13).
| Method | BCI-IV-2a | PhysioNet-MI | HMC | MAT | Mumtaz | Macro |
|---|---|---|---|---|---|---|
| Orthogonal transformation | 65.73 ± 0.65 | 60.13 ± 0.67 | 78.36 ± 0.24 | 68.61 ± 3.61 | 96.98 ± 0.57 | 73.96 |
| Two-view regularization | 66.31 ± 0.87 | 61.69 ± 0.56 | 75.82 ± 0.90 | 75.76 ± 3.90 | 95.49 ± 0.70 | 75.01 |
| SCoRE | 68.49 ± 1.56 | 63.95 ± 0.77 | 79.79 ± 0.30 | 78.47 ± 2.62 | 97.44 ± 0.56 | 77.63 |
The orthogonal transformation breaks the reflection-equivariant structure. It keeps the same backbone and a comparable size, yet performance drops (macro 73.96 vs. 77.63), which indicates that the gain comes from reflection equivariance. Two-view regularization does improve on average over the backbone without the reflection mechanism (macro 75.01 vs. 74.03, Table 2). However, this improvement is a general effect of regularization, and it is much smaller than that of SCoRE over the same backbone (0.98 vs. 3.60 points). This gap indicates that regularization alone does not account for the gain of SCoRE.
Further discussion. One point beyond the scope of this study may be of interest. Initialization can be used to inject known knowledge, such as bilateral pairing. The shift of the reflection from this starting point, or the reflection learned in the end, can then be analyzed to explore physiological structure in the data. We see potential here for deep learning to offer insights to neuroscience. As this topic leans toward neuroscience and is far from the technical focus of this paper, we will not include it in the manuscript and only share it here as an insight. Thank you for your valuable suggestions, which pushed us to think more deeply and also improved this study.
Q3: Covariance computation
A3: We first clarify how the covariance is computed. In Table 1, it is computed per subject or per recording session, without labels. The same rule applies to test subjects. The key point is that the statistics used by EA are fully separated between training and test data. Training data use only training statistics, and test data use only test statistics, so there is no leakage between them (Appendix B.10 and the released code).
Generalization and causality. We understand your point (mentioned in W2) and appreciate this valuable comment. To avoid confusion and better address your concern, we would like to respectfully distinguish generalization from causality.
Generalization concerns unseen subjects. Zero-shot means using no label of the new subject for training. EA, however, is a statistical operation that involves no training. Using EA therefore keeps the evaluation zero-shot.
As for the evaluation itself, it is offline and retrospective. This follows the widely used practice in REVE [9], BIOT [10], CBraMod [11], and EEGNet [12]. It is also reasonable for these data. Several of the datasets we use have already been processed with whole-recording statistics, such as ICA-based artifact removal in the MAT release [13]. Such data are retrospective and offline by nature. Beyond BCI, tasks such as sleep staging, depression detection, and emotion recognition are also mainly analyzed offline, with little need for streaming.
Causality concerns streaming and deployment, where each prediction can only use the data received before it. A causal evaluation does make the study more solid, but it is a separate matter from generalization. We give the detailed analysis in A4.
Overall, EA uses the whole recording for its statistics in evaluation, yet the implementation involves no leakage. It is simply an offline, retrospective analysis. Other models also use such statistics and are evaluated in the same way (for example, EEG-SimpleConv computes its normalization statistics from each test session [14]). Our claim therefore remains valid, and the comparison follows the widely used protocol. To avoid confusion, we have clarified this offline setting in the revised manuscript (Revisions: lines 1127–1130, Appendix B.10), and we thank you for the helpful comment.
Response to Reviewer Qbj5
Thank you for your constructive comments and for recognizing the strengths of our work. Note: The revised manuscript has been uploaded, with changes marked in blue. For your convenience, the new result tables from this rebuttal are also collected in
Supplementary Tables.pdf(identical to those in the revision), and the relevant ones are included in the responses below.Q1: Reflection equivariance beyond motor imagery
A1: We would first like to respectfully clarify that the reflection in SCoRE is learned rather than predefined. Both reflections (R and Q) are trained jointly with the backbone, without relying on a specific electrode pairing or physiological prior. The learned reflection may pair bilateral sites, other regions, or groups of regions. We use motor imagery and bilateral pairing as our example because they are commonly understood, and then extend the concept beyond them (Section 2.2). Of course, a known or hypothesized physiological pairing can be used to initialize R, but this is optional (initialization is discussed in Q2 below).
Physiological evidence beyond motor imagery.
These physiological findings support the motivation of our method. They span bilateral pairs as well as fronto-occipital, fronto-parietal, and occipito-parietal pairs. Within a single task, what the model learns is likely a combination of several such relationships. We show the gain of the mechanism through performance (Table 1) and its effectiveness through ablations (Table 2). Post-hoc marker analyses further show that the model draws on physiological information (Sections 5.3 and 5.4).
To be more specific, we formalize these findings as reflection equivariance, where exchanging the paired regions changes the class evidence accordingly. The mechanism combines a built-in structure with joint learning (Section 3.2). When a task has this reflection-equivariant property, the model can capture it through this structure and gain from it.
Output reflection without left–right labels. With the clarification above, the interpretation becomes clear. Q is not tied to left–right labels. It reverses the class contrast that the learned input reflection affects and leaves the other class evidence unchanged (Section 2.3). What matters is therefore not a predefined input–output pairing, but whether the task has a reflection-equivariant property that matches this structure. If it does, the model can in principle still learn it without left–right lateralization. If this property is weak, the gain diminishes, and performance stays comparable to strong non-pretrained baselines, as on TUAB (Appendix C.7).