- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes the Morlet Spectral Transformer (MST) for cross-subject EEG emotion recognition. It uses Morlet wavelets to extract time–frequency representations and constructs a local spectral reference from neighboring windows within the same trial. The target spectrum and its reference-relative residual are combined through frequency-specific spatial projections before Transformer-based classification. This design incorporates temporal context while maintaining a fixed attention token count.
The method is evaluated on SEED, SEED-IV, SEED-V, SEED-VII, and FACED against six general-purpose EEG representation models. The authors report improvements over the evaluated baselines and provide component ablations, context-span-matched comparisons, and past-only context experiments.
Critical strengths
1. The motivation for incorporating neighboring spectral information is reasonable, and the design is structurally simple.
Combining absolute and reference-relative representations provides a straightforward way to utilize contextual information while retaining potentially useful sustained emotion-related activity. Incorporating the neighborhood summary into target tokens before attention keeps the Transformer's token count independent of the number of neighbors.
2. The evaluation covers multiple datasets and includes relevant controls.
The paper evaluates five datasets with different numbers of emotion classes, reports results across multiple random seeds, and includes all-subject component ablations, context-span-matched comparisons, and past-only context experiments.
Critical weaknesses
1. The baseline selection is inadequate, and the reported results do not establish competitiveness on the target task.
1.1 Representative cross-subject emotion-recognition methods are missing.
The six evaluated baselines primarily target general-purpose EEG representation learning. Established emotion-recognition methods such as DGCNN [1], RGNN [2], IAG [3], and EmT [4] are absent from the quantitative comparisons. EmT is particularly relevant because it explicitly models temporal context for cross-subject EEG emotion recognition.
The paper discusses some of these methods in the related work but provides no experimental comparison against them. The current baseline coverage does not establish whether MST improves over mature solutions to the target task. Consequently, improvements over the selected general-purpose models are insufficient to establish an empirical contribution to cross-subject EEG emotion recognition.
1.2 Absolute discriminative performance is limited, and the substantial gap from prior work remains unexplained.
MST achieves only 17.52% accuracy and a Cohen's kappa of 0.0625 on nine-class FACED, indicating limited overall discriminative performance. Under its own evaluation protocol, the original FACED dataset paper [6] reported cross-subject nine-class accuracies of 35.2% for DE + SVM and 42.4% for CLISA [5].
The submission neither explains this gap through comparisons under compatible protocols nor establishes an advantage over a simple spectral-feature classifier. Outperforming the selected baselines, which themselves perform poorly in this evaluation, does not establish practical competitiveness.
2. The methodological contribution is incremental, and the specific fusion design lacks direct empirical support.
2.1 The method primarily combines established techniques without establishing a substantive incremental advantage.
The proposed method combines Morlet time–frequency analysis, local spectral referencing, frequency-specific spatial projections, and Transformer-based classification. DMNet [7] and EmT [4] have already explored contextual spectral differences for seizure detection and temporal contextual modeling for emotion recognition, respectively. Moreover, Equation (1) shows that the linear projection of the absolute spectrum and its residual is mathematically equivalent to jointly projecting the target and reference spectra.
The paper does not sufficiently demonstrate the advantage of this particular combination over simpler fusion strategies or establish a substantive advance over closely related approaches. The existing evidence therefore provides insufficient support for the methodological novelty of the proposed contextual representation.
2.2 The ablations conflate the benefits of neighboring information with those of the fusion mechanism.
Removing the reference branch also removes neighboring information, so this ablation only tests the effect of the entire context pathway. The context-span-matched comparison with CSBrain [8] still differs in architecture and training recipe and therefore does not isolate the proposed fusion mechanism.
Direct alternatives, such as reference-only classification and simple spectral aggregation, are missing. The experiments support the usefulness of access to neighboring information but do not establish that the gains depend on the proposed target–reference fusion. This gap directly concerns the empirical basis of the paper's central contribution.
3. Differences in training recipes prevent attribution of the reported gains to the proposed method.
3.1 Data augmentation is substantially asymmetric and materially affects performance.
Appendices B.3–B.4 state that the baselines use no input augmentation, whereas MST uses phase perturbation, band-specific noise, channel dropout, and wavelet time roll. In Table 3, removing augmentation reduces MST's SEED accuracy from 66.5% to 60.1%, a 6.4-percentage-point decrease that exceeds its 4.1-point improvement over pretrained LaBraM [9] at 62.4%.
The effect of augmentation is therefore comparable to, and numerically larger than, the reported improvement, yet no corresponding augmentation controls are provided for the baselines. Table 1 consequently does not separate the contribution of the model design from that of augmentation.
3.2 Training budgets differ without evidence that the baselines were sufficiently optimized.
MST is trained for 50,000 steps, whereas EEGPT [10], CBraMod [11], and CSBrain [8] are trained for 10,000 steps, with additional differences in batch size. Even the context-span-matched comparison retains different training configurations. The paper provides neither convergence evidence nor a budget-sensitivity analysis.
The experiments demonstrate the effectiveness of the complete MST training recipe relative to the selected baseline configurations, but do not convincingly isolate the benefit of context-aware tokenization.
4. Unresolved discrepancies between the code and the stated evaluation protocol limit the verifiability of the results.
4.1 The normalization pathway for held-out subjects does not match the paper's description.
Appendix B.1 specifies normalization of held-out subjects using statistics pooled from the training subjects. However, morlet/datasets/seed.py retrieves the mean and standard deviation using the current subject's ID and falls back to the current trial's statistics when the corresponding entry is unavailable. The released main-experiment pipeline does not provide an implementation for computing and applying source-pooled statistics within each LOSO fold. The code therefore does not establish that the experiments followed the stated normalization protocol.
4.2 The correspondence between the reported results and the checkpoints is unclear.
The paper states that evaluation uses the final training step without selecting models based on held-out-subject performance. However, the main configuration specifies best_metric = val_balanced_accuracy, and the script evaluates every 200 steps and saves the best-performing checkpoint as best, while separately saving final. The mapping between the reported results and these checkpoints is not documented, preventing verification that the reported scores follow the stated final-step evaluation rule.
References
[1] Song, T., Zheng, W., Song, P., and Cui, Z. EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks. IEEE Transactions on Affective Computing, 11(3):532–541, 2020. https://doi.org/10.1109/TAFFC.2018.2817622
[2] Zhong, P., Wang, D., and Miao, C. EEG-Based Emotion Recognition Using Regularized Graph Neural Networks. IEEE Transactions on Affective Computing, 13(3):1290–1301, 2022. https://doi.org/10.1109/TAFFC.2020.2994159
[3] Song, T., Liu, S., Zheng, W., Zong, Y., and Cui, Z. Instance-Adaptive Graph for EEG Emotion Recognition. AAAI, 2020. https://doi.org/10.1609/aaai.v34i03.5656
[4] Ding, Y., et al. EmT: A Novel Transformer for Generalized Cross-Subject EEG Emotion Recognition. IEEE Transactions on Neural Networks and Learning Systems, 2025. https://doi.org/10.1109/TNNLS.2025.3552603
[5] Shen, X., Liu, X., Hu, X., Zhang, D., and Song, S. Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition. IEEE Transactions on Affective Computing, 14(3):2496–2511, 2023. https://doi.org/10.1109/TAFFC.2022.3164516
[6] Chen, J., et al. A Large Finer-grained Affective Computing EEG Dataset. Scientific Data, 10:740, 2023. https://doi.org/10.1038/s41597-023-02650-w
[7] Tu, S., et al. DMNet: Self-comparison Driven Model for Subject-independent Seizure Detection. NeurIPS, 2024. https://proceedings.neurips.cc/paper_files/paper/2024/hash/3192aa37a2227627d7f8cbf582c075f3-Abstract-Conference.html
[8] Zhou, Y., et al. CSBrain: A Cross-scale Spatiotemporal Brain Foundation Model for EEG Decoding. NeurIPS, 2025. https://proceedings.neurips.cc/paper_files/paper/2025/hash/7e199ad8ae40eb19b2980f61f659cb07-Abstract-Conference.html
[9] Jiang, W.-B., Zhao, L.-M., and Lu, B.-L. Large Brain Model for Learning Generic Representations with Tremendous EEG Data in BCI. ICLR, 2024. https://openreview.net/forum?id=QzTpTRVtrP
[10] Wang, G., et al. EEGPT: Pretrained Transformer for Universal and Reliable Representation of EEG Signals. NeurIPS, 2024.
[11] Wang, J., et al. CBraMod: A Criss-Cross Brain Foundation Model for EEG Decoding. ICLR, 2025. https://proceedings.iclr.cc/paper_files/paper/2025/hash/bbbd6d915cb90be21c1254a82d45cedd-Abstract-Conference.html
Questions for authors
Why were representative task-specific methods excluded from the quantitative evaluation, and how do the current results establish MST's competitiveness in cross-subject EEG emotion recognition? Beyond access to additional neighboring information, which experiments support the independent contribution of the proposed fusion mechanism? Given the differences in augmentation and training budgets, on what basis are the main performance gains attributed to context-aware tokenization? Which data were used to compute normalization statistics for held-out subjects, and do the reported results correspond to the best or final checkpoints?
3 comments
Concern — W3.1 and the attribution question. Does the augmentation imbalance explain the main performance difference?
Response. All our experiments share the same data processing pipeline, including the same data augmentation. The wording in Appendix B.3 was meant to say that the augmentation was designed specific for MST and may not be compatible with some of the the baselines. We will correct the wording in Appendix B.3 to ensure there is no confusion.
Concern — W3.2. Were the baselines sufficiently optimized, given the unequal budgets and lack of convergence analysis?
Response. The training budgets follow the same loss-based stopping criterion for all models. For each model, we use one seed to determine when training loss stops decreasing or begins to rise, then fix that number of steps for the remaining seeds. We also give every model the same hyperparameter-tuning budget and select its learning rate and batch size based on training loss. Different step counts therefore reflect when each model meets the shared stopping criterion.
On SEED, this procedure gives 50,000 steps for MST and LaBraM, and 10,000 steps for CSBrain, EEGPT, and CBraMod (Table 6 and Appendix B.4). We will clarify how training loss determines both the hyperparameters and the training duration.
Concern — W4.1 and the normalization-data question. The loader retrieves statistics by the current subject's ID and can fall back to trial statistics. How does this match the source-pooled normalization described in Appendix B.1?
Response. The reported SEED runs using this loader followed the source-pooled normalization specified in Appendix B.1. For each LOSO fold, we precomputed the mean and standard deviation using only the training subjects and saved them locally under the held-out subject's ID. The ID therefore identifies the fold's stored training statistics. The loader retrieves these precomputed values, so it does not need to recompute them during loading. All reported runs using this loader loaded the corresponding statistics successfully, and the trial-statistics fallback was never triggered. We will document the precomputation step and the subject-ID mapping in the released pipeline.
Concern — W4.2 and the checkpoint question. Do the reported results use the final or the best-performing checkpoint?
Response. We used the final checkpoint as reported in the manuscript. Our codes also save the intermediate checkpoints and the best checkpoint for analysis purpose.
References
[1] Tengfei Song, Wenming Zheng, Peng Song, and Zhen Cui. EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks. IEEE Transactions on Affective Computing, 11(3):532–541, 2020.
[2] Peixiang Zhong, Di Wang, and Chunyan Miao. EEG-Based Emotion Recognition Using Regularized Graph Neural Networks. arXiv:1907.07835, 2019.
[3] Tengfei Song, Suyuan Liu, Wenming Zheng, Yuan Zong, and Zhen Cui. Instance-Adaptive Graph for EEG Emotion Recognition. AAAI, 34(3):2701–2708, 2020.
[4] Yi Ding et al. EmT: A Novel Transformer for Generalized Cross-subject EEG Emotion Recognition. IEEE Transactions on Neural Networks and Learning Systems, 2025.
[5] Xinke Shen et al. Contrastive Learning of Subject-Invariant EEG Representations for Cross-Subject Emotion Recognition. IEEE Transactions on Affective Computing, 2022 (online publication).
[6] Shihao Tu et al. DMNet: Self-comparison Driven Model for Subject-independent Seizure Detection. NeurIPS, 2024.
I appreciate the authors' response, including the additional emotion-recognition baselines and code clarifications. However, the response does not resolve my core concerns:
-
Unexplained low performance on FACED. MST achieves 17.52% accuracy (), compared with 35.2% for DE + SVM and 42.4% for CLISA in the original FACED paper, as well as 45.7% for MSHCL and 67.9% for DAEST. These published results are approximately 18 to 50 percentage points higher than MST. The response discusses CLISA's test-time normalization but neither quantifies its effect nor addresses the discrepancy with DE + SVM. The substantial performance gap therefore remains unexplained.
-
Unvalidated fusion mechanism. Removing the neighbor-reference branch removes both the neighboring information and its fusion with the target. The reported 5.6-point drop therefore supports the entire context pathway, but not the proposed fusion specifically. Declaring this distinction unnecessary and out of scope leaves the claimed contribution of the proposed fusion unsupported.
-
Inconsistent training and augmentation protocols. Selecting training budgets and hyperparameters from training loss does not establish that the baselines were adequately optimized for cross-subject generalization. The claim that all experiments use the same augmentation contradicts Appendix B.3, which states that the baselines use no input augmentation, and the response itself states that the augmentations were designed for MST and may be incompatible with some baselines. Removing augmentation reduces MST's SEED accuracy by 6.4 points, exceeding its 4.1-point gain over pretrained LaBraM.
These issues directly affect the paper's empirical conclusions. I maintain my rating of 1 (Clear rejection).
We thank the reviewer for the detailed comments.
Concern — W1.1 and the baseline-selection question. Why are DGCNN, RGNN, IAG, and EmT absent, and what competitiveness claim follows from the evaluated baselines?
Response. The current selection of baselines aim to test whether MST, built around context-aware spectral tokenization and trained without external pretraining, can compete with general-purpose EEG encoders. The current baseline includes five latest encoders evaluated with pretrained and scratch initialization, together with TFM-Tokenizer, which are complete for our purpose. Therefore, we did not include the results of DGCNN [1], RGNN [2], IAG [3], and EmT [4] in the manuscript.
Nonetheless, we include the results with DGCNN, RGNN, IAG, and EmT as follows.
The four added baselines use the same training budget per fold. The standard deviation across subjects are reported. For implementation of these four models, we adapt their design to our data shape and evaluation protocol. Implementation details will be included in the appedix of our manuscript.
Concern — W1.2. How should 17.52% accuracy and κ = 0.0625 be interpreted relative to the original FACED results of 35.2% for DE + SVM and 42.4% for CLISA cited in the review?
Response. We take a strict leave-one-subject-out evaluation protocol. Especially, we compute each channel's mean and variance using only the current one-second EEG window. However, the original CLISA method [5] takes a different data processing protocol. CLISA initializes normalization with training statistics, then updates feature means and variances using incoming test-subject data (§4.4). Thus, CLISA adjusts feature scaling to the test subject's accumulated data, while our window-wise normalization does not accumulate statistics across windows.
Concern — W2.1. Given the precedents in DMNet and EmT, and the equivalence in Equation (1), what does the design contribute?
Response. MST differs from DMNet [6] in its spectral representation and spatial modeling, and from EmT in how context enters the Transformer. DMNet encodes channel-wise spectral difference matrices with a CNN. MST instead retains both absolute and locally referenced Morlet spectra across electrodes, then mixes electrodes separately at each frequency. The local reference is designed to reduce temporal redundancy, while the absolute branch preserves access to sustained spectral activity.
EmT [4] represents successive EEG feature graphs as a token sequence and learns their temporal relationships with a contextual Transformer. MST averages neighboring spectra into a reference and uses it to form the target's time–frequency tokens before attention. Context therefore changes the target tokens without adding neighboring windows to the attention sequence (Sections 3.2–3.4 and Appendix E). These differences in representation and context construction remain under either parameterization in Equation (1).
Concern — W2.2 and the fusion-contribution question. Which experiment isolates fusion from access to neighbors? What about reference-only classification or simple spectral aggregation?
Response. The ablation aims to test the effectiveness of the complete neighbor-reference pathway. This design is motivated by removing the temporal correlation while preserving the original spectral information, thus using the neighboring EEG and a fusion technique. Our ablation alreadly shows that removing the pathway reduces mean accuracy by 5.6 percentage points (Table 3), directly showing the effectiveness of this design. Figure 2 also shows that the temporal correlation is reduced.
Therefore, isolating the fusion from access to neighbors would not be necessary and out-of-the-scope of our ablation, where we only aim to justify the effectiveness and motivation of the proposed design.