- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Stage-Aligned Temporal Representation Learning (SATRL) for motor imagery EEG decoding. The framework consists of three stages: multiscale temporal extraction, local short-window temporal aggregation, and trial-level temporal integration. The authors evaluate SATRL on four EEG datasets using CNN-based and CNN–Transformer-based architectures under cross-session and leave-one-subject-out protocols. Overall, this paper includes a wide range of experiments, but the proposed method is not particularly innovative.
Critical strengths
- Clear presentation. The paper is well-organized and clearly written, with an intuitive three-stage architecture for temporal representation learning.
- Broad experimental coverage. The authors evaluate the proposed framework across four datasets and two architectural realizations, including baseline comparisons, stage ablations, and descriptive analyses of Stage-I features and input-level saliency.
Critical weaknesses
- Limited methodological novelty. The proposed framework primarily combines existing temporal modeling operators, including multiscale temporal convolution, stacked depthwise convolution, and dilated TCN. The proposed operator-stage alignment is essentially a predefined architectural arrangement without an explicit alignment mechanism or criterion. Its fundamental distinction from conventional hierarchical temporal representation learning remains unclear.
- Insufficient validation of the stage-alignment hypothesis. The ablation studies mainly investigate component removal and operator substitution. They do not directly demonstrate that the proposed operator-stage assignments outperform alternative placements under controlled model capacity and receptive fields. Therefore, the reported improvements cannot be conclusively attributed to stage alignment itself.
- Concerns regarding the evaluation protocol. In the cross-session experiments, the same evaluation partition is used for both validation and testing, while Best Accuracy is defined as the highest test accuracy observed during training. This introduces potential model-selection bias and undermines the reliability of the reported performance improvements.
- Lack of stage-specific interpretability evidence. Although the framework assigns distinct temporal learning objectives to three stages, the interpretability analyses do not directly validate these functional distinctions. The time-frequency analysis focuses on Stage-I, while the Gradient × Input saliency maps reflect the overall model's input sensitivity. No dedicated representation-level analyses demonstrate that Stage-II learns stable short-window representations or that Stage-III effectively integrates trial-level contextual evidence.
- Minor concerns:
- Unclear module labeling in Figure 1. Figure 1 explicitly labels the MS, ST, and CDTM modules, but does not clearly identify the FT and I modules, despite introducing them in the corresponding equations. Although their underlying operations appear to be illustrated, the lack of explicit labels and module boundaries makes it difficult to associate the mathematical formulations with the architectural components.
- Inconsistent numerical reporting. Tables 1 and 4 report different standard deviations for the same CNN–Transformer SATRL result on BCIC IV-2a (Last Accuracy: 85.96 ± 0.66 versus 85.96 ± 0.12).
- Insufficient specification of task conditions and class definitions. The paper describes HGD as containing executed movements and rest, while Ofner includes both movement execution and motor imagery. However, the experimental task conditions and class definitions are not sufficiently specified, particularly for Ofner. The authors should clarify which conditions and classes were included in each experiment, and distinguish evidence from movement execution tasks from that supporting the paper's claims about motor imagery decoding.
Questions for authors
- What specifically constitutes the operator-stage alignment mechanism in SATRL? Beyond assigning existing temporal operators to predefined representation stages, how does the proposed framework fundamentally differ from conventional hierarchical temporal modeling?
- While controlling for model capacity and receptive fields, can the proposed operator-stage assignments be compared with alternative operator placements to demonstrate the independent contribution of stage alignment?
- Why not use a independent validation set and a strictly held-out test set, with perform checkpoint selection only on the validation data, to provide cross-session results?
- Is there direct representation-level evidence demonstrates that Stage-II performs the claimed local short-window temporal aggregation and Stage-III achieves trial-level temporal integration?