- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
MExFormer argues that multivariate time-series Transformers fuse channel information too early (during tokenization/embedding), preventing explicit modeling of inter-electrode interactions at the point where channel-specific temporal structure is still localized. It tokenizes each channel independently into multi-resolution temporal patches and organizes attention in three stages: inter-channel self-attention at each temporal position (with a learned "container" token aggregating and redistributing cross-channel information), temporal attention over containers plus a per-granularity "router", and inter-granularity attention over routers. Evaluation uses two binary clinical datasets under subject-independent splits — APAVA (Alzheimer's, 23 subjects) and TDBRAIN (Parkinson's, 72 subjects) — with 1-second segments, against 11 time-series Transformer baselines. MExFormer is best on APAVA (79.71 accuracy) and competitive on TDBRAIN (90.23 vs Informer's 90.50); it shows greater robustness to channel exclusion (10–30% of channels zeroed) and more discriminative intermediate layers under a weak logistic-regression probe.
Critical strengths
- The design question — at which stage channel information should be fused — is well articulated, and the container/router mechanism is a clean way to make cross-channel interaction an explicit attention computation. Evaluating robustness to channel corruption and probing intermediate layers with a weak classifier are thoughtful complements to accuracy that directly test the representation claim.
- Experiments are transparent and honestly scoped: fixed subject-level partitions shared across models, five seeds with mean ± SD, and the paper openly states it leads on only one of two datasets and lists the missing architectural ablation as future work.
Critical weaknesses
- The central claim is never isolated. There is no ablation that changes only the fusion ordering (e.g., the same blocks with channel fusion deferred to after temporal aggregation), which the paper's own limitations acknowledge — so the results cannot be attributed to "channel-first interaction" rather than capacity, multi-resolution patching, or the container mechanism itself. For a paper whose thesis is about ordering, this is the decisive missing experiment.
- The evaluation is too narrow for an EEG representation-learning claim: two small binary clinical datasets (23 and 72 subjects, 1-second segments), no EEG-specific baselines (EEGNet, EEG Conformer, LaBraM/CBraMod), and no standard EEG benchmarks (motor imagery, emotion, sleep). On TDBRAIN the strongest baseline actually edges MExFormer, and most margins are within one seed standard deviation; the intermediate-layer probe covers only four models and layers 1/3/6.
Questions for authors
- Can you add the ordering ablation identified as future work (identical blocks, channel fusion after temporal aggregation, and vice versa) before the review period ends?
- How do EEG-specific models and at least two standard EEG benchmarks change the picture?
- Is one-second segmentation appropriate for AD/PD detection here, and do the conclusions hold across segment lengths?
11 comments
Q2: How do EEG-specific models and at least two standard EEG benchmarks change the picture?
We agree that including EEG-specific architectures strengthens the scope of the evaluation. In response, we incorporated EEG Conformer as an additional EEG-specific baseline under the same subject-independent partitions, training environment, and evaluation protocol used for the models in the original submission.
We selected EEG Conformer as the EEG-specific baseline because it provides the closest architectural comparison to MExFormer under the same supervised training setting, combining EEG-oriented processing with Transformer-based attention. EEGNet is a CNN-based model, while LaBraM and CBraMod rely on large-scale EEG pretraining and external data, making them less directly comparable for isolating architectural differences within our controlled evaluation.
The results show that MExFormer substantially outperforms EEG Conformer on APAVA across the main classification metrics. On clean TDBRAIN, the two models are closely matched in accuracy and macro-F1, while EEG Conformer achieves higher AUROC and AUPRC. This again suggests that the benefit of a particular EEG architecture can depend on the characteristics of the task and evaluation metric, rather than one architecture being uniformly superior under all conditions.
The difference becomes clearer under channel corruption. MExFormer consistently retains higher accuracy and macro-F1 than EEG Conformer across all corruption levels on both datasets, with the gap becoming more pronounced as additional channels are excluded. In particular, at 30% channel exclusion on TDBRAIN, MExFormer retains 86.60% accuracy compared with 83.77% for EEG Conformer. This additional EEG-specific comparison therefore reinforces the robustness result observed against the original time-series baselines and supports the proposed motivation for preserving channel-specific representations and explicitly modeling their interactions before temporal aggregation.
APAVA (2-Classes)
| Models | Accuracy | Precision | Recall | F1 score | AUROC | AUPRC |
|---|---|---|---|---|---|---|
| EEG Conformer |
TDBRAIN (2-Classes)
| Models | Accuracy | Precision | Recall | F1 score | AUROC | AUPRC |
|---|---|---|---|---|---|---|
| EEG Conformer |
APAVA (2-Classes)
| Models | 10% Accuracy | 10% F1 score | 20% Accuracy | 20% F1 score | 30% Accuracy | 30% F1 score |
|---|---|---|---|---|---|---|
| EEG Conformer |
TDBRAIN (2-Classes)
| Models | 10% Accuracy | 10% F1 score | 20% Accuracy | 20% F1 score | 30% Accuracy | 30% F1 score |
|---|---|---|---|---|---|---|
| EEG Conformer |
Due to the limited review-period timeframe, we were not able to complete an additional large-scale EEG benchmark evaluation. We therefore prioritized experiments that directly test the central representation-learning claims of the paper, including the ordering ablation, aggregation ablation, multi-resolution analysis, EEG-specific baseline comparison, and intermediate-representation probing. Extending the evaluation to larger and more diverse EEG datasets is an immediate next step, and we plan to investigate whether the same representation-learning behavior and robustness trends hold at substantially larger scale.
Q3: Is one-second segmentation appropriate for AD/PD detection here, and do the conclusions hold across segment lengths?
We thank the reviewer for raising this point. To examine whether the conclusions depend on the one-second segmentation used in the original evaluation, we extended the experiments to two- and four-second EEG segments while retaining the same subject-independent evaluation protocol.
The additional results show that segmentation length affects absolute performance and that the preferred temporal context varies across datasets. On APAVA, MExFormer achieves the strongest performance across both additional segment lengths, reaching accuracy and macro-F1 with two-second segments and accuracy and macro-F1 with four-second segments. Notably, its advantage over the competing models is preserved and becomes more pronounced than in the original one-second setting.
On TDBRAIN, the results remain consistent with the original one-second evaluation. Informer achieves the highest accuracy and macro-F1 at both two and four seconds, while MExFormer remains competitive across both segmentation lengths. This consistency across temporal contexts indicates that the relative behavior of the models is not an artifact of the one-second segmentation choice.
Overall, these experiments indicate that the main conclusions are not specific to one-second segmentation. Across three temporal contexts, MExFormer consistently shows a particularly strong advantage on APAVA, while the relative advantage of early-fusion architectures on clean TDBRAIN remains visible. We will include these additional segmentation-length experiments and clarify this variation across datasets in the revised manuscript.
APAVA (2-Classes)
| Models | 2s Accuracy | 2s F1 score | 2s AUPRC | 4s Accuracy | 4s F1 score | 4s AUPRC |
|---|---|---|---|---|---|---|
| Autoformer | ||||||
| Crossformer | ||||||
| FEDformer | ||||||
| Informer | ||||||
| iTransformer | ||||||
| MTST | ||||||
| Nonformer | ||||||
| PatchTST | ||||||
| Reformer | ||||||
| Transformer | ||||||
| Medformer | ||||||
| EEG Conformer | ||||||
| MExFormer |
We sincerely thank the reviewer for the thoughtful review and constructive suggestions.
Following the publication of the reviews, we conducted additional experiments to address the concerns raised, including an architectural ordering ablation, an additional EEG-specific baseline, an evaluation on a motor imagery dataset, and experiments with different EEG segmentation of the samples.
We address each point below.
Q1: Can you add the ordering ablation identified as future work (identical blocks, channel fusion after temporal aggregation, and vice versa) before the review period ends?
We fully agree that this is an important experiment for isolating the contribution of the proposed channel-first interaction. In response, we conducted a controlled ordering ablation in which we swap only the first two attention stages while keeping the remaining architectural configuration, model capacity, and training hyperparameters unchanged.
Specifically, the original MExFormer first performs inter-channel attention between channel-specific temporal representations and subsequently aggregates information across time through temporal attention over the resulting container representations. In the ablated configuration, the same operations are applied in the reverse order: temporal attention is first performed independently within each channel, and the resulting temporally contextualized channel representations are subsequently processed through inter-channel attention. The inter-granularity stage and all remaining components are kept unchanged.
The results are reported in Tables below as mean ± STD across the same five random seeds used in the main experiments.
On APAVA, reversing the ordering decreases macro-F1 from 77.36 to 76.16 and substantially increases the variability across runs. Although the reversed configuration achieves higher AUROC and AUPRC, the original channel-first configuration provides more stable and consistent classification performance. This suggests that resolving inter-channel interactions before temporal aggregation is particularly beneficial for obtaining robust decision boundaries on APAVA, which is consistent with the importance of altered inter-regional EEG interactions in Alzheimer's disease.
The effect is substantially clearer on TDBRAIN. Reversing the ordering decreases macro-F1 from 90.20 to 80.55, with corresponding decreases in accuracy, AUROC, and AUPRC. This controlled comparison therefore shows that the sequence in which channel and temporal interactions are performed can have a substantial effect even when the underlying blocks, model capacity, and training configuration are kept fixed.
Overall, these results provide direct evidence that the ordering of channel and temporal interactions is an important architectural design choice. In particular, the strong degradation of the temporal-first variant on TDBRAIN supports the motivation for resolving inter-channel interactions while channel-specific temporal representations remain explicit, before subsequent temporal aggregation.
APAVA (2-Classes)
TDBRAIN (2-Classes)