- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper reports measurement-validity / evaluation for the manifold EEG/EMG cross-subject decoding pipelines. The ML contribution appears limited: most conclusions are established for a narrow family of manifold-based EEG/EMG pipelines. The paper is also very poorly written, with too many subtitles and sentences that are very hard to follow. I think this paper is not of interest to the ICLR machine learning community in EEG; it reads more like an engineering technique report.
Critical strengths
S1: Cross-subject decoding is an important research topic for EEG, and the results presented in this paper would be of interest to engineering researchers in EEG.
Critical weaknesses
W1: What is the paper's contribution related to the machine learning community? It does not propose a new alignment method or decoding method. Its main contribution is a simple measurement-validity / evaluation in the previous work. It claims to report quantities in the field; I did not see anything new from its perspective. The theory is also more or less unnecessary.
W2: Domain adaptation and foundation models are two main approaches in the EEG cross-subject decoding community. Domain adaptation has its own advantage of being small models and without the need for large computational resources. However, even in this setting, the comparison with classical EEG deep learning models and recent high-impact foundation models is also necessary.
W3: This paper is very poorly written, and I found it very hard to follow. There are subtitles like 'What this paper is not. '; 'The screen, and the two numbers it produces'; 'Reading this as a zero, not a result.'; 'Add the column. '.
Table2, Table3, Table 4, and Table5 violate the ICLR format requirements.
Questions for authors
Can you compare the alignment framework with classical EEG deep learning and foundation models? These models are also important for cross-subject decoding.
What is the paper's contribution related to the ICLR community?
Why do we need such analyses for large samples, the reasonable number of available data trials can provide a good estimation, in my opinion.
Contribution. The paper proposes no method, by design: it supplies the in-domain baseline that published alignment gains omit (the domain-adaptation literature reported it a decade ago on ERP features, Wu 2017; the alignment literature never imported it — Related Work now says so), prices the budget at which own labels replace donors, and (new in this revision, Table 5) prices the pooled hybrid that the EA review itself recommends (Wu 2025). We accept that this is a measurement contribution and have removed language that implied more.
Deep and foundation models. Two additions. Appendix R reports a trained SPD network on BCI IV-2a: alignment changes a network with the identity basepoint by +0.114 and one with the per-domain basepoint by +0.0004, as the proposition predicts. Appendix S (Table 16) puts EEGNet on the budget axis, same splits as Tables 4–5: aligned EEGNet is +0.05 [+0.02, +0.08] above aligned TS+LR on binary IV-2a (+0.032 [−0.005, +0.071] on 4-class); EEGNet trained from scratch on the user's k trials is below the shallow own-trials decoder at every k; and a donor-pretrained EEGNet fine-tuned on the same trials keeps a +0.12–0.15 premium at the largest k, so for that decoder donors have not stopped paying at any tested budget. The budget claim is now scoped to the decoder family it was measured on. We have not run foundation models; the budget question for those is open, and we say so.
Format and writing. Tables 2–5 of the submission overflowed the text margin; all tables are now inside it. The main text's stand-alone qualification paragraphs are folded into the paragraphs they qualified (global comment, correction 6); the sentence-style paragraph headings remain, and a full rewrite is beyond the discussion window.
Why large-sample analysis. The question is not how many trials estimate a covariance but how many labelled trials from a new user make donor data unnecessary — Table 5 gives the answer (5–40 per class) and the regime where it fails (60-channel Weibo2014).