- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper looks int ot the role of source-free test-time adaptation in cross-subject motor imagery EEG decoding, focusing on batch normalisation (BN) statistics. The authors tried TENT (a standard tta method) in four levels: source-only, BN-only recalibration, TENT, and affine-only optimisation with fixed source statistics. It was studied on BCI IV 2a, BCI IV 2b, and OpenBMI, across three datasets EEGNet, ShallowConvNet, and ATCNet. The authors argued that BN-only recalibration closely matches TENT.
Although the authors have done some good experiments on BN, I am afraid the scope of this work is far less what would be expected from a ICLR paper in 2027. The main finding is largely anticipated by prior work, and the evidence is limited to BN-based CNNs on three small MI datasets.
Critical strengths
- The four-condition design is clean. Four test conditions adhere to the same experimental settings in terms of the same checkpoint, split and seed.
Critical weaknesses
I am concerned about the limited novelty and scope of this paper, as well as the lack of genrealizability of the evidence.
Clarity and Presentation
- There have been much space used for introducing BN or equivalent, which are particualrly not the key takeaways of this work.
- The figures could be enhanced better, about the clarity, resolution, correct aspect ratio etc. I could see some AI traces associated with Figure 1 (but apologies if you did not apply AI).
- There are many terms/phrases coming without context, and it adds to great difficulty to understand the whole ppaer (probably they come from AI's vocabulary, rather than human!), such as "pooled accucracy" in L77, apologies I may not be able to understand this term at first glance!
Methodology
- Evaluating the testing adaptation of “old-fashioned” EEG deep models in 2026 would sounds a bit “old-fashioned” itself (especially considering foundation models have been dominating this area), and if not justfied or addressed well, it will sounds more like a report-like work rather than a paper bringing novel knowledge/insights to this community.
- Further to the last, I believe this area (BN for EEG model adaptation) has been done a lot, and looking into the references in Related Work section, all before 2024, is there any more recent work on this? and what is the difference?
- If TENT puls BN calibration is considered as one contribution, I am afraid people may not buy-in this. As I beleive this has been done significantly in test time adaptation based work (although may not in specific BCI EEG area)
- Most recent EEG foundation models use LayerNorm rather than BN, so it is unclear how the takeaways transfer.
Experiment and Results
- Just based on my experience of working these datasets, they are relatviely small, even different splits or small changes would result in big changes. After reading through this work, I am concerned that whether the takeaways from this paper can be as generalizable as possible to other datasets or tasks. So does it become clear (as said in L16 before this paper this issue remains unclear)?
- Euclidean alignment is cited (L88) but not compared, although it is cheap, source-free and standard for cross-subject MI. Also, Tables 1 and 2 would be enhanced by adding the sd or confidence interval. I would encourage stronger baselines and statistics.
Minor Issues and Suggestions
- Figure's readbility could be enhanced by increasing the font size.
- It is difficult for me to understand the term "risk" in the context of this paper, and also several other terms. Does it mean probability, or literally "risk"??
Questions for authors
I would expect the authors
- Please clarify the scope of this work, its main takeaways and its novelty, in particular relative to Wimpff et al. (2024), the BN baseline in TENT, and Schneider et al. (2020).
- Does the near-equivalence of TENT and BN-only hold, if condutced under a sweep of learning rate,