- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors investigate EEG-based person identification across recording sessions. At training time, recordings from a first session are available for all enrolled users, but recordings from a later session are available only for a subset of them, referred to as auxiliary users; the remaining users are evaluated on their later session without any calibration data. The proposed method, SHIFT-ID, measures for each auxiliary user how the statistics of the learned features (channel means and log standard deviations) change between the two sessions. These session shifts are then applied to the features of other users to simulate how their recordings might change in a later session, and the network is trained to give consistent identity predictions on these simulated views, using a consistency loss and a worst-case prototype loss. The method is evaluated on three datasets (MCD, M3CV, and SEED-IV) against twelve EEG architectures and against strategies that use the same auxiliary data, such as DANN.
Critical strengths
First, the information-isolation protocol is clearly specified, and the comparison group that uses the same backbone and auxiliary data is the right design for separating the value of the data from the value of the method.
Second, the mechanism is simple, its components are examined through ablations, and the authors report the modest size of the gains candidly.
Critical weaknesses
First, the gain is small and not statistically supported. Around 11 points on MCD come from the additional target-session data, and SHIFT-ID outperforms both cross-entropy on that data and DANN by less than one point. With 5–8 evaluation identities on two datasets and no standard deviations or statistical tests, it is not possible to tell whether these improvements exceed run-to-run variability, although the paired design and the consistent direction of the gains help. Moreover, CAGCNet without the auxiliary data already matches the authors’ backbone trained with it, suggesting the architecture matters more than the training method.
Second, the novelty is limited, and the authors do not explain their hyperparameter choices. Transferring within-class variation to other classes has been shown before (Hariharan and Girshick, 2017; Schwartz et al., 2018), and feature-statistic augmentation is close to AdaIN, MixStyle, and DSU, so the contribution lies mainly in applying this idea to session differences for EEG identification. The default matches the best test result in every MCD sweep, but the paper does not explain how the defaults were chosen, which is concerning when the gains are under 1 point. On presentation, C0–C8 in Table 3 are not defined, and Appendix A largely repeats Section 3.
Questions for authors
Can the authors provide standard deviations and a paired test across multiple runs, or an identity-level bootstrap interval, for the comparisons with auxiliary cross-entropy, DANN, and CAGCNet? How were the default hyperparameters chosen? It would also be useful to see SHIFT-ID applied to the strongest backbones with the same auxiliary data, and compared with an augmentation that uses the auxiliary target statistics, such as MixStyle. What is the effect of combining SHIFT-ID with auxiliary cross-entropy? Regarding the data, were the two MCD conditions recorded on different days? How does the gain change as the number of auxiliary identities increases on M3CV?