- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The problem this paper aims to solve is very practical: subjects, devices, numbers of channels, and emotion labels all differ across affective EEG datasets. Can these data be used together to pretrain a model that transfers more easily? The authors propose UniPER, which combines masked prediction, zero-input reference, and event relationship learning, and test it on six target datasets. I appreciate this research direction, and the improvements reported in the paper are worth noting. However, after reading it, I am still not entirely sure how much of these gains come from the proposed new designs and how much come from the pretraining data and training approach themselves. In addition, the specific procedure of the "zero-shot" experiments and the performance of some baselines also need further explanation.
Critical strengths
First, the paper does not require all datasets to use the same set of emotion labels, which is of great practical value. Different datasets inherently use inconsistent emotion classification schemes, and being able to directly leverage these data is more convenient than forcibly aligning labels first. Second, the experimental coverage is relatively broad, and some of the improvements are not small. For example, BACC on FACED reaches 65.60%, nearly 6 percentage points higher than the strongest baseline; on SEED-V there is also an improvement of about 5.5 percentage points. Gains are also observed in subject-independent experiments, so these results deserve serious consideration. Another point worth acknowledging: the authors explain the data splits, with SD split by complete trials and SI split by subjects. The paper also reports the case where it does not outperform on SEED-IV and acknowledges that FACED used only some subjects, allowing readers to understand more clearly the scope in which the results apply.
Critical weaknesses
-
I still cannot clearly see where the most critical advance of UniPER over existing methods lies. Masked latent prediction, multi-dataset pretraining, and exploiting cross-subject relationships under the same stimulus all have related prior work. The potentially valuable distinction of this paper may be the zero-input reference and the combination of these objectives. However, a very critical control is missing: what would happen with the same backbone, the same nine source datasets, and the same training budget, but using only conventional EMA masked prediction? Without this experiment, it is hard for me to judge where the advantage of the full model actually comes from. The paper also discusses closely related work such as MGCRL but does not compare directly with it, which makes it harder to judge the contribution.
-
The "zero-shot" experiments are easily misunderstood, and the details are not fully explained. The appendix states that at test time a labeled gallery from the target dataset was used. That is, although the model does not update its parameters, labeled samples from the target domain are still needed for classification. This setting itself is feasible, but the main text should state this more directly. It is currently unclear how large the gallery is, how many samples per class are included, whether the gallery and query come from the same subjects or trials, and how the final class prediction is obtained. These details could all significantly affect the results in Table 3 and need to be supplemented.
-
The results of some baselines make me question whether the comparison is sufficiently thorough. For example, on FACED, DGCNN and EEG Conformer perform close to chance level. This does not necessarily mean there is a problem with the implementation, but at least it needs explanation: did the models converge, is the input processing suitable for these methods, and was reasonable hyperparameter tuning performed? In addition, the paper does not explain clearly enough what weights and what source data each pretraining baseline specifically used, and whether they were retrained. If these conditions differ greatly, the comparison in the table can hardly directly show that the method itself is better.
-
The ablation shows that some components are useful, but it does not yet explain clearly why they are useful. For example, performance drops markedly after removing the zero reference. This is an interesting result. But this experiment removes the reference in both the encoder and the predictor at the same time, so it is impossible to know which one is actually responsible, or whether the two must be used together. Similarly, does the improvement brought by the cross-source relationship loss really indicate that the model has learned emotion information that transfers more easily across datasets? The current evidence is relatively indirect. I would like to see more direct analyses, for example, how much data-source or subject-identity information is still retained in the representation, and whether performance is more stable when encountering unseen stimuli or channel changes.
-
Small improvements still need more sufficient statistical support. The improvement on MPED is very small, and the BACC on SD is only 0.45 percentage points ahead. Although the paper reports means and standard deviations, it still needs to distinguish fluctuations from the target data split from fluctuations from pretraining itself. For such close results, I would not consider a stable advantage to have been established based on ranking by mean alone. I hope the authors will focus on answering the following in their response
Questions for authors
-
Under the same data, backbone, and training budget, what level can conventional EMA masked prediction achieve?
-
Why was no direct comparison with the closest methods such as MGCRL included?
-
What exactly are the gallery size, split, and classification rule? Can it be guaranteed that the gallery and query are isolated at the trial level?
-
Were the several baselines on FACED that are close to chance level sufficiently trained and tuned? Can training curves or related explanations be provided?
-
How much do the encoder zero reference and the predictor zero reference each contribute? Does increasing the number of pretraining data sources still yield gains under a fixed data volume?
We thank the reviewer for asking what transfers across stimuli and what drives the gains.
Q1: Why mask 28% along each axis?
A1: We chose 0.28 for both axes by preliminary validation on held-out source data. The ideal grid union is 0.28 + 0.28 − 0.28² = 48.16%, and 47.20% of valid tokens were masked in practice. The SD sweep varies both axes together and retains the Table 4 aggregate at 0.28.
The 0.28 and 0.40 settings give similar scores. Performance is lower at 0.15 and 0.55. We will clarify the mask accounting and the scope of this sweep in the camera-ready appendix.
Q2: Do pooled data or the objectives drive the gains?
A2: Pooling improves the EMA baseline with SIGReg. UniPER scores higher than the pooled EMA+SIGReg control on both targets. The predictive controls use the same backbone and 7,200 updates.
Q3: Does performance transfer across stimulus identities?
A3: With both participants and clips held out of target training, UniPER reaches 71.93% BACC on SEED-IV and 63.38% on FACED. The matched predictive baseline reaches 66.82% and 59.07%. FACED holds out 9 of 28 clips, one per class, and uses 19 for training. SEED-VII reuses stimuli from the SEED series. These results support transfer across target clips and leave the contribution of correlated sensory and attentional cues open.
Q4: What does cross-source supervision change?
A4: Cross-source KL matches EMA teacher similarities. Its supervision comes from the teacher, with no independent emotion correspondence labels. SIGReg regularizes source-centered features.
The 9-way source probe uses held-out participants (uniform chance 11.11%). Subject probes operate within each target. Source and subject accuracy are lower with the loss enabled, and Table 4 shows higher SD BACC. Source identity remains recoverable.