- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes PRiSE-EEG, a prior-guided EEG foundation model for cross-paradigm representation learning. Motivated by gradient conflicts across EEG tasks and depth-dependent differences in representation similarity, the authors introduce a continuous multi-channel tokenizer that integrates static spatial priors with dynamic channel interactions. They further propose CKA-calibrated depth-stratified experts to allocate shared and specialized experts across Transformer layers.
Critical strengths
-
The motivation is good. This paper addresses an important challenge in cross-paradigm EEG representation learning. The analysis of gradient conflicts and layer-wise representation similarity provides a reasonable motivation for the proposed depth-stratified expert design.
-
The proposed method is evaluated on 12 public EEG benchmarks covering diverse tasks.
Critical weaknesses
-
Although the CKA-based expert allocation is well motivated by the challenges of cross-paradigm EEG representation learning, as discussed in Strength 1, the proposed solution largely reduces this challenge to determining the number of shared and specialized experts at different network depths. Related ideas have already been explored in existing works, such as NeurIPT (NeurIPS 2025), which investigates progressive expert specialization, and EEGMoE (TNNLS 2026), which introduces shared and domain-specific experts. In particular, NeurIPT is not discussed in the related work, while EEGMoE is acknowledged but not included in the experimental comparisons. A clearer distinction from these methods, together with more direct comparisons, would help establish the novelty of the proposed design.
-
The ablation results in Figure 3 show that using a fixed number of shared experts ("Fixed 2 Shared Experts") leads to relatively modest performance degradation compared with the proposed CKA-based allocation. Given that depth-stratified expert allocation is a central contribution of this work, these results raise questions about how much the CKA-guided design actually contributes beyond a simpler fixed allocation strategy.
-
The implementation details of joint fine-tuning need further clarification, particularly how training batches are constructed and how datasets of substantially different sizes are balanced during optimization. More importantly, Table 9 shows that joint fine-tuning consistently outperforms single-task fine-tuning across all 12 heterogeneous EEG datasets, which deserves further investigation. Although positive transfer across tasks is possible, such consistent improvements are not necessarily expected. Given the motivation of this work, the CKA-guided expert design should ideally play an important role in facilitating beneficial cross-paradigm knowledge sharing. However, the relatively modest improvements over fixed expert allocation in Figure 3 make it unclear how much this design contributes to the observed multi-task gains. Although Figure 5 provides some analysis of gradient similarity and expert routing, it does not directly explain these consistent improvements or establish their connection to CKA-guided allocation.
Questions for authors
Please see in Weaknesses
I appreciate the authors’ additional experiments and clarifications, which have addressed some of my concerns and strengthened the empirical support for the proposed design. However, my main concern remains.
While I appreciate the motivation of mitigating cross-paradigm conflicts and facilitating knowledge sharing, the methodological advance of this component primarily consists of using offline representation similarity to determine the layer-wise allocation of shared and specialized experts within an existing MoE framework. In my view, this remains a relatively incremental extension of existing expert-allocation designs and this offers limited methodological novelty relative to such broader motivation. And the paper still lacks a sufficiently clear explanation of how this specific CKA-guided allocation mechanism further mitigates cross-paradigm conflicts and facilitates knowledge sharing.
As the CKA-guided expert allocation is presented as a main technical contribution of this work(see in Intro. Contribution. 2), I maintain my original rating. This is my final rating.