- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Resultant-Power Transport, a data-free continual model merging framework for subject-incremental EEG learning. RPT introduces a resultant-guided task-vector transport mechanism that uses cross-subject agreement to construct layer-specific targets and a closed-form projection to determine incoming contributions while preserving historical weights. Additionally, the proposed Affine-Map Batch Normalization mechanism merges normalization transformations using compatibility-weighted affine maps derived from stored BN statistics. Experiments on 3 EEG datasets demonstrate strong performance.
Critical strengths
- The paper addresses data-free continual EEG model merging, which is particularly relevant for scenarios where storing or replaying historical EEG recordings is undesirable.
- The proposed history-weighted projection provides a computationally efficient mechanism.
Critical weaknesses
- Table 3 reports extremely low performance on FACED when AM-BN is removed. These results are also substantially lower than the weight-averaging baselines reported in Table 2.
- Although the experiments cover three EEG tasks, they all use variants of the same CNN-Transformer backbone. The effectiveness of task-vector transport may depend on the architecture and the relative contributions of convolutional and linear layers. Additional evaluations on different EEG architectures would strengthen the generality of the proposed framework.
Questions for authors
- Table 3 shows that removing AM-BN causes FACED performance to drop to approximately 8%, substantially below the WA baseline. Could the authors explain the source of this degradation?
- Could the authors evaluate RPT on different backbone architectures, particularly EEG models with substantially different convolutional or Transformer configurations?
3 comments
Thank you for the additional experiments, and I have no further concerns. I will keep my score.
Thank you for maintaining your positive rating! We appreciate the time and care you put into reviewing our paper. Your constructive feedback helped us strengthen our work!
Response to Reviewer jnuS[1/N]
Thank you for your constructive review and for recognizing the merits of our approach. We appreciate the opportunity to address your questions and provide further context for our findings.
W1 / Q1. Why FACED accuracy drops without AM-BN
The 7.8% accuracy in Table 3 arises from independently averaging BN affine parameters and running statistics. In the first BN layer of each CNN branch, subject 23 accounted for about 99.9% of the summed expert running variances, and subject 4 accounted for about three quarters of the remainder. The large averaged variances reduced the effective BN scales, and the ablated model assigned about 98% of test trials to a single class in each of the ten orders.
Native weight averaging (WA) in Table 2 keeps the first expert’s BN running statistics. Subject 23 arrived after the first expert in all ten orders. In one order, replacing only the running statistics in the first BN layer of each branch with those of subject 23 reduced WA accuracy from 50.98% to 10.20%. In the same order, with the ablation’s non-BN weights fixed, using the first expert’s running statistics raised accuracy from 7.84% to 55.69%. Replacing the full BN state with its AM-BN counterpart raised accuracy to 58.43%.
We repeated merging after excluding subject 23 alone and after excluding both subjects 23 and 4. The table reports mean final ACC (%) over ten matched orders on the same 83 test subjects (Appendix C.7, Table 15, p. 33).
With AM-BN, RPT achieved 58.59% accuracy with all 85 experts included, within 0.17 percentage points of either exclusion run. With both checkpoints excluded and AM-BN held fixed, adding task-vector transport still improved accuracy from 52.61% to 58.76%.
W2 / Q2. Evaluation with the CBraMod backbone
Thank you for suggesting this evaluation. We compared RPT with continual model merging baselines on all three datasets using CBraMod [1], a distinct EEG backbone that combines convolutional patch embeddings with criss-cross attention. We followed the same subject-incremental experimental setup described in the manuscript. For each dataset, all merging methods received the same CBraMod checkpoints (50 epochs of pre-training for the shared model and 25 epochs of fine-tuning per subject) in the same arrival order.
The table reports CBraMod results, with accuracy (ACC) and macro-F1 (MF1) expressed as percentages and backward transfer (BWT) in percentage points (pp).
With CBraMod, RPT achieved the highest final ACC and macro-F1 among the merging methods on all three datasets and led five of the six BWT comparisons. MagMax led BWT-ACC on ISRUC.
[1] Wang J, Zhao S, Luo Z, et al. Cbramod: A criss-cross brain foundation model for eeg decoding. ICLR 2025
We hope our responses and additional results adequately address the points you raised. We appreciate your consideration and would be pleased to discuss any remaining questions. For further details, please refer to the revised manuscript, where changes to both the main text and the appendix are marked in blue.