- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces GACE, a framework for improving downstream EEG foundation models through self-guided fine-tuning, prediction-risk assessment, and selective correction. It combines training-time sample weighting based on true-class margins and confidence stability with two internal signals: channel-level attribution and aggregated intermediate-versus-final logit alignment. After fine-tuning, supervised risk and correction heads are trained on labeled calibration data to identify high-risk predictions and choose between retaining or modifying their labels. Evaluation across three backbones and six main datasets reports average improvements of 4.05 percentage points in balanced accuracy and 3.86 points in weighted F1, supported by component and feature ablations, stage-wise comparisons, and calibration and correction diagnostics.
Critical strengths
- This paper is well written and easy to follow. The authors conducted comprehensive experiments to showcase the good performance of the proposed framework.
- The evaluation covers multiple backbones and tasks, with positive mean balanced-accuracy gains in all comparisons.
- GACE is a plug-and-play framework, which preserves the backbone architecture and separates training adaptation, risk selection, and correction into identifiable modules.
Critical weaknesses
- The authors uses internal K-fold validation and out-of-fold risk scoring, but does not clearly consolidate the calibration split’s exact relationship to backbone training and validation, the value of K, or whether folds are grouped by subject or recording.
- The main results use a fixed highest-risk selection budget of 12%. Table 19 vary the selection rate, but only evaluates risk-selection precision on Cho2017-MI. The authors should conduct more comparison across tasks to to assess whether the approach remains beneficial when the budget or tasks differ from the main paper setting.
- I'm curious about that if the proposed trajectory statistic outperform concatenated or pooled layer-wise outputs when evaluated with the same correction-head capacity.
- And I want to know how sensitive are the Evidence gains to a fixed-predicted-class attribution target, the integration baseline, and fewer integration steps.
Questions for authors
Please refer to the weakness.
4 comments
Response for Weakness 2
Review Comments
The main results use a fixed highest-risk selection budget of 12%. Table 19 [now Table 30] vary the selection rate, but only evaluates risk-selection precision on Cho2017-MI. The authors should conduct more comparison across tasks to to assess whether the approach remains beneficial when the budget or tasks differ from the main paper setting.
Summary
Does GACE still improve final performance across tasks when the risk budget changes?
Response
GACE retains positive correction gains across multiple risk budgets on all six tasks; 12% is not the only effective budget.
Across six tasks, two backbones, and three seeds, we keep the trained risk head, correction head, and gates fixed, vary only the test-time risk-selection proportion, and directly evaluate final BACC. A larger risk budget is not necessarily better, as it may also introduce harmful changes. We therefore use 12% as a common evaluation setting, without claiming that it is optimal for every task. Cross-task budget results are reported in Appendix J.3 (Table 33 and Figure 6). The table below reports mean BACC gains over Self-Guidance from the same runs:
| Dataset | 3% | 5% | 7% | 9% | 12% | 16% | 20% | 30% |
|---|---|---|---|---|---|---|---|---|
| ATTENTION | +0.628% | +0.761% | +0.720% | +0.813% | +1.255% | +1.029% | +1.132% | +0.854% |
| BCI-IV-2a | +0.651% | +0.868% | +1.056% | +1.215% | +1.910% | +2.025% | +2.214% | +3.009% |
| SEED-2C | +0.741% | +0.905% | +1.132% | +1.008% | +0.700% | +0.967% | +1.049% | +0.782% |
| ISRUC-S3 | +0.795% | +1.028% | +1.253% | +1.511% | +1.709% | +0.995% | +0.723% | +0.428% |
| Mumtaz2016 | +4.334% | +7.273% | +9.745% | +11.027% | +7.768% | +10.014% | +9.221% | +7.716% |
| Speech-BCIC2020-3 | +0.333% | +0.267% | +0.267% | +0.244% | +0.267% | +0.156% | +0.156% | +0.156% |
Conclusion: All six tasks retain positive correction gains over the reported budget range, indicating that the method's effectiveness is not limited to a 12% budget.
Modification
We added Appendix J.3, "Correction Budgets across Tasks" (Table 33 and Figure 6). It reports final correction gains under different budgets.
Response for Weakness 3
Review Comments
I'm curious about that if the proposed trajectory statistic outperform concatenated or pooled layer-wise outputs when evaluated with the same correction-head capacity.
Summary
With the same correction-head capacity, do trajectory statistics outperform concatenation or averaging of layer-wise outputs?
Response
In the available comparisons, Trajectory yields larger correction gains than averaging or concatenating layer-wise outputs.
Trajectory explicitly describes alignment between intermediate layers and the final decision, whereas Mean and Concat average or concatenate layer-wise logits, respectively. The table below reports each variant's BACC gain over its corresponding Self-Guidance baseline (Appendix I.9.2, Table 27), averaged equally over CBraMod and CSBrain and three seeds:
| Dataset | Trajectory | Mean | Concat |
|---|---|---|---|
| ATTENTION | +1.26% | −0.14% | +0.06% |
| BCI-IV-2a | +1.91% | −0.22% | −0.72% |
| SEED-2C | +0.70% | +0.08% | +0.10% |
| ISRUC-S3 | +1.71% | +0.54% | +0.61% |
| Mumtaz2016 | +7.77% | +7.23% | +7.46% |
| Speech-BCIC2020-3 | +0.27% | −0.36% | −0.24% |
Conclusion: In the available comparisons across runs, Trajectory yields larger gains than Mean and Concat on all six tasks.
Modification
We added comparisons in Appendix I.9.2, "Alternative Trajectory Encodings" (Table 27). These include averaging and concatenation of layer-wise outputs.
Response for Weakness 4
Review Comments
And I want to know how sensitive are the Evidence gains to a fixed-predicted-class attribution target, the integration baseline, and fewer integration steps.
Summary
How do the attribution target, integration baseline, and number of integration steps affect final performance?
Response
GACE generally retains positive correction gains across attribution settings, indicating that its effectiveness does not depend on a single specific attribution configuration.
The current Evidence computation uses a zero baseline and 16 integration steps, taking gradients of the maximum logit along the path and allowing the maximizing class to change along the path. We separately replace this setup with a target that holds the class predicted for the original input fixed along the integration path, a training-set mean baseline, and 4/8 integration steps. On three tasks and two backbones, we keep the backbone fixed, recompute attributions, and retrain and select the risk and correction heads for each setting, using the same 12% selection budget. The table below reports each setting's BACC gain over Self-Guidance from the same run (Appendix I.8, Table 25):
| Dataset | Model | Fixed predicted class | Training-set mean baseline | 4 integration steps | 8 integration steps |
|---|---|---|---|---|---|
| BCI-IV-2a | CBraMod | +1.215% | +2.604% | +3.299% | +2.517% |
| BCI-IV-2a | CSBrain | +1.563% | +0.781% | +0.174% | +1.736% |
| SEED-2C | CBraMod | +0.247% | +0.617% | 0.000% | +0.370% |
| SEED-2C | CSBrain | +0.988% | +0.247% | +0.494% | +2.222% |
| Mumtaz2016 | CBraMod | +13.859% | +13.302% | +10.999% | +13.659% |
| Mumtaz2016 | CSBrain | +5.903% | +6.098% | +5.108% | +6.364% |
Conclusion: GACE generally retains positive correction gains when the attribution target, integration baseline, or number of integration steps is changed.
Modification
We added Appendix I.8, "Attribution-Setting Sensitivity" (Table 25). It clarifies the attribution definition and compares attribution targets, integration baselines, and step counts.
I sincerely thank the authors for additional experiments and clarification. My concerns are well addressed and I will keep my positive rating.
Response to Reviewer 3 (GzHA)
Thank you for recognizing the clarity, experimental coverage, and modular design of our work, and for your specific suggestions on the calibration protocol, risk budget, trajectory design, and attribution sensitivity. We address each point below.
Overview
To facilitate comparison with the review, each response follows this structure:
Summary: A concise restatement of the reviewer's main concern, divided into subquestions A, B, etc., where needed.
Response: Direct answers, explanations, and supporting evidence for each point.
Modification: The corresponding changes to the main text or appendices.
Response for Weakness 1
Review Comments
Summary
How is the calibration set defined, what is the value of K, and how is out-of-fold scoring performed?
Response
(1) The calibration set reuses the original validation set without adding labeled data; this set serves different purposes in backbone model selection and post-hoc training.
(2) Internal risk scoring uses 2 or 5 folds, with subject-wise splits for all datasets except ISRUC-S3, which has only one calibration subject.
Conclusion: The calibration set reuses the original validation set. Internal out-of-fold scoring is performed with a fixed backbone, and the fold unit is chosen according to the calibration subjects available for each task.
Modification
We summarize the calibration folds in Appendix C.1 (Table 5) and clarify reuse of the original validation set in Appendix O.1. This distinguishes backbone model selection from risk-head fitting.