- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes AMRT, which decodes continuous hand or cursor trajectories from scalp EEG and intracranial EEG with one framework meant to work across subjects, electrode layouts, and datasets.
The paper’s main contribution is a two-stage decoder that first predicts velocity and integrates it into a rough trajectory, then uses the neural signals together with that trajectory to correct the drift, and it pairs this with channel adapters that let one model handle both fixed-cap EEG and variable intracranial electrode layouts. Its second contribution is a step-by-step generalization study across three datasets, covering unseen trials, unseen subjects, few-shot calibration, and what the authors call the first systematic cross-dataset transfer study for continuous decoding between scalp and intracranial EEG.
The proposed method is tested on WAY-EEG-GAL, U-Limb, and Joystick-Track for unseen trials, unseen subjects, few-shot calibration, and transfer between datasets, using PCC. AMRT beats three recent EEG decoders. Pretraining on another dataset lets it reach 0.454 on U-Limb with 10% of the target data, against 0.192 when trained from scratch on all of it. However, transfer between EEG and iEEG fails in both directions, and predicting position directly does as well as AMRT or better when training and testing on the same subject.
Critical strengths
- The target problem is very relevant in the field. Continuous kinematic decoding that generalizes across subjects, electrode layouts, and datasets is an important and under-explored problem for practical BCIs.
- The proposed method is intuitive. Splitting decoding into velocity-based motion anchoring and trajectory refinement is easy to follow, and it clearly helps on U-Limb, the dataset with the most diverse movements.
- Evaluation experiments are comprehensive. The experiments go step by step from unseen trials to unseen subjects to transfer between EEG and iEEG datasets.
- The authors provided source code for reproduction of results.
Critical weaknesses
- The manuscript has many grammatical and spelling errors, including in the main figures. For example, Figure 1 has “Ressidual” for “Residual”. The whole manuscript and its figures need careful proofreading.
- The caption of Figure 1 is a single sentence. It should briefly explain each module and the data flow from the channel adapters, through the encoder, to Stage-0 and Stage-1.
- All datasets involve executed movements, and the preprocessing uses only a notch filter and common average reference, with no ICA or removal of motion, eye or muscle artifacts. Such artifacts are time-locked to the task, especially in the low-frequency band used for WAY-EEG-GAL, so the model could learn them as a shortcut instead of decoding neural activity. The authors should report results after artifact removal and add a shuffled-EEG or template-trajectory baseline to show that performance depends on genuine neural information.
- The PCC metric ignores trajectory scale and offset, yet correcting integration drift in amplitude and position is the main role of Stage1. A prediction with the right shape but the wrong amplitude can still score a high PCC. The authors should report R² and RMSE alongside PCC, especially when comparing AMRT with the velocity-integration baseline.
- Figure 2 is low quality, and most of its text is too small to read.
- Table 8 shows that cross-dataset pretraining helps substantially only when U-Limb is the target. Transfer from EEG to iEEG never beats scratch, and with Stage-1-only adaptation it is far worse (W→J at 10%: −0.047 vs. 0.730). Pretraining on two source datasets is also worse than the best single source for U-Limb (Table 10). Yet the abstract and conclusion describe transfer potential in general terms. The authors could state these limits explicitly in a limitations section and discuss why transfer to iEEG fails.
Questions for authors
- Why is Li et al.(2026a), “Learning Residual Kinematic Corrections for Continuous Neural Decoding via Reinforcement Learning”, only mentioned in Appendix A.3 and not compared as a baseline? It seems closely related to the proposed two-stage design and could be a good baseline comparison.
- The manuscript reports results over 10 random seeds, but the released code uses 11, 5 and 4 seeds for WAY-EEG-GAL, U-Limb and Joystick-Track. Can the authors clarify the seed setting? In addition, could you please clarify whether the 8:1:1 split is fixed for Tables 1 and 3 across seeds, or were trials shuffled?
- The code adds a grasp-classification loss for WAY-EEG-GAL (weight 0.5), a trajectory-consistency loss for U-Limb, per-axis loss reweighting, and a gate-sparsity term in Stage-1, none of which are discussed in the paper. Were these used or dropped in the reported experiments?
3 comments
Thanks for the author's response and additional results. However, it is still unclear to me. Does the ICA check cover only WAY-EEG-GAL under ctri? What about U-Limb, where AMRT’s gains are largest? Could you please report the baseline results under the within-dataset setting and artifact removal on U-Limb and under csub?
Author Response to Reviewer mt8U 2
We thank the reviewer for the thoughtful follow-up and for highlighting the need for a more comprehensive artifact analysis.
We confirm that our previous rebuttal only reported the ICA analysis on WAY-EEG-GAL under ctri. We have now extended the evaluation to U-Limb under both ctri-mix and csub-LOSO using ICA-based artifact removal.
| Protocol | Input | PCC ↑ | ΔPCC | RMSE ↓ |
|---|---|---|---|---|
| csub-LOSO | Before ICA | 0.430 ± 0.073 | — | 79.106 ± 13.723 |
| csub-LOSO | After ICA | 0.424 ± 0.114 | −0.006 | 81.500 ± 15.687 |
| ctri-mix | Before ICA | 0.530 ± 0.029 | — | 80.926 ± 3.760 |
| ctri-mix | After ICA | 0.522 ± 0.029 | −0.008 | 81.658 ± 5.136 |
Across both protocols, ICA-based artifact removal results in negligible PCC reductions (≤ 0.008), with modest RMSE changes. These findings demonstrate that AMRT's decoding performance is largely unaffected by ICA-based artifact removal, including under cross-subject evaluation, suggesting that the observed performance is unlikely to be primarily driven by the removed artifacts.
Author Response to Reviewer mt8U
We thank the reviewer for the constructive comments. We have addressed the presentation, evaluation, and reproducibility concerns as follows.
W1/W2/W5: Improved presentation and figure clarity. We have proofread the manuscript, corrected spelling and grammatical errors, improved the readability of Figures 1–2, and expanded the Figure 1 caption to explain the roles and data flow.
W3: Robustness to artifacts and trajectory-template controls. We adopt consistent preprocessing across EEG/iEEG datasets (Sec. 3.1). To assess artifact contamination, we additionally applied ICA to remove candidate ocular and muscle components on WAY-EEG-GAL under the ctri protocol. PCC remained comparable to the original result (0.90 ± 0.03 vs. 0.91 ± 0.03), suggesting limited sensitivity to the removed components. We also added an EEG-free trajectory-template baseline (Appendix E.3.4). Cross-dataset template transfer yields generally low PCC. Together with successful W→U and J→U transfer, these findings suggest that AMRT's cross-dataset gains cannot be fully explained by stereotyped trajectory patterns.
Cross-dataset trajectory-template transfer:
W4: Additional positional error metrics. We add trajectory RMSE results in Appendix E.1.1 (Tables 7–9). Compared with Vel-Int, AMRT reduces RMSE across all evaluated settings, demonstrating improved positional reconstruction beyond trajectory PCC.
ctrictri-mixcsubctri-mixcsubctrictri-mixcsubW6: Directional cross-dataset transfer. The observed asymmetry may reflect differences in neural sampling and task compatibility. Scalp EEG captures spatially mixed activity from distributed cortical sources, whereas ECoG provides more localized measurements with subject-specific cortical coverage [1]. Thus, local motion-related features learned from ECoG may remain accessible through EEG, while distributed spatial patterns learned from EEG may not be preserved in locally sampled ECoG recordings. Task differences may also contribute: our additional trajectory-template transfer analysis yields PCCs of −0.161 ± 0.021 for J→U and −0.406 ± 0.095 for U→J, suggesting greater difficulty in the reverse direction.
Q1: Comparison with Li et al. (2026a). We discuss this closely related work in Appendix A.3. As its code is not publicly available, a direct comparison is currently unavailable. We will reproduce the method based on the paper's description and evaluate it later.
Q2: Random seeds and data partitioning. The reported results follow the configurations described in the paper; the released scripts contain example configurations and do not fully specify every reported run. Under ctri-mix, complete trials are randomly shuffled and repartitioned at an 8:1:1 ratio for each seed, rather than using a fixed split across seeds (Sec. 3.2.1). This avoids window-level leakage and evaluates robustness across different trial partitions.
Q3: Clarification of training losses. The grasp-classification loss (weight 0.5) is associated with the supplementary grasp-state decoding experiment (Appendix E.3.2). The U-Limb trajectory-consistency loss and Stage-1 gate-sparsity regularization were exploratory variants and were not used in the final reported experiments. Per-axis loss reweighting was used but omitted from the manuscript; we have added its description in D.2.
Reference [1] Dubey A, Ray S. Cortical electrocorticogram (ECoG) is a local signal[J]. The Journal of Neuroscience, 2019, 39(22): 4299-4311.