- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents a framework for improving surface electromyography decoding through architectural refinements and training-time privileged information. The approach combines delta-position prediction, joint tracking and regression training, causal temporal feature modulation, and Metadata-conditioned Layers. McLayers stochastically alternate between metadata-specific and generic transformations during training, while using only generic transformations at inference. Experiments demonstrate improvements on emg2pose and emg2qwerty, including generalization to unseen users.
Critical strengths
- Generalization across users is a central challenge in sEMG decoding. Evaluation on both continuous hand-pose estimation and typing provides useful evidence that McLayers can benefit different decoding tasks. The reduction in emg2qwerty character error rate is particularly encouraging.
- The paper includes multiple training seeds, user-level statistical comparisons, and extensive ablations covering feedback, conditioning granularity, layer placement, routing probabilities, and computational cost. Matching the position and velocity decoders also makes their comparison more informative.
- The inference design is practical, McLayers exploit training metadata without requiring user identity or sample-specific parameters at test time. Their transformations can potentially be merged into adjacent layers, making the approach attractive for deployment.
Critical weaknesses
- My major concern is about the insufficient comparison with closely related works. The main methodological contribution is closely connected to existing approaches that separate shared and subject-specific parameters or exploit privileged information during training. Although relevant methods such as DResNet and TRAM are discussed, direct comparisons are missing. Consequently, the advantages of stochastic metadata routing over neighboring approaches remain unclear.
- Improvements from sample-specific mappings suggest that additional training capacity or stochastic regularization may contribute substantially. Controls using size-matched random pseudo-user groups and metadata-independent stochastic transformations would help determine whether genuine user structure is essential.
- Streaming and long-horizon behavior remain incompletely validated. The standard five-second evaluation provides limited evidence for sustained tracking, and the longer-horizon result is primarily illustrative. Furthermore, the temporal alignment of linear feature upsampling requires clarification to establish end-to-end causality.
- Some gains require stronger attribution controls. The overall system combines several effective modifications, while the independent improvement from user McLayers on emg2pose is approximately 3–6% relative to the stronger baseline. For emg2qwerty, it is also important to establish whether the unmodified baseline was retrained with the same additional gradient clipping and evaluation configuration.
Questions for authors
- How do McLayers compare with a shared/subject-specific parameter baseline and a representative privileged-information method under matched training conditions?
- How much improvement remains when training examples are assigned to fixed random pseudo-user groups with approximately the same group sizes as the real users?
- What exactly constitutes a “sample” for sample-conditioned mappings, and at what granularity are routing decisions sampled?
- Does multi-task training outperform a regression-only baseline under matched computational budgets? Was the emg2qwerty baseline retrained using identical gradient clipping and evaluation settings?
- Can the authors clarify timestamp alignment during upsampling, provide a future-input perturbation test for causality, and report aggregate long-horizon tracking results across users?
5 comments
Q1: How do McLayers compare with a shared/subject-specific parameter baseline and a representative privileged-information method under matched training conditions?
We now compare McLayers to a shared/subject-specific parameter baseline (DResNet) and a privileged-information method (TRAM). While TRAM does improve decoding to a lesser degree than McLayers, DResNet does not improve decoding (Global Response section 1).
Q2: How much improvement remains when training examples are assigned to fixed random pseudo-user groups with approximately the same group sizes as the real users?
Some of the improvement of McLayers remains when training examples are assigned to fixed random pseudo-user groups with the same group sizes as the real users. For example, for User-Stage Tracking, the baseline ΔPos, TFiLM achieves 9.97° AE, while shuffled metadata achieves 9.87° and PI-EMG-U achieves 9.53°. Please see Global Response section 2 for more details.
Q3: What exactly constitutes a “sample” for sample-conditioned mappings, and at what granularity are routing decisions sampled?
For sample-conditioned mappings, a "sample" refers to a window of data associated with a particular anchor start time step and dataset index. For routing, all time steps within a window are routed identically, to either the generic mapping or the mapping associated with that dataset index.
Q4: Does multi-task training outperform a regression-only baseline under matched computational budgets? Was the emg2qwerty baseline retrained using identical gradient clipping and evaluation settings?
For multi-task training, we trained a version of Pos MT -FB whose computational budget matches that of single-task models, by sampling across tasks rather than weighting their respective losses. We found that sampled multi-task training, which is more efficient, matched the performance of weighted multi-task training (Global Response section 5, Table R7). We have now retrained the S4D-large emg2qwerty baseline using identical gradient clipping and evaluation settings, and have updated all of our comparisons (Global Response section 3, Table R5).
Q5: Can the authors clarify timestamp alignment during upsampling, provide a future-input perturbation test for causality, and report aggregate long-horizon tracking results across users?
We clarify timestamp alignment during upsampling and report a causality test using backpropagation as well as aggregate long-horizon tracking results across users in Global Response section 4.
(2/2)
Dear Reviewer cpnA,
We thank you again for your constructive feedback. We wish to politely remind you that the end of the author-reviewer discussion period draws nigh, and want to check if our previous responses and updated manuscript have addressed each of your concerns, as well as whether there are any last-minute questions or concerns.
Kindest regards, The Authors
Thank you for your highly detailed review. We address each point individually, though the reviewer may prefer to read the Global Response:
W1: My major concern is about the insufficient comparison with closely related works. The main methodological contribution is closely connected to existing approaches that separate shared and subject-specific parameters or exploit privileged information during training. Although relevant methods such as DResNet and TRAM are discussed, direct comparisons are missing. Consequently, the advantages of stochastic metadata routing over neighboring approaches remain unclear.
We agree that our paper would greatly benefit from the inclusion of relevant baselines such as DResNet and TRAM. We now include these baselines. We found that TRAM improved decoding, though less than McLayers, while we were unable to find a DResNet configuration that improved decoding (Tables R1 and R2). Please see Global Response section 1 for details on implementation.
W2: Improvements from sample-specific mappings suggest that additional training capacity or stochastic regularization may contribute substantially. Controls using size-matched random pseudo-user groups and metadata-independent stochastic transformations would help determine whether genuine user structure is essential.
We agree that the extent to which user structure helps could be better determined by such controls. We now include size-matched random pseudo-user groups, formed by randomly shuffling the user-side metadata across training windows once at the start of training. We also test metadata-independent stochastic transformations by sampling the user-side metadata (with replacement) for every sample at every training step according to the global training distribution. Both approaches underperform McLayers that use unaltered metadata. Please see Global Response section 2 and Table R3 for more details.
W3: Streaming and long-horizon behavior remain incompletely validated. The standard five-second evaluation provides limited evidence for sustained tracking, and the longer-horizon result is primarily illustrative. Furthermore, the temporal alignment of linear feature upsampling requires clarification to establish end-to-end causality.
We agree that long-horizon behavior remains incompletely validated in emg2pose’s original 5-second evaluation setting, and have now added long horizon evaluations using 40-second windows (around the minimum length for individual recordings, beyond which many recordings become ineligible for this analysis). We find that PI-EMG-U outperforms all baseline models across time. We include Table R6 (new Table A.2) in the global response and add Figure A.4 to the paper itself.
W4: Some gains require stronger attribution controls. The overall system combines several effective modifications, while the independent improvement from user McLayers on emg2pose is approximately 3–6% relative to the stronger baseline. For emg2qwerty, it is also important to establish whether the unmodified baseline was retrained with the same additional gradient clipping and evaluation configuration.
We agree that McLayers are not the sole contributor to our overall performance improvement. To reduce confusion, in the Abstract we now separate the individual contribution of McLayers from the global improvement relative to Salter et al.'s baseline.
We have since retrained Ortone et al.'s S4D-large with gradient clipping on emg2qwerty over 4 training seeds, which achieves CERs of 40.4 and 32.0 for greedy and beam search decoding, respectively, using Sivakumar et al.'s evaluation protocol (Table R4). We now update the relative improvements from adding user McLayers S4D-large to 9.9% (greedy) and 13.1% (beam search). Additional testing on the CNN-Conformer from Wang et al., 2026 yielded improvements of 4.1% (greedy) and 7.5% (beam search) relative reductions in CER.
(1/2)