- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents STAMP, a task-structured Transformer for streaming hand-pose estimation from surface electromyography (sEMG) signals. It introduces three components: a STEM encoder for spatiotemporal electrode modeling, an Affine Scan decoder for pose propagation and correction, and a history-conditioned Motion MoE for adaptive computation. Experiments on emg2pose, EgoEMG, and NinaPro demonstrate improved pose estimation accuracy over retrained baselines. Additional ablations, scaling studies, and streaming evaluations support the effectiveness and practicality of the proposed architecture.
Critical strengths
- The proposed Motion MoE leverages multi-scale motion histories for adaptive expert selection, improving the model's ability to capture different motion patterns and enhancing pose estimation accuracy.
- The replacement studies are useful. Near-parameter-matched temporal attention and wider non-MoE controls, together with routing and decoder replacements, provide evidence beyond a simple capacity explanation.
- I also appreciate the explicit distinction between native streaming causality, benchmark alignment, and the steady-state execution latency.
Critical weaknesses
- My main concern is experimental robustness. The experiments do not sufficiently validate the effectiveness of Motion MoE across different motion regimes or STEM's robustness to electrode displacement. The main emg2pose comparison and cumulative ablations use a single seed, and the scaling experiments also lack repeated seeds and participant-subset sampling. This limits confidence in both the smaller performance differences and the fitted scaling slopes.
- STAMP shows limited improvements on unseen users in NinaPro and the audited EgoEMG protocol, raising concerns about its generalization ability across different users and datasets.
- The released-protocol EgoEMG results have split and model-selection limitations. The additional audited evaluation is valuable and should carry more weight in the main presentation. A unified comparison with the complete PI-EMG method would also strengthen the accuracy claims.
- Long-horizon tracking exposes an important limitation. At 30 seconds, the original absolute-position configuration performs worse than the baseline.
Questions for authors
- To demonstrate the effectiveness of MotionMoE, the authors compare it with a parameter-matched wider backbone. Could the authors clarify the specific architecture of this wider backbone. Furthermore, the paper argues that a fixed computation path must compromise across static, transitional, slow, and fast motion regimes, motivating the proposed Motion MoE. However, the current experiments do not directly demonstrate whether Motion MoE alleviates this limitation. Could the authors provide a comparison of STAMP and the baselines across these different motion regimes to verify the benefits of motion-dependent expert selection?
- The paper motivates STEM by highlighting the importance of electrode spatial relationships and the sensitivity of sEMG signals to electrode placement shifts. Although the authors compare STEM with a temporal Transformer and evaluate circular positional encoding, the current experiments do not directly demonstrate robustness to electrode displacement. Could the authors evaluate STAMP under different electrode placement conditions or controlled sensor perturbations to verify whether the proposed spatial modeling improves robustness compared with the baselines?
- Although STAMP achieves strong performance on emg2pose, its improvements are less consistent across other datasets. In particular, STAMP underperforms NeuroPose on the User and User+Stage splits of NinaPro, while its performance gains become marginal under the audited EgoEMG protocol. Could the authors explain why the proposed method shows less consistent improvements in cross-user generalization across different datasets?
- While the motivation and mathematical formulations are reasonably clear, the correspondence between Figure 2 and the method description could be improved. Several architectural components, such as the multi-scale Patch MLP and the two decoder attention are only briefly described in the main text. The Method section relies heavily on mathematical formulations, many of which would be more appropriate for the appendix. This makes it difficult to follow the complete data flow directly from the method section and Figure 2. The authors should simplify the equations in the main text and focus on clearly explaining the inputs, outputs, functions, and roles of each module within the overall architecture, while moving detailed mathematical derivations to the appendix.
2 comments
imited Sensitivity of Aggregate EgoEMG Tracking Scores to Dynamic Performance
We provide an additional analysis to clarify why the aggregate EgoEMG tracking scores are close and how they reflect dynamic tracking performance.
1. A strong initial-pose baseline
On the restored strict-v1 split, holding the supplied ground-truth initial pose throughout each five-second window yields 9.164° joint-angle MAE. The three-seed means of the four trained methods range from 8.976° to 9.171°. Thus, a competitive aggregate score can be obtained without estimating subsequent motion from EMG.
2. Motion stratification reveals different rankings
For each user, we divided test windows into lower- and higher-displacement halves according to the ground-truth pose deviation from the initial pose. The groups contain 832 and 843 windows, respectively, and both cover the same 32 users. The table reports joint-angle MAE, averaged over three seeds for the trained methods.
| Method | Lower displacement | Higher displacement |
|---|---|---|
| Hold initial pose | 5.460° | 12.749° |
| STAMP | 5.969° | 12.108° |
| EMGFormer-M | 5.492° | 12.731° |
| NeuroPose | 5.494° | 12.698° |
| vEMG2Pose (velocity integration) | 5.543° | 12.300° |
Holding the initial pose has the lowest error in the lower-displacement group, whereas STAMP has the lowest error in the higher-displacement group. Based on each user's three-seed mean, vEMG2Pose performs better than STAMP for all 32 users in the lower-displacement group; STAMP performs better for 25/32 users in the higher-displacement group. The group-level ranking reversal between these two methods occurs in all three seeds.
Under the paper's original equal-user aggregation, the lower- and higher-displacement groups contribute +0.209° and −0.097°, respectively, to the overall STAMP-minus-vEMG2Pose difference of +0.112°. The aggregate comparison therefore combines a penalty at lower displacement with a gain at higher displacement.
3. Implication for evaluation
These results suggest that the aggregate EgoEMG tracking metric has limited sensitivity to differences in dynamic tracking performance: preserving the initial pose is already competitive, and opposing effects across motion regimes partly cancel. We will report the initial-pose baseline and motion-stratified results alongside the aggregate score to make these differences explicit.
Motion-Dependent Performance, Sensor Perturbation Tests, and Cross-User Generalization
Thank you for the suggestions. We have added three-seed evaluations and will revise the presentation as follows. Unless stated otherwise, results are mean angular errors; ± denotes the sample SD across seeds 42, 43, and 44.
1. Wider backbone and motion regimes. The wider control retains electrode-wise patches, spatial softmax attention, causal temporal attention, feed-forward layers, dual-query pooling, and the two-stage Affine Scan. It removes all three Motion MoE branches and widens the remaining encoder, giving 6.056M parameters versus STAMP's 6.059M under the same training and evaluation protocol.
On emg2pose, training-derived thresholds define low-motion, slow, fast, and transition regimes. At 50 Hz, STAMP outperforms the evaluated EMGFormer-M, NeuroPose, and single-task vEMG2Pose baselines in all four regimes across the three-seed evaluation. Fast-motion errors are 12.049° versus 13.286° for EMGFormer-M; transition errors are 13.109° versus 14.390°. These results establish full-model performance across regimes; the capacity-matched control addresses the contribution beyond model size.
2. Controlled sensor perturbations. Three-seed emg2pose tests cover circular channel shifts of ±1/±2, zeroing channel 0 or 8, and alternating gains of 0.5/1.5. STAMP has lower absolute error than the evaluated baselines under all shifts and channel-zeroing conditions. Under gain perturbation, STAMP/EMGFormer-M/vEMG2Pose obtain 17.678°/15.766°/16.831°.
On EgoEMG, we also trained STAMP and EMGFormer-M with identical channel-shift augmentation. Averaging left/right one-channel shifts over the first five seconds and 20 finger angles, errors change from 16.359°/18.163° to 15.535°/15.353°. Both improve for all 32 paired users. We will report absolute errors and degradation from clean inputs, and distinguish these synthetic perturbations from physical re-donning.
3. Cross-user results and EgoEMG. On NinaPro, STAMP improves Stage performance to 16.089° versus EMGFormer-M's 17.759°, but trails NeuroPose by 0.350° on User and 1.060° on User+Stage. Thus, the overall benefit comes mainly from unseen gestures performed by seen users.
For EgoEMG, the restored strict-v1 split with independent validation-based checkpoint selection will become the main result; released-protocol results will move to the appendix. The three-seed overall regression errors are 15.533±0.212° for STAMP and 14.991±0.271° for EMGFormer-M. STAMP performs better in User and User+Stage but worse in Stage; 26 of the 32 scored users contribute only Stage windows, giving this condition substantial weight in the user-balanced mean.
Low motion helps explain this pattern. In EgoEMG Stage, static or very-low-speed samples account for 61.3% under the matched 20-finger-angle analysis. STAMP trails EMGFormer-M by 1.105° in this group but leads by 0.678° in fast motion. Tracking shows a related effect: holding the provided initial pose already gives 9.164° overall, close to the trained models' 8.976°–9.171°. Splitting each user's windows equally by ground-truth displacement from the initial pose, STAMP/vEMG2Pose errors are 5.969°/5.543° in the lower-displacement group and 12.108°/12.300° in the higher-displacement group. The ranking reverses in all three seeds. Their contributions to the original user-balanced gap are +0.209° and −0.097°, yielding +0.112° overall. We will report these conditions separately and describe cross-dataset retraining as evidence of architectural portability.
4. Method presentation. Figure 2 will show EMG → dual-scale electrode-wise Patch MLP → STEM → dual-query pooling → two-stage Affine Scan, with both decoder attentions, all three MoE locations, temporal strides, and cached states. We will retain the core update equations in the main text and move detailed derivations to the appendix. Regression and Tracking initialization will be labeled explicitly.
Additional robustness and streaming results. Three seeds cover the main comparisons, new STEM controls, and routing sensitivity. On emg2pose, STAMP/EMGFormer-M obtain 12.762±0.228°/14.199±0.169° in Regression; STAMP/single-task vEMG2Pose obtain 9.774±0.050°/10.826±0.013° in Tracking. Original cumulative ablations and scaling curves remain single-seed; participant-subset sampling was not repeated, so scaling trends will be treated as exploratory. A unified comparison with full PI-EMG is not included in the current results.
We recommend Absolute + MOD-295, applied to the trained absolute-position model without additional fine-tuning. With the same checkpoint per task and seed, Tracking errors at 5 s/30 s are 9.810±0.048°/12.997±1.147° under native scoring and 9.838±0.046°/13.034±1.144° under past-only scoring. The original MOD-295 engine measured a steady-state P99 of 1.216 ms on an RTX 5060 Laptop; this is the existing engine measurement, not a new timing run for these checkpoints.