- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes NHN, a compact architecture for sEMG decoding inspired by neuromotor organization. It combines adaptation of recording statistics with preserved intensity cues, structured feature mixing, history-dependent feature modulation, and temporal integration and graded allocation of nonnegative candidate drives. The architecture is evaluated on emg2pose for hand-pose estimation and on emg2qwerty for typing recognition, with separately trained models for each task. NHN’s main results are averaged over five training seeds and show improved accuracy over several established baselines with fewer parameters. The paper also presents component ablations on emg2pose and analyses of the learned representations in support of the design.
Critical strengths
- NHN improves accuracy on two quite different tasks while using substantially fewer parameters than the main convolutional baselines. On emg2qwerty, zero-shot beam-search CER on the test split drops from 35.67% for SplashNet-Upscale to 28.75%, and fine-tuned beam-search CER drops from 5.51% for its shared variant to 3.83%, with 0.88 million parameters instead of 2.58 million. On emg2pose, NHN has the lowest reported AE and LD among the compared models across all three splits for both Regression and Tracking, with roughly half the parameters of vemg2pose and the Hadidi et al. variants. NHN’s results are consistent across five training seeds. Although the distilled Transformers achieve lower greedy CER on typing, the balance between accuracy and model size is a substantive strength of NHN.
- The main design choices are backed by controlled ablations. On emg2pose official-small, replacing structured mixing with conventional TDS mixing raises Tracking AE by 1.11° even though it adds parameters, and removing adaptive gain or FIR integration raises it by 0.82° and 0.79°, respectively. Disabling waveform conditioning and removing the relative-intensity channels increase AE by 0.61° and 0.69°, respectively. Each of these changes increases AE in all three seeds. In the Regression backbone comparisons, NHN also outperforms TDS in every seed at both matched LSTM hidden widths. These comparisons give me reasonable confidence that the proposed operations contribute to pose accuracy.
Critical weaknesses
- The full-data comparison with the strongest pose baselines leaves some uncertainty about the source of the improvement. NHN uses a 300-epoch schedule with time warping and amplitude scaling, while the results for Pos-ST and Vel-MT are taken from prior work. The authors' ablations show that training choices affect performance on official-small, but no full-data comparison with matched training conditions is reported. This matters because NHN's Tracking AE advantage over Pos-ST is 0.05° to 0.09° across the three splits. The controlled backbone comparisons on official-small are helpful, but do not fully resolve this uncertainty. I therefore place more weight on the parameter reduction than on the small accuracy advantage.
- The component ablations provide useful evidence on emg2pose, but no retrained component ablations are reported for typing. The allocation intervention shows that the trained typing decoder relies on the learned allocation pattern, but does not establish how a model trained without that operation would perform. The overall typing gains are convincing, while the contributions of the individual components to those gains remain less clear.
Questions for authors
- Could you clarify the main differences in training budget and augmentation between NHN and the strongest pose baselines? If any full-data comparisons under matched conditions are already available, they would help interpret the small accuracy differences in Table 1.
- Are any retrained typing ablations already available for temporal integration or graded allocation? The fixed-model allocation intervention is useful, but does not show how a model trained without graded allocation would perform.
4 comments
Response to pgEr Part 2 of 2
W2 and Q2. Retrained Typing integration and allocation ablations
Yes. We added six Typing controls trained from scratch with three seeds each (new Appendix E.12, Table 21). The complete table below includes removal of finite impulse response (FIR) integration, removal of allocation, and four additional controls. All follow Full NHN's protocol apart from the specified intervention. Entries are mean character error rate (CER, %) across three seeds. TDV and TDT denote test-domain Validation and Test, evaluated over complete sessions.
| Configuration | TDV greedy | TDV beam | TDT greedy | TDT beam |
|---|---|---|---|---|
| No measurement adaptation | 42.94 | 33.75 | 42.65 | 33.31 |
| Conventional TDS encoder | 41.14 | 31.63 | 40.86 | 31.73 |
| Linear bottleneck | 39.23 | 29.35 | 39.23 | 29.30 |
| Independent gating | 39.66 | 30.27 | 39.36 | 29.89 |
| FIR identity | 39.83 | 30.40 | 39.34 | 29.70 |
| No allocation | 39.03 | 29.68 | 38.77 | 29.17 |
| Full NHN | 38.95 | 29.24 | 38.70 | 28.80 |
Full has the lowest mean CER in all four columns. Following Meta's participant-level approach, we use Wilcoxon signed-rank tests after averaging matched seeds within each participant. Both FIR and allocation removals increase TDT beam CER at p < 0.05. All six TDT beam comparisons favor Full at this threshold. Table 21 also reports standard deviations across seeds and individual statistical annotations.
These retrained controls test whether each component helps decoding. NHN draws inspiration from physiological organization rather than simulating its biological mechanisms. The new Appendix A and Figures 4 to 6 test that link. Temporal integration retains sustained activity, while priorities concentrate weak drives and broaden participation for stronger input (A.2, Figure 4e/f). Figures 5 and 6 show repeatable movement relationships and association with classical coordination activity (A.3/A.4).
Manuscript location: Appendix E.12, Table 21 gives the three-seed results and participant-level tests. Appendix A, Figures 4 to 6 (pp. 21, 23, 24), provides the complementary physiological organization analyses.
Thank you for the clarifications and the extra experiments. That addresses my concerns.
Thank you for your thoughtful feedback. Your questions helped us strengthen the paper, and we’re glad the clarifications and additional experiments addressed your concerns
Response to pgEr Part 1 of 2
Thank you for your careful review and constructive feedback. We appreciate your recognition of the accuracy and parameter efficiency across both tasks and the existing Pose controls. We added full-data training comparisons and retrained Typing ablations to address both remaining concerns.
W1 and Q1. Training differences and controlled full-data comparisons
We agree that parameter efficiency is the clearest advantage in the original Pose comparison, where the accuracy gains are small (Table 1). Typing also shows a clearer CER advantage with fewer parameters (Table 2). To address the training concern, we added ten full-data runs in Appendix E.10 (Tables 18 and 19): five for Pos-ST Tracking and five for Vel-MT Regression. They use Meta's emg2pose implementation and retain each baseline's task formulation.
Table 18 lists the changes: 300 rather than 150 epochs, time warping from 0.85 to 1.18, channelwise amplitude scaling from 0.80 to 1.20, and a 256-wide prediction head. It also aligns the window, AdamW schedule, batch size, weight decay, and clipping. Amplitude scaling is applied once at the baseline input. The two heads have 0.882M and 0.887M parameters, close to NHN's 0.886M. The following results are from Appendix E.10, Table 19 and report means over five runs. Each entry is angular error (AE) in degrees / landmark distance (LD) in millimeters. Lower is better.
NHN retains lower mean errors in every condition after these changes. The participant-level comparisons in Appendix E.1.1, Table 4 have p < 0.01. These results provide additional support for the comparison after aligning the major training differences and closely matching head capacity.
Complementary NHN adaptation. We also added Appendix E.11, Table 20, adapting Hadidi's training ideas to NHN. The table below gives user-weighted AE/LD, with NHN's main setting from Appendix E.9, Table 17. NHN values are means over five runs.
NHN's errors change only slightly and remain below the best published task-specific baselines. E.10 therefore tests fairness under matched baseline training, while E.11 tests NHN's sensitivity to the reverse adaptation.
Broader performance and efficiency. We also added Appendix E.13 and Table 22 with seven gesture datasets, each using a separately trained NHN model. The table gives NHN accuracy and macro area under the receiver operating characteristic curve (AUROC), both in percent.
Table 22 shows higher accuracy than the best published baseline on five of seven datasets, with gaps of at most 0.84 percentage points on the other two. Macro AUROC exceeds the published best on two datasets. NHN averages 0.77M parameters and 0.066 network GFLOPs per 250 ms window.
Manuscript locations: Appendices E.10/Tables 18 and 19, E.11/Table 20, E.1.1/Table 4, and E.13/Table 22.