- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper is about representation learning in the cross-dataset scenario for sEMG based gesture recognition. There has been a lot of interest in sEMG gesture recognition over the past decade due to its applications in human computer interaction and for helping disabled people. However, while a lot of work has been done, a variety of sEMG sensors have been used. The diversity is across the number of channels, type and placement of electrodes as well as the sampling rate. Moreover, the gestures studied can also vary. Several such diverse datasets are publicly available. What this paper proposes is the utilize these public datasets by focusing on common hand gestures present in all of the datasets. Using these common gestures, a cross-dataset representation learning method has been developed. This involves pre-training using diverse datasets as indicated in Figure 1(a). This common representation then has been used to successfully recognize gestures in a target unseen dataset (after masked target adaptation and supervised fine-tuning as shown in Fig 1(b)). The experimental results show that representation transfer is indeed possible across heterogeneous sEMG datasets, using common hand gestures.
Critical strengths
(1) The idea of using the diverse existing datasets for more robust representation learning for sEMG based gesture recognition is novel.
(2) The extensive experimental results demonstrate the utility of this approach, as shown by the balanced accuracy results of Table 2. The generalization ability to unseen datasets as shown in the results is also promising.
Critical weaknesses
(1) While the idea of using diverse datasets for better representation learning for sEMG based gesture recognition is novel, the techniques employed to do so are not novel. In fact, as seen in Figure 1(a), the techniques of adapters and encoders along with losses described in equation (2) are fairly standard. Moreover, the target adaptation and supervised fine-tuning summarized in Fig 1(b) and described in Section 3.4 are also fairly standard. So there is no non-obvious methodological contribution. The application is good and its practical utility is real.
(2) It is not clear whether the proposed representation learning method helps improve the recognition rate of the non-common gestures. If this has not been stated, it must be stated. If it has been already stated, it should be made clearer.
(3) For a particular setting for a particular user, one uses a specific type of sEMG device. Just optimizing for that device type using only device specific data (with device specific data augmentation) might actually be better than improving the balanced accuracy using heterogeneous datasets. Please comment.
Questions for authors
(1) On line 51, other methods have been described that use diverse datasets. It will be useful to the reader to point out the substantive differences between those approaches and the proposed one.
(2) The reference for sEMGPoseMIM is missing on line 96.
(3) On line 107, the phrase "In contrast" has been used but it is not clear to the reader in contrast to what?
(4) Section 2.3 is not at all clear. While the second paragraph is supposed to indicate the differences, it seems very similar to the techniques described in the first paragraph. Please improve the exposition in this section.
(5) In Table 2, SAFT performs excellently for the GrabMyo 16ch dataset. It stands out oddly - it would be nice to have some explanation for it.