- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper introduces Mindscape-137, a new sEMG-to-text dataset, and uses it to investigate cross-session variability in sEMG recordings, aiming to identify factors that facilitate or hinder cross-session generalization.
Critical strengths
The main contribution is the dataset that the authors plan to release, which they describe as the largest open silent-speech sEMG corpus in terms of utterance count.
Critical weaknesses
In my opinion, the main limitation lies in the paper’s overall framing. On the one hand, the dataset description lacks the level of detail typically expected from a dataset release paper, particularly regarding the data collection protocol, recording characteristics, and statistics on the recordings and associated labels. On the other hand, the experimental analysis provides limited evidence for generalizable conclusions about cross-session variability and how to address it, as it considers only one dataset and one decoding model. Consequently, the findings may be strongly dependent on the specific experimental setup.
Furthermore, I find that several findings, while reasonable, offer limited novelty or actionable insights for the community. For instance, checkpoint averaging is a well-established technique, and previous work on neural recordings has already demonstrated scaling trends showing the benefits of training on larger datasets.
I also have some concerns about the manuscript’s clarity. Several passages required multiple readings to understand the proposed methods and findings. Some concepts and procedures are not sufficiently explained, including the gain and mixing transformations introduced around line 263 and the covariance alignment procedure. Additionally, Figure 1A appears to contain rendering artefacts in my PDF viewer. More importantly, it is not clear until around line 86 that Mindscape-137 is a dataset introduced by the authors themselves.
Finally, as far as I understand, no data have been made publicly available so far, even in the form of a subset. This makes it difficult to independently assess the dataset’s quality and potential utility.
Questions for authors
I would appreciate the authors’ comments on the points raised above.