- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This study investigates a dataset collected from patients with epilepsy, comprising neural recordings during movie watching, memory recall, and sleep, corresponding to densely labeled, sparsely labeled, and unlabeled data, respectively. The authors combine unsupervised domain adaptation with knowledge distillation to transfer a model trained on movie-watching data to the sleep state, while leveraging recall data to preserve concept-related representational structure. Furthermore, the authors identify concept-selective neurons and propose a temporal alignment-based evaluation framework to assess model performance during sleep. Experimental results suggest that the proposed framework can successfully detect concept-related neural reactivation during sleep.
Critical strengths
1.A highly valuable dataset and an important research objective. The study leverages a rare and valuable neural recording dataset to address a highly significant research question. This work represents a major step toward decoding human dream content. 2.A well-matched algorithmic design. Unsupervised domain adaptation has traditionally been less suitable for conventional neural decoding tasks. However, it is particularly well suited to the authors' cross-state transfer setting. Although the methods employed are well established, their application is highly appropriate given the unique characteristics of the dataset. 3.A highly valuable evaluation framework. The use of held-out concept-selective neurons partially addresses the fundamental challenge of evaluating neural decoding during sleep, where ground-truth labels are unavailable. This evaluation strategy provides important insights and inspiration for future research in this field.
Critical weaknesses
1.A somewhat lengthy and unfocused introduction. The introduction covers a broad range of research areas and is slightly longer than necessary. 2.A less compelling title. The current title is not particularly engaging, especially since the term "brain states" is somewhat vague. Explicitly emphasizing the transfer from wakefulness to sleep would better communicate the significance and novelty of the study. 3.Potential information leakage in the evaluation framework. I have some concerns about whether using held-out concept-selective neurons as evaluation references could introduce information leakage. Although the corresponding recording wires are excluded from the model inputs, the activity of these neurons may still be highly correlated with signals recorded from other electrodes.
Questions for authors
My questions are the same as the concerns raised in the Weaknesses section
3 comments
Response to Weakness 2: title clarity
Thank you for this thoughtful suggestion. We agree that explicitly naming the wakefulness-to-sleep transition makes the study’s focus clearer. We have revised the title to “Transferring Concept-Aligned Neuronal Representations from Wakefulness to Sleep,” as shown on the title page of the accompanying revised manuscript.
Response to Weakness 3: correlations and reference-wire exclusion
Thank you for raising this important concern. Concept-related correlations within the neuronal population are part of the signal our framework is intended to learn. Excluding the reference neuron’s entire recording wire throughout training, adaptation and evaluation prevents the model from directly using that wire’s signal and requires predictions to be derived from the remaining population. We agree that this does not eliminate correlations with retained electrodes. The question is whether those correlations support concept-related representations or allow nonspecific shared activity to account for the observed alignment.
To address this, we performed an additional exclusion sensitivity analysis based on correlations measured during movie viewing. We set the threshold at the 90th percentile of the pooled absolute same-bundle correlations (|r| > 0.1198). In addition to the reference wire, all same-bundle wires exceeding this threshold were excluded throughout training, adaptation and evaluation, without a limit on their number. We trained and evaluated both the movie-only baseline and RASA under this rule using the original BECA evaluator.
RASA’s performance remained broadly stable after exclusion: across the same 62 reference neurons, pooled median specificity changed from 82.48 to 83.43, and temporal alignment from 1.165 to 1.164. These results support the conclusion that the observed alignment is not primarily dependent on the highly correlated same-bundle inputs removed in this control (Appendix B.6, Table 10).
This result complements Table 7, which shows a pooled alignment advantage for correctly matched concept outputs over mismatched outputs. We also found that the pooled matched-concept advantage persisted after excluding events centered at high regional population activity (Appendix B.4, Table 8). Together, these controls support concept-related population correspondence and address the concern that alignment is driven simply by highly correlated local inputs or nonspecific shared activity.
Response to Weakness 1: focus and length of the Introduction
Thank you for this helpful suggestion. We have shortened and refocused the Introduction around the central challenge of transferring concept-related neuronal representations from movie viewing to sleep, where behavioral labels are unavailable. We have condensed the broader background discussion and integrated the supporting rodent-replay and human fMRI background into Appendix A, while preserving the central motivation and contributions. Please see Section 1 (Introduction) and Appendix A (Related Work) in the accompanying revised manuscript.