- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies peripheral-to-EEG translation, bringing EEG-free recordings into EEG-informed analysis.
The authors adapt the dynamic chunking technique to physiological signals. Combined with duration-aware wordization, modality-specific discrete wordbooks are learned through self-supervised reconstruction. Each word encodes a variable-duration segment of physiological signal. Building on this latent representation, the authors train a peripheral-to-EEG translator. A chunk-based autoregressive generation scheme is introduced to mitigate the temporal drift issue.
Experiments show that the proposed method outperforms PasL and the C-T baseline in EEG translation quality. The generated EEG also achieves the best results among generation-based methods on downstream tasks, such as sleep staging, arousal detection, and survival prediction. Important component designs (such as chunking mechanism) are supported by ablation studies.
Critical strengths
Adapting dynamic chunking to physiological translation is non-trivial: since different modalities segment independently, source and target chunks have no positional correspondence, so naive solutions such as a transformer decoder or U-Net over chunks is not applicable. And once autoregressive generation is used to handle the target segmentation of unknown length, temporal drift could accumulate. The indroduced block-wise AR scheme is a reasonable answer to this adaptation problem.
Critical weaknesses
In abstract, the authors motivates the work as "extending EEG-informed sleep analysis to recordings acquired without EEG." However, the downstream evaluation actually performed involves "fine-tuning" classifiers on the generated EEG spectrograms, which supports a weaker claim: "the generated spectrograms contain task-relevant information." A fine-tuned classifier can adapt to systematic distortions in the generated spectrograms. Therefore, the experiments do not varify whether tools that cannot be "fine-tuned" (such as rule-based arousal detectors or black-box neural classifiers) would still work on generated EEG. A possible solution could be, to take a model pretrained on real EEG (ideally an external, frozen one), apply it zero-shot to the generated EEG, and compare across methods. Alternatively, the authors could tone down the abstract claim to match what the experiments actually show.
Questions for authors
In the original dynamic chunking, each chunk is represented directly by the latest embedding in the chunk, whereas Sleep2Word uses average pooling over the chunk. What motivated this change, and was any comparison between the two performed?
The generated spectrograms look smoother than the ground truth in Figure 8, could this limit its usage with existing EEG tools?
4 comments
Response to Reviewer mHXy (2/2)
Scope of the claim. These results show that the generated spectrograms remain informative for classifiers trained only on real EEG, including on an unseen cohort, while a gap remains for sleep staging. We note that tools operating on raw EEG waveforms (e.g., rule-based detectors) cannot be applied directly, as Sleep2Word estimates spectrograms rather than waveforms. Following the reviewer's suggestion, we revised the abstract to state this scope precisely: “The generated spectrograms also remain informative for classifiers trained only on real EEG, including on an unseen cohort.”. We also added this as our limitation in Section 5.
[Q1] Average pooling vs. last-embedding chunk representation
We chose average pooling so that each word summarizes the whole segment it replaces. This is consistent with the rest of the pipeline: each word is scattered back to all positions of its chunk during dechunking. To verify this choice, we compared four strategies: average pooling, the first embedding, the last embedding, and attention pooling. We report respiratory-to-EEG sleep staging accuracy on SHHS1 under the linear-probing protocol (trained on SHHS1, as in Table 17 (previously Table 14)).
| Chunk representation | Acc. |
|---|---|
| Average pooling | 0.753 |
| First embedding | 0.720 |
| Last embedding | 0.735 |
| Attention pooling | 0.714 |
Average pooling performs best, outperforming the last-embedding strategy by 0.018. We added this comparison to Appendix G and Table 22.
[Q2] Smoothness of generated spectrograms
We agree with this observation. Potential contributors include: (i) fine-grained EEG details that are not identifiable from peripheral signals tend to be estimated as their conditional average under the reconstruction objective, (ii) each word is a discrete prototype shared across many segments, and (iii) the MSE objective favors smooth outputs. The zero-shot results in our response to W1 indirectly quantify the practical impact: features at the coarse spectral level, such as arousal-related shifts, transfer well to classifiers trained on real EEG, whereas sleep staging shows a measurable gap. We added this as a limitation in Section 5, noting that the generated spectrograms support utility for the evaluated spectrogram-based tasks, while fine-grained temporal fidelity remains unverified. Reducing over-smoothing, for example with band-specific reconstruction losses or generative objectives that sample from the conditional distribution, is a promising direction for future work.
We thank the reviewer again for the constructive suggestions, which have helped us state the scope of our claims more precisely.
References
[1] Quan, S. F., et al. "The association between obstructive sleep apnea and neurocognitive performance—the Apnea Positive Pressure Long-term Efficacy Study (APPLES)." Sleep 34.3 (2011): 303–314.
[2] Zhang, G.-Q., et al. "The National Sleep Research Resource: towards a sleep data commons." JAMIA 25.10 (2018): 1351–1358.
I appreciate the author’s additional experiments, which fully address my concerns; I have therefore increased the Soundness rating. I view this work as a solid engineering adaptation of existing techniques, and my final rating remains unchanged.
We sincerely thank the reviewer for the thoughtful engagement and for raising the Soundness rating. We are glad that the additional experiments fully addressed the reviewer's concerns. Thank you again for the constructive feedback, which has substantially improved the paper.
Response to Reviewer mHXy (1/2)
We thank the reviewer for the insightful comments and for recognizing the challenge of adapting dynamic chunking to cross-modal physiological translation. We address each point below.
[W1] Evaluation with frozen classifiers trained on real EEG
We agree that fine-tuned downstream heads can adapt to systematic distortions in generated spectrograms. Following the reviewer's suggestion, we evaluated generated spectrograms with classifiers trained only on real EEG spectrograms and kept frozen, without any exposure to generated data. Specifically, we used the classifiers trained on the GT spectrograms of each training split (the GT columns of Tables 2 and 3) and applied them directly to the generated spectrograms of the corresponding test split.
Sleep staging (frozen GT-trained classifier)
Arousal detection (AUROC, frozen GT-trained classifier)
For sleep staging, Sleep2Word achieves the best performance among the generation methods in all settings. Compared with classifiers fine-tuned on generated spectrograms (Table 2), accuracy decreases by 0.045–0.094, indicating that part of the stage-relevant structure in the generated spectrograms differs from real EEG and is compensated for by fine-tuning. For arousal detection, Sleep2Word's AUROC stays within 0.017 of the fine-tuned setting (Table 3) in 7 of 8 settings. Sleep2Word achieves the highest AUROC among the generation methods except on CFS-RESP, where the C-T baseline is slightly higher (0.801 vs. 0.794). We conjecture that arousal detection performance is preserved because arousals are defined by abrupt, broadband shifts in EEG frequency lasting at least 3 seconds, which are well preserved at the coarse spectral level, whereas staging relies more on subtle and transient features that are partially smoothed in generation (see also our response to Q2).
External cohort: fully zero-shot pipeline.
To evaluate the setting where neither the generator nor the downstream classifier has seen the target cohort, we additionally used APPLES [1, 2], which is not used at any training stages of Sleep2Word and the baselines. Classifiers trained on GT spectrograms of SHHS1 and MESA were applied, without any adaptation, to spectrograms generated for all APPLES recordings (1097 recordings).
Performance is lower than on the internal cohorts because the generation gap and the cohort shift compound. Nevertheless, Sleep2Word achieves the highest MF1 and kappa for both modalities; for ECG, the C-T baseline has slightly higher accuracy (0.618 vs. 0.639), but lower MF1 and kappa, which better reflect performance under class imbalance. For arousal detection, Sleep2Word from respiration reaches an AUROC of 0.756, within 0.025 of real EEG (0.781). We newly added “Evaluation with real EEG-trained classifier” paragraph under section 4.3 and added the results as Tables 5 and 6.
In our response to Reviewer 1LF2 and in Table 28 of the revised manuscript, we additionally report zero-shot age estimation results on APPLES. Sleep2Word also achieves the lowest estimation error compared to baselines for this task.