- Rating
- 2(+1)
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies early CAP Phase A forecasting (predicting from a EEG window, whether a Phase A onset will occur in 10, 20, or 30 seconds) which could support closed-loop sleep interventions. The authors release NapCAP-128Ch, a new dataset of expert-annotated CAP events from 120 subjects, recorded with high-density EEG. Motivated by cross-subject physiological heterogeneity, they augment a baseline forecaster with a retrieval mechanism comprising episodic memory, multi-subspace keys learned from future annotations, and a reliability gate to regulate base predictions. Across 8 backbones and 3 horizons, the proposed retrieval-augmentation plug-in improves AUPRC over the base forecaster and outperforms RAFT and SARAF in nearly all settings.
Critical strengths
The NapCAP-128Ch dataset is valuable for future research in the domain.
Critical weaknesses
This paper investigates a novel task, making it particularly important to establish its value. However, the incremental gain of forecasting relative to existing automated CAP methods is never evaluated. And, the interface bridging the binary onset forecast to the input required by closed-loop sleep interventions is left unspecified. This undermines the paper's claimed significance.
The authors motivate retrieval augmentation by cross-subject physiological heterogeneity (a cross-subject conditional shift), however, the experimental baseline omits standard domain generalization benchmarks, such as DANN.
Questions for authors
Was the future-conditioned ranking supervision compared against an alternative learning objective (e.g., a supervised classification embedding trained on the same labels)? This is a major design choice that lacks an ablation experiment.
Have you analyzed how the gain of retrieval augmentation varies with data scale, relative to the parametric baseline itself? As the source pool grows, does the gap between base forecaster and base+C-SHARE widen or narrow? A simple test would be subsampling the source subjects and plotting both AUPRC curves.
4 comments
Additional baselines, ablations, and scaling analysis further support C-SHARE’s performance.
W2. Additional comparison with DANN.
Our original comparisons focused on retrieval-augmentation methods to assess the contribution of our proposed retrieval design. Following your suggestion, we evaluated DANN with TimesNet at the 20 s forecasting horizon under the same LOSO protocol across all 120 NapCAP-128Ch subjects.
\hline \text{Method} & \text{AUROC} & \text{AUPRC} \\\\ \hline \text{TimesNet (base)} & 64.16 & 24.85\pm14.85 \\\\ \text{TimesNet + DANN} & 63.76 & 25.21\pm15.49 \\\\ \text{TimesNet + C-SHARE (ours)} & 67.65 & 34.03\pm14.03 \\\\ \hline \end{array}$$ DANN shows no clear AUPRC improvement over the baseline ($+0.36$ points, paired bootstrap 95% CI $[-1.36, +1.83]$). C-SHARE improves AUPRC by $9.18$ points ($[+5.28, +13.32]$), indicating that subject-invariant representations alone provide limited benefit in this forecasting task. These results are included in Appendix J.1 of the revised manuscript. ### Q1. Retrieval supervision ablation. Following your suggestion, we replaced future-conditioned ranking with a supervised classification embedding trained using a linear head and binary cross-entropy on the same onset labels. All other settings remained identical. The table reports retrieval-only and full-pipeline AUPRC (%, mean $\pm$ standard deviation) for TimesNet at the 20 s horizon across all 120 NapCAP-128Ch subjects under LOSO. $$\begin{array}{lcc} \hline \text{20 s horizon, AUPRC (\\%)} & \text{Retrieval-only} & \text{Full C-SHARE} \\\\ \hline \text{Supervised classification embedding} & 22.11\pm13.36 & 29.89\pm15.47 \\\\ \text{Future-conditioned ranking (ours)} & 24.18\pm13.47 & \mathbf{34.03}\pm14.03 \\\\ \hline \end{array}$$ The 4.14-point improvement in full-pipeline AUPRC (paired Wilcoxon $p=0.040$) supports the additional value of future-conditioned ranking over classification supervision for learning retrieval keys. This ablation is included in Appendix J.2 of the revised manuscript. ### Q2. Source-data scaling and retrieval gains. Following your suggestion, we evaluated nested subsets containing 25%, 50%, and 100% of the source subjects, retraining the backbone and retrieval encoder and rebuilding the memory at each scale. We used TimesNet at the 20 s horizon across all 120 NapCAP-128Ch subjects under LOSO, excluding the test subject throughout. The table reports mean AUPRC (%) and paired subject-level bootstrap 95% confidence intervals for the gains. $$\begin{array}{lccc} \hline \text{Source subjects} & \text{TimesNet (base)} & \text{+ C-SHARE} & \Delta\text{AUPRC [95\\% CI]} \\\\ \hline \text{25\\%} & 24.06 & 25.70 & +1.64\text{ [}+0.76, +3.46\text{]} \\\\ \text{50\\%} & 27.02 & 31.01 & +3.99\text{ [}+2.53, +7.04\text{]} \\\\ \text{100\\%} & 24.85 & \mathbf{34.03} & +9.18\text{ [}+5.28, +13.32\text{]} \\\\ \hline \end{array}$$ C-SHARE improves AUPRC at every source scale, with all confidence intervals above zero. Its gain increases from 1.64 to 3.99 to 9.18 points as the source pool grows, showing that the retrieval benefit persists and increases with more source data in this setting. This motivates us to collect a larger dataset to strengthen this benefit. This analysis is included in Appendix J.4 of the revised manuscript.Thank you for the experiments and detailed responses! In particular, the comparison with DANN has addressed my concerns regarding the advantage of retrieval augmentation over conventional domain generalization approaches.
My remaining concern is primarily about the practical significance of the forecasting task, particularly its utility for real-world closed-loop sleep interventions. I will raise my final rating.
Further clarification on CAP forecasting for sleep interventions: motivation, preliminary evidence, and practical use
Thank you for recognizing the value of our additional experiments and raising your rating. To address your remaining concern, we further clarify the practical motivation already discussed in our paper and provide additional evidence and analysis.
Sleep forecasting has received growing attention in recent years. A shared motivation is to first establish whether future sleep changes can be predicted, providing a foundation for designing and evaluating interventions. For example, SSF-SET states that sleep stage forecasting “offers a proactive method from monitoring to intervention” [1]. DeepArousal-Net forecasts non-apneic arousals 30 seconds in advance and motivates this task through potential interventions and personalized sleep management [2]. Both studies focus their empirical evaluation on forecasting performance, with proactive and personalized interventions left for future work. Although our sleep-related prediction targets differ, our work follows the same procedure. We first establish whether CAP onsets can be forecast in unseen subjects, providing a basis for future closed-loop sleep interventions.
Specifically, reducing abnormally elevated CAP rates is a potential intervention target for improving sleep stability and quality. As described in the Introduction (lines 39 to 41), CAP rate is an established marker of NREM sleep instability and fragmentation. A large population study linked higher CAP rates to poorer subjective sleep quality [3]. A treatment study also found that reductions in CAP rate accompanied improvements in subjective sleep quality among patients with insomnia [4]. During the collection of NapCAP-128Ch, we conducted an additional sleep experiment with audio stimulation involving 20 participants from the 120-participant cohort. Using a specific fixed-frequency natural sound, we compared conditions with and without audio stimulation in the same participants. Mean CAP rate was 34.32% without audio stimulation and 30.98% with stimulation, a reduction of 3.34 percentage points. This preliminary observation supports the potential to modulate CAP through audio stimulation.
Intervention timing is a key link between forecasting and practical use. As described in the Introduction (lines 45 to 48), CAP forecasting offers an advance window for closed-loop auditory interventions. For example, appropriately timed auditory stimulation can enhance sleep slow oscillations [5], as already cited in line 48. We therefore propose using CAP onset predictions to decide when to deliver audio stimulation or adjust its parameters. One potential use is to intervene before arousal-related Phase A events to help reduce the risk of progression toward wakefulness and sleep disruption.
Overall, this work demonstrates the feasibility of forecasting CAP onsets. These forecast probabilities could serve as risk inputs to a closed-loop intervention controller. Thresholding and post-processing could determine when to trigger stimulation. However, developing and evaluating a complete forecast-guided intervention system requires a broader set of experiments. As acknowledged in Section 5 (lines 467 to 470), further studies need to evaluate safety, false-alarm tolerance, intervention timing, and effects on sleep stability and clinical outcomes. This also requires examining stimulation strategies and individual responses. Our next step is to combine forecasting with audio interventions and assess whether the complete system can further reduce abnormally elevated CAP rates and improve sleep stability and quality.
We hope this explanation addresses your remaining concern.
References:
[1] Kweon Y S, Shin G H, Lee D H, et al. SSF-SET: A Discrete EEG Token-based Framework for Sleep Stage Forecasting[J]. IEEE Journal of Biomedical and Health Informatics, 2026.
[2] Jamarani Z Y, Baker F C, de Zambotti M, et al. Deeparousal-net: A multi-block recurrent deep learning model for proactive forecasting of non-apneic arousals from multichannel psg[J]. IEEE Transactions on Biomedical Engineering, 2025, 73(3): 1003-1014.
[3] Hartmann S, Bruni O, Ferri R, et al. Characterization of cyclic alternating pattern during sleep in older men and women using large population studies[J]. Sleep, 2020, 43(7): zsaa016.
[4] Giovanni Terzano M, Parrino L. Evaluation of EEG cyclic alternating pattern during sleep in insomniacs and controls under placebo and acute treatment with zolpidem[J]. Sleep, 1992, 15(1): 64-70.
[5] Besedovsky L, Ngo H V V, Dimitrov S, et al. Auditory closed-loop stimulation of EEG slow oscillations strengthens sleep and signs of its immune-supportive function[J]. Nature communications, 2017, 8(1): 1984.
Early CAP forecasting offers the opportunity to act before onset
Thank you sincerely for your constructive feedback. We appreciate your recognition of the value of our collected NapCAP-128Ch, the largest CAP-annotated EEG dataset by number of subjects, for future research in the domain. In response to your concerns, we explain how the well-established value of forecasting over detection, namely the opportunity to act before onset, motivates our CAP forecasting task and its potential use in closed-loop interventions. Following your suggestions, we added a DANN comparison, retrieval-supervision ablations, and source-data scaling analysis. We sincerely appreciate these suggestions, as the additional experiments and statistical analyses further support C-SHARE's forecasting performance. We have incorporated these results into the revised manuscript.
W1. The incremental value of forecasting beyond existing automated CAP methods, all of which address detection.
To our knowledge, all existing automated CAP methods address detection, identifying Phase A events from EEG in which event-related activity is already present. Our work is the first to forecast CAP Phase A onsets from preceding EEG. The incremental gain of forecasting compared with detection is the opportunity to act before onset. Advance information can support corrective action before a disturbance affects a system [1] (Section 1.4, p. 22). Our task uses preceding EEG to predict future onsets, following the definition of forecasting [2] (2nd ed., Section 1.1). As motivated in the Introduction, this advance warning provides a potential intervention window for improving sleep stability (lines 47 to 48). Section 3.1 defines the task following established EEG event-forecasting formulations. Eq. 1 specifies whether a Phase A onset occurs within a given future interval (lines 159 to 160 and 186 to 190). We also evaluated existing automated CAP methods as comparison baselines by adapting GTransU and MuRAT to the same forecasting inputs and targets.
Our results provide empirical evidence that upcoming Phase A onsets are predictable from preceding EEG in unseen subjects. These forecast probabilities could serve as risk inputs to a closed-loop intervention controller, with thresholding and temporal post-processing determining when to trigger stimulation and suppress repeated triggers. As acknowledged in Section 5, translating these findings into a reliable closed-loop system requires further systematic design of intervention timing, repeated-trigger handling, and false-alarm tolerance.
[1] Åström K J, Murray R M. Feedback systems: an introduction for scientists and engineers[J]. 2008.
[2] Montgomery D C, Jennings C L, Kulahci M. Introduction to time series analysis and forecasting[M]. John Wiley & Sons, 2015.