- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces NormWear-2 for physiological time-series forecasting conditioned on intervention variables. It combines a pretrained encoder-decoder pathway, termed “intuition,” with inference-time clustering and empirical latent-state transitions, termed “insight.” The authors also investigate chaos-aware balancing of pretraining data. Evaluation covers five physiological datasets using time-domain, frequency-domain, and latent-space metrics, supplemented by data-selection and backbone ablations, downstream representation tests, and an exploratory offline planning experiment.
Critical strengths
-
A practical combination of pretrained representations and context-specific dynamics. The insight module constructs non-parametric latent transitions from observed context without updating the pretrained network. This provides a concrete mechanism for incorporating subject-specific history rather than relying entirely on fixed pretrained predictions. The evaluation across five physiological datasets with different temporal resolutions and intervention variables makes this design relevant beyond a single application setting.
-
Supporting evidence for improved structural generation quality. The full model achieves lower frequency-domain and latent-domain FID than the evaluated alternatives in Table 12. The transition perturbations in Table 13 also degrade aggregate performance across all five datasets. These results provide useful evidence that the transition mechanism contributes to generation quality, beyond the headline composite score alone.
Critical weaknesses
-
The practical meaning of the overall performance advantage is insufficiently established. In Table 2, NormWear-2 has higher MAE than the Naive baseline on all five datasets, despite its favorable composite scores. Structural and distributional improvements are valuable, but the paper does not establish why they compensate for this loss of time-aligned accuracy. Sensitivity to the metric weights and latent-space evaluator, together with an application-relevant endpoint such as event timing, would help determine whether the reported overall advantage reflects practically better forecasts.
-
Observed-action prediction is not sufficient counterfactual validation. Section 4.3 is titled “Counterfactual Validation,” but its described evidence concerns prediction accuracy under observed clinical actions. Accuracy across logged action levels does not establish the consequences of alternative interventions from the same patient history. This distinction matters because the paper explicitly notes that clinicians adjust actions in response to patient condition. The authors should clarify the assumptions and evidence supporting an intervention interpretation, or restrict the conclusions to observational action-conditioned forecasting.
-
The benefits of chaos-aware balancing are task-dependent. In the fixed-budget, same-source ablation in Table 11, random sampling outperforms balancing on both short forecasting (MAE 0.558 versus 0.597) and long forecasting (0.696 versus 0.729). Balancing improves simulation and pooled results, but this does not establish a general forecasting advantage. Although acknowledged in Appendix D.2, this distinction should be more prominent in the main conclusions, with clearer evidence connecting the balancing strategy to the physiological forecasting improvements.
Questions for authors
See the weaknesses .Clarifying these issues and providing targeted supporting analyses maybe could improve my assessment.
2 comments
Response to Reviewer ajhZ [2/2]
Concern 2. Observational action-conditioned forecasting
"Observed-action prediction is not sufficient counterfactual validation. Section 4.3 is titled “Counterfactual Validation,” but its described evidence concerns prediction accuracy under observed clinical actions. Accuracy across logged action levels does not establish the consequences of alternative interventions from the same patient history. This distinction matters because the paper explicitly notes that clinicians adjust actions in response to patient conditions. The authors should clarify the assumptions and evidence supporting an intervention interpretation, or restrict the conclusions to observational action-conditioned forecasting."
Response
We agree with the reviewer on the more proper interpretation of the presented results. Section 4.3 evaluates predictions conditioned on recorded interventions. Its error maps summarize accuracy across observed combinations of prior physiological state and action. Because clinicians adjust treatments in response to patient condition, these comparisons describe observational action-conditioned forecasting; patient-specific effects of alternative treatments require separate causal assumptions and validation. Action-Conditioned Prediction Validation would a title that more precisely describe this analysis, and we have updated it as the title for Section 4.3.
Concern 3. Task-dependent benefits of pretraining-data balancing
"The benefits of chaos-aware balancing are task-dependent. In the fixed-budget, same-source ablation in Table 11, random sampling outperforms balancing on both short forecasting (MAE 0.558 versus 0.597) and long forecasting (0.696 versus 0.729). Balancing improves simulation and pooled results, but this does not establish a general forecasting advantage. Although acknowledged in Appendix D.2, this distinction should be more prominent in the main conclusions, with clearer evidence connecting the balancing strategy to the physiological forecasting improvements."
Response
Thank you for highlighting this trade-off. In the fixed-budget, same alternation comparison (Table 11), balancing yields modestly higher forecasting error than random sampling, alongside substantially lower simulation error and better pooled performance. We selected balanced pretraining for its stronger performance on simulation, which predicts unobserved channels conditioned on supplied channels. This setting is particularly relevant to our interest in subsequent action-conditioned physiological modeling. We have made this trade-off and the motivation for selecting balanced pretraining explicit in Section 4.1 (Preliminary Exploration on Chaos-Balance-Aware Pretraining), with a reference to Table 11. We have also added the physiological forecasting comparison with standard deviations to Section 4.1 (Table 3).
To better connect this pretraining study to physiological forecasting, we evaluated the concatenation and random-sampling pretraining checkpoints on all the physiological datasets leveraged in this study. Final performance scores are presented below.
Response Table 4: Physiological forecasting by pretraining strategy
| Pretraining | VitalDB | PMData | CGMacros | Shanghai | KidneyDialysis | Average |
|---|---|---|---|---|---|---|
| Concatenation | 0.556 | 0.609 | 0.658 | 0.573 | 0.558 | 0.591 |
| Random sampling | 0.520 | 0.530 | 0.559 | 0.575 | 0.556 | 0.548 |
| Balanced (Table 2) | 0.457 | 0.466 | 0.474 | 0.578 | 0.575 | 0.510 |
Across the five datasets, the balanced model achieves the lowest average score, with clear gains on VitalDB, PMData, and CGMacros and comparable scores on Shanghai and KidneyDialysis. We’d like to thank the reviewer again for pointing this out, as having this clearer observation as part of the conclusion for the pretraining experimental stage provides a better bridge toward the successive experiments.
In Closing
We sincerely thank the reviewer once again for the thoughtful and constructive feedback. If there are aspects where our work could be further improved, we would greatly appreciate any additional suggestions you might have.
Reference
[1] Garland et al., Mindfulness-induced endogenous theta stimulation occasions self-transcendence and inhibits addictive behavior, Science Advances, 2022.
[2] Garland et al., Mindfulness-oriented recovery enhancement reduces opioid dose in primary care by strengthening autonomic regulation during meditation, American Psychologist, 2020.
[3] Luo et al., Personalized entropy-informed deep learning for identifying opioid misuse, Nature Mental Health, 2026.
Response to Reviewer ajhZ [1/2]
Concern 1. Evaluation robustness
Response
We’d like to thank the reviewer for recognizing the value of our evaluation scheme and for suggesting these additional checks. Before moving on to the additional experimental results as suggested by the reviewer, we’d like to first make a clarification on the performance scoring. The final score, which is the Equation 3 in the paper, normalizes metrics by the evaluated sequence and representation sizes. They are not tuned scaling factors or weights. Soft-DTW is normalized by its evaluated sequence length, frequency-domain Euclidean distance by half the prediction length, and latent Euclidean distance by the embedding dimension. The final score is the arithmetic mean of these six normalized losses. Thus, there are no manually tuned scaling and weighting for the final score.
We have clarified the normalization factors and equal averaging in Section 3.6 alongside Equation 3.Following the reviewer’s suggestion, we examined sensitivity to the evaluation encoder by replacing the encoder used for the two latent metrics with frozen Chronos-2, scoring the same predictions with unchanged normalization. The table below present final scores, with bold and italics mark the best and second-best. We observe that NormWear-2 still achieves leading overall performance under this alternative latent evaluator.
Response Table 1: Final scores with the Chronos-2 evaluator
The table below shows the average normalized latent score following same normalization of the terms in Equation 3.
Response Table 2: Average normalized latent scores
We also examined whether this advantage persists after completely removing both latent metrics and averaging the four remaining performance scores. The table below shows the resulting average scores recalculated from Table 2 in the original manuscript. We observe that NormWear-2 is being competitive on VitalDB, but maintain the leading overall performance.
Response Table 3: Final scores without latent metrics
The advantage largely persists when changing the evaluation encoder or removing latent metrics, suggesting that the metrics capture complementary aspects of forecast quality. MAE measures pointwise error but does not establish preservation of fluctuations across long continuous recordings. Such temporal structure can carry meaningful physiological information, such as spectral power and coherence [1], beat-to-beat variability [2], and temporal complexity of wearable-derived affective trajectories [3] as the supporting literature. We are encouraged that we share agreement with reviewer that the considering complementary metrics are valuable, and that the suggested additional analysis strengthen the observation.
We have made this rationale explicit in Section 3.6, clarified the interpretation of the observed metric trade-off in Section 4.2, and added the evaluator comparisons to Appendix D.10 (Tables 20–21).