- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper addresses forecasting across heterogeneous entities, such as weather stations and ICU patients, where models must share statistical strength while preserving entity-specific dynamics and generalize to unseen entities without retraining. The authors argue that existing neural approaches share information through deterministic parameters, embeddings, or cluster vectors, lacking explicit distributional partial pooling. The paper proposes a method called CLASP, a plug-in module that aligns history-dependent Gaussian latent distributions with shared Gaussian prototype priors via a weighted KL penalty, using provided labels or a learned router. They also derive the exact KL between these training and deployment laws, a data-processing bound, and an equivalence with the pooling penalty under one-hot assignments. The authors have conducted experiments on held-out WEATHER-5K stations and eICU patients, which show error reductions over strong baselines and consistent gains across forecasting backbones.
Critical strengths
-
This paper is addressing a practically important problem: most real forecasting involves many related time-series, how to share information across such populations without training a individual model each time is a central question.
-
The paper shows that a distributional prior over groups along with a KL alignment penalty can be added to very different forecasters including recurrent, convolutional, state-space, transformer, diffusion and flow models. This can pave the way for adapt the method to widely used time-series foundation models.
-
The proposed framework works with many backbones, scales to many entities; the pipeline produces full predictive distributions and the prototypes expose population structure can be easily examined.
Critical weaknesses
-
In empirical evaluation, transferring to a new population is never tested. For example, in weather-5k dataset, test stations come from the same 5 zones and same 125 station balanced subset; in eICU, the split is by patient only, with no hospital-level holdout reported.
-
The objective of the method is similar to the regularizer of a Gaussian-mixture VAE, several closely related works are uncited or not compared against: VaDE: https://www.ijcai.org/proceedings/2017/273 GMVAE: https://arxiv.org/abs/1611.02648 CVAEs: https://papers.nips.cc/paper_files/paper/2015/hash/8d55a249e6baa5c06772297520da2051-Abstract.html
-
It seems that the theory (88 pages in total is too long) adds very little actionable content. The results are standard, e.g. the Gaussian KL is a textbook formula, theorem 1 is data processing inequality. And its assumptions don't hold for time series, where it assumes windows within an entity are iid.
Questions for authors
How does the method perform for entities with long histories and varying length?
4 comments
W2. Relationship to Gaussian-mixture VAEs and forecasting baselines
W2. Relationship to Gaussian-mixture VAEs and forecasting baselines
We thank the reviewer for highlighting these related works. We agree that Gaussian priors and KL-based latent alignment are established components of variational models, including VaDE, GMVAE, and CVAE. CLASP’s contribution lies in its entity-level pooling construction using shared Gaussian prototypes and its analysis of the associated training–deployment discrepancy. Specifically, CLASP pools independent Gaussian component draws, which differs from sampling a latent representation from a selected mixture component. This construction enables CLASP to serve as an adaptive module that augments existing deterministic and probabilistic forecasters while retaining the host forecasting model.
To address the request for additional comparisons, we added CVAE as a forecasting baseline following this reviewer’s suggestion and evaluated it both with and without CLASP. VaDE and GMVAE are closely related generative clustering methods, but their original formulations do not specify a history-to-future forecasting model. Evaluating them here would therefore require constructing forecasting extensions with additional architectural choices; we have not included such extensions in the present comparisons.
Across D3VAE, TSDiff, NsDiff, Timer-XL, TSFlow, CVAE, and CAMul, the CLASP-augmented models achieve lower MAE than their corresponding hosts at every evaluated WEATHER-5K horizon (Table 24, Appendix E.3.2). For CVAE specifically, 24-hour MAE decreases from 2.279 to 1.621, a 28.9% reduction. These results support CLASP’s usefulness across forecasting architectures, including a conditional variational model.
We also added CAMul and CCM following reviewer oEHV’s suggestions. Table R4 summarizes the comparisons reported in main-text Tables 1–2 as MAE / MSE, with the best values in bold. In these experiments, CLASP uses the five provided WEATHER-5K zones and four inferred eICU groups.
Table R4.
WEATHER-5K
| Model | 24 hours | 72 hours | 168 hours |
|---|---|---|---|
| CVAE | 2.279 / 14.898 | 2.928 / 22.076 | 3.338 / 27.660 |
| CAMul | 1.595 / 8.019 | 2.049 / 15.245 | 2.561 / 20.099 |
| CCM | 1.568 / 5.827 | 2.326 / 16.766 | 2.664 / 23.866 |
| CLASP | 1.291 / 5.111 | 1.902 / 11.848 | 2.290 / 17.193 |
eICU
| Model | 6 hours | 12 hours | 24 hours |
|---|---|---|---|
| CVAE | 9.905 / 188.459 | 12.572 / 282.981 | 10.090 / 220.934 |
| CAMul | 6.984 / 103.129 | 7.549 / 116.607 | 8.102 / 133.299 |
| CCM | 8.946 / 117.501 | 9.062 / 133.847 | 9.179 / 153.472 |
| CLASP | 5.801 / 91.291 | 6.350 / 104.696 | 6.936 / 120.552 |
Presentation revisions.
Clarified modularity and related work in Section 2 and Appendix F.1; added CVAE, CAMul, and CCM comparisons in Tables 1–2 and Appendix C.1; documented integrations in Appendix C.2 and their results in Table 24, Appendix E.3.2, complementing the backbone evaluation in Section 4.3.
W3. Theory scope and practical relevance
W3. Theory scope and practical relevance
Theorem 1 does not assume independent time-series windows. Instead, it holds for any fixed observed context and requires independence only across latent component draws. We agree that Gaussian KL and data processing are standard tools; we use them specifically to characterize what CLASP’s pooling objective controls. Under one-hot assignments, the uncapped pooling penalty matches the aggregate training–deployment KL exactly; under soft assignments, however, neither quantity bounds the other in general, motivating us to measure aggregate KL directly rather than using the pooling penalty as a proxy bound.
We appreciate the concern that the overall length of the manuscript can make navigation challenging. This length primarily reflects our effort to document all experimental details needed to reproduce and assess our results across several forecasting backbones and baselines. Specifically, Appendices B–D detail how CLASP is integrated into each model alongside training configurations, sampling procedures, preprocessing, and evaluation protocols, while Appendix E reports comprehensive results and ablations across settings. Meanwhile, the core theoretical presentation is self-contained in Section 3.4, supported by complete proofs and regularity conditions in Appendix A, and the submission already includes an appendix table of contents and section roadmaps to guide readers.
Q1. Long histories and variable-length entities
Q1. Long histories and variable-length entities
eICU already includes patient records of varying lengths, with an overall range of 25–28,117 hourly steps. We added detailed length statistics to Table 15 in Appendix D.3.2.
Table R5 reports MAE / MSE on WEATHER-5K with 48-hour and 168-hour inputs at a fixed 168-hour forecast horizon. CLASP continues to improve the flow-matching backbone with longer inputs. Flow + CLASP uses five provided zones and the validation-fitted readout.
Table R5.
| Input history | Plain Flow | Flow + CLASP |
|---|---|---|
| 48 hours, default | 2.710 / 21.035 | 2.290 / 17.193 |
| 168 hours | 2.513 / 19.148 | 1.902 / 11.848 |
Presentation revisions.
Added eICU length statistics in Table 15, Appendix D.3.2, with the fixed-input protocol clarified in Appendix D.3.1.
W1. Transfer to new populations
We thank the reviewer for the comments on population transfer and connections to variational models. All manuscript references follow the revised paper numbering.
W1. Transfer to new populations
We agree that the original headline splits alone do not establish cross-zone or cross-hospital transfer. While the original submission already included an imbalanced WEATHER-5K setting, with cluster-wise CLASP results under balanced and imbalanced training configurations across all five zones and three forecast horizons in Appendix E.3.6. To directly test transfer to new populations, we added leave-one-zone-out WEATHER-5K evaluation and a hospital-disjoint eICU evaluation.
WEATHER-5K: transfer to an unseen geographic zone.
We use a five-fold leave-one-zone-out protocol at 24 hours, excluding one zone from task-specific training and evaluating on that zone in each fold. Models are trained or fine-tuned using stations from the other four zones; Timer-XL ZS is evaluated without task-specific training. Table R1 reports MAE / MSE for each held-out zone, with the best values in bold; ZS/FT denotes zero-shot/fine-tuned evaluation.
Table R1.
CLASP achieves the lowest MAE in all five zones and the lowest MSE in four; TSFlow has lower Tropical MSE, at 2.340 versus 2.431 for CLASP. In the Polar zone, CLASP reduces MAE/MSE by 14.3%/20.4% relative to the strongest baseline, NsDiff. These results support cross-zone transfer under the evaluated 24-hour forecasting protocol.
eICU: transfer to held-out hospitals.
Since there are patients recorded at more than one hospital, we remove those patients before splitting the remaining hospitals into mutually disjoint training, validation, and test sets. Each retained patient is assigned to their hospital’s split, so both hospital and patient identities are disjoint across splits. Table R2 reports the resulting split, comprising 208 hospitals and 91,262 unique patients.
Table R2.
Table R3 reports MAE / MSE on patients from the 18 held-out test hospitals, with the best values in bold.
Table R3.
CLASP achieves the lowest MAE at all three horizons and the lowest MSE at 6 and 12 hours. Relative to CAMul, the strongest listed baseline for every horizon and metric, CLASP reduces MAE by 7.1%/6.1%/4.5% at 6/12/24 hours. At 24 hours, CAMul has slightly lower MSE, at 121.853 versus 122.051 for CLASP. These results support transfer to held-out hospitals under the reported split.
Presentation revisions.
Added cross-zone and cross-hospital evaluations in Section 4.1, with protocols and results in Appendices E.3.7 and E.3.9, respectively, and updated the transfer discussion in Appendix F.2. The original imbalanced WEATHER-5K evaluation remains in Appendix E.3.6.