- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes HEPA, a self-supervised framework for event prediction in multivariate time series. The framework employs a causal Transformer encoder with JEPA-based pretraining to predict future representations, followed by predictor finetuning on a frozen encoder to generate event probabilities through a discrete-time survival CDF. Experiments across 14 benchmarks from 11 domains compare HEPA with various time-series models, including ablation studies and label-efficiency evaluations. The results demonstrate competitive event prediction performance, particularly on lifecycle datasets with limited labeled data. However, the necessity of predictor finetuning remains unclear, while the theoretical assumptions and experimental evidence supporting the claimed benefits require further justification and validation.
Critical strengths
The paper addresses event prediction in multivariate time series under limited labeled data, which is a practically relevant problem. It presents a unified framework for event prediction across different domains by combining JEPA-based self-supervised representation learning, horizon-conditioned predictor finetuning, and discrete-time survival modeling. The experiments cover 14 benchmarks across 11 domains, with comparisons against various baselines, ablation studies, and statistical significance analyses. The results demonstrate competitive performance and promising label efficiency on certain lifecycle datasets, while the paper also acknowledges several limitations.
Critical weaknesses
-
Unclear necessity of predictor finetuning. The proposed predictor finetuning is similar to training a horizon-conditioned nonlinear head on a frozen pretrained encoder. Moreover, Appendix I.2 shows that pretrained predictor weights provide little benefit over random initialization (at most 0.003 in pooled AUPRC). The necessity and unique advantages of predictor finetuning remain unclear.
-
Insufficient justification of theoretical assumptions. Proposition 1 relies on the target sufficiency assumption (A1), but the paper does not adequately justify this assumption given that the target encoder remains fixed after initialization. Moreover, the theoretical result only addresses event-information retention and does not directly establish the benefits of predictor finetuning or label efficiency.
-
Insufficient experimental validation. The paper lacks a comparison with a frozen randomly initialized encoder to verify the benefits of self-supervised pretraining. In addition, the 1%, 2%, and 5% label experiments only report HEPA's results on two C-MAPSS datasets, without comparisons against other baselines, making the claimed label efficiency difficult to assess.
Questions for authors
-
Given the similar performance of pretrained and randomly initialized predictors, why is it necessary to retain and finetune the pretrained predictor rather than train a new nonlinear head?
-
How do the authors justify the target sufficiency assumption (A1) in Proposition 1, given that the target encoder remains fixed after initialization?
-
How does Proposition 1 theoretically support the effectiveness of predictor finetuning?
-
How does HEPA compare with other baselines under 1%, 2%, and 5% labeled data?
-
Why is the finetuning-mode ablation in Table 4 conducted using an earlier architecture rather than the final HEPA architecture?
5 comments
We thank the authors for their detailed response and additional experiments. The new results provide further evidence of the effectiveness of HEPA's self-supervised pretrained encoder, particularly under limited labeled data on certain lifecycle datasets. However, this advantage is not consistent across all evaluated settings, and the pretrained predictor weights appear to contribute little to downstream performance. Therefore, we believe the paper should more clearly position its main contributions in light of these findings. Our remaining concerns have been satisfactorily addressed by the authors' response and additional experiments.
Thank you, we agree: the architecture is the general contribution, and pretraining pays off on lifecycle data with scarce labels
We thank the reviewer for the follow-up and are glad that the remaining concerns are addressed. We agree with the positioning the reviewer describes; the revised paper follows it, as summarised below, and we will make it explicit in the contributions list of the final version.
1. The main contribution is the horizon-conditioned architecture and its downstream recipe. One architecture with fixed hyperparameters matches or exceeds each baseline on at least 10 of 14 benchmarks across 11 domains (Section 1, Table 1). Within it, finetuning the predictor is what makes the recipe work: at full labels it beats a linear probe on the frozen predictor on all 5 datasets of the unified ablation (+0.01 to +0.30, Table 4). As the reviewer notes, however, its pretrained weights add little, and Section 3.2 says so explicitly: what transfers is the frozen encoder and the horizon-conditioning structure, not the predictor's weights.
2. The pretrained encoder is what makes scarce labels sufficient on lifecycle data, and the paper scopes the claim there. With 1–5% labels, the pretrained encoder has a higher mean than a random encoder under the same head in all 12 C-MAPSS settings (significantly in 10; Table 10). Moreover, on C-MAPSS-3 it has the highest mean of all methods at every budget, ahead of Chronos-2 by +0.15 [+0.05, +0.24] at 2% (Table 2). On GECCO, PSM and MBA, in contrast, the two encoders are level (Appendix P.2). Accordingly, Section 5.4 states that the benefit of pretraining is specific to scarce labels on lifecycle data, and that the advantage is not universal.
We are grateful for the reviewer's engagement throughout the discussion; the reviewer's questions led to the random-encoder control and the unified ablation, which we believe make the paper considerably stronger. We hope the revised paper now reflects the suggested positioning, and that this might be considered in the final assessment.
Predictor vs. fresh head, assumption A1, low-label baselines, final-architecture ablation
We thank the reviewer for their questions. Following their suggestion, we now compare all baselines at 1, 2 and 5% labels (Q4): the frozen pretrained HEPA encoder has the highest mean of all methods on C-MAPSS-3 at every budget.
Q1 and W1. We agree that the pretrained predictor weights matter little; the finetuned predictor's advantage comes from its architecture. With full labels it beats a fresh MLP head that takes Δt as input on MBA (+0.07 [+0.04, +0.09]) and GECCO (+0.08 [+0.02, +0.13]) and is within 0.01 of it on the other three. Its pretrained weights, however, add little (re-initialising them changes h-AUROC by −0.01 to +0.02, every interval including 0).
* paired 95% interval excludes 0. With ≤5% labels, in contrast, the fresh head is the more stable choice on C-MAPSS (Q4), and the revision no longer claims that the predictor weights transfer.
Q2–Q3 and W2. We agree that A1 needed more support than the submission gave, so we now test it directly. The test shows that A1 holds at longer horizons but not at Δt = 10: adding the past to the random target's embedding of (t, t+Δt] raises event AUROC by +0.05 on GECCO and +0.13 on MBA at Δt = 10, and changes it by at most 0.02 at Δt = 50 and 100.
At Δt = 50 and 100, A1 holds within the probe's resolution. On PSM, however, every embedding carries little of the event (AUROC 0.50–0.55), so the test says little there. Accordingly, the revision states A1 this way, removes the sentence calling it "mild for well-trained target encoders" (the target is a fixed random network) and moves Proposition 1 to the appendix as a statement about information retention. Finally, as the reviewer notes, Proposition 1 says nothing about the head, predictor finetuning or label efficiency, so the case for finetuning rests on Q1 and Q4.
Q4 and W3. We added all baselines at 1, 2 and 5% labels, and the comparison supports the label-efficiency claim for the pretrained HEPA encoder. On the two subsets of Table 2, at 1–5% labels the frozen HEPA encoder with a fresh MLP head has the highest mean h-AUROC of all methods on C-MAPSS-3 and is ahead of Chronos-2 there by +0.15 [+0.05, +0.24] at 2%; on C-MAPSS-1 it is level with the best baselines (paired intervals include 0).
The table reads the frozen HEPA encoder with an MLP head because, at these budgets, HEPA with its own predictor head depends strongly on which engines are labelled (sd up to 0.29 across subset draws). The second row is the frozen randomly initialised encoder the reviewer asked for: under the same head the pretrained encoder is ahead of it by +0.12 [+0.06, +0.18] at C-MAPSS-3 2%, and with 1–5% labels it has the higher mean in all 12 C-MAPSS settings. On C-MAPSS-2 and -4, too, the frozen encoder with this head has the higher mean at 2% (0.88 against Chronos-2's 0.78, and 0.89 against 0.75), with intervals that include 0. The revision therefore names the MLP head on the frozen encoder as the setting for scarce labels.
Q5. We now run it on the final architecture: a unified ablation in h-AUROC (7 arms, 5 label budgets, 5 seeds) replaces Table 4. At full labels it shows that finetuning the predictor beats a linear probe on all 5 datasets (+0.01 to +0.30) and that re-initialising it changes h-AUROC by at most 0.02.