- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3(+1)
Read review
Paper summary
The paper introduces TimEE, an end-to-end time series classification model that uses in-context learning (ICL) within the prior-data fitted network (PFN) framework. Its main contributions are a structured synthetic data-generation process and a transformer architecture that conditions on labeled support examples. In the reported evaluation, TimEE substantially outperforms the prior time series ICL method TiCT and achieves competitive performance against strong supervised baselines. The synthetic prior is a central contribution, supported by ablation studies of its components.
Critical strengths
- The paper provides substantial empirical evidence of strong classification performance. Across 128 UCR datasets, TimEE achieves the best mean ROC AUC rank and is statistically tied with the strongest supervised baselines. These results support the practical value of synthetic pretraining for end-to-end time series classification.
- The paper is clear and easy to follow, and the proposed method is well motivated. The structured synthetic prior and architecture are described in sufficient detail to make the approach useful to researchers and practitioners developing time series ICL models.
Critical weaknesses
My main concern is that the connection between the synthetic prior and real-world classification tasks could be developed further. The paper provides intuitive motivation and component ablations, but these leave open which properties of the synthetic tasks explain successful transfer to real datasets. A more targeted analysis of this connection would strengthen the scientific contribution and help characterize the method's generalization limits.
Questions for authors
- Synthetic prior and generalization (clarification). The prior design is intuitively motivated, and the empirical results and ablations support its effectiveness for ICL training. Could the authors explain which statistical or discriminative properties of real time series classification tasks the prior is intended to capture, and how the existing evidence supports this connection? As a suggestion for further analysis, a focused comparison of synthetic tasks with UCR and/or UEA tasks, or theoretical justification where appropriate, could help explain the observed transfer. Broader validation beyond these benchmark families would be a useful direction for future work.
- One-vs-rest prediction (clarification). Section 3.3 states that, when the number of classes C exceeds 10, TimEE decomposes the task into C binary one-vs-rest (OvR) contexts. How are their outputs combined into a single multiclass prediction? For example, if several contexts favor their positive class, is the final label selected using the highest positive-class probability? Please also clarify how the C scores are normalized to obtain a multiclass probability distribution.
- TiCT preprocessing (clarification). Given TiCT's relatively weak performance in the reported evaluation, could the authors check whether its input time series were resampled to length 512 before inference? The reference implementation includes this preprocessing step, using
scipy.signal.resample(data, 512, axis=2)for arrays shaped(samples, channels, time).
4 comments
Follow-up on the authors’ response
Thank you for the detailed response. The explanation of OvR normalization and the confirmation of TiCT’s preprocessing address my second and third questions.
The additional domain-wise analysis is helpful and strengthens the empirical evidence for synthetic-to-real transfer. My remaining question concerns which properties introduced by the prior’s structural and signal variations explain this transfer. A brief qualitative analysis would be sufficient—for example, visualizing representative synthetic and real-world series and discussing which class-discriminative patterns the prior captures or underrepresents. This could also help substantiate the proposed explanation for weaker performance on appliance-load datasets.
Overall, I retain my weak acceptance recommendation. The response resolves my implementation questions and provides useful additional evidence of transfer. A clearer qualitative connection between the synthetic prior and real-world task structure would further strengthen the paper.
Dear Reviewer G4UF,
Thank you for your constructive follow-up. Following your suggestion, we have added a qualitative comparison of synthetic and real-world time series in Appendix C.5 (Synthetic Prior and Real-World Data).
In the new Figure 13, we compare representative series from 15 UCR datasets with their nearest synthetic counterparts among 153,600 generated series. We observe similarities across diverse patterns, including smooth trends, localized events, and noisy oscillations. This illustrates the diversity of time-series patterns covered by our prior.
Regarding class-discriminative patterns, our structural and signal variation mechanisms introduce differences in temporal dynamics and time scale, respectively, as illustrated in Figures 10–12. Our prior ablations (Appendix C.6, Table 6) further show that pretraining with either mechanism independently yields competitive performance on real-world UCR datasets.
While our work describes the class-discriminative mechanisms generated by the prior and provides empirical evidence of their transferability, we agree that a deeper understanding of which specific properties enable this transfer to real-world tasks would be valuable. Such an investigation could involve analyzing the discriminative structures of real-world datasets alongside controlled synthetic experiments. We see this as a promising direction for future work.
Thank you again for your helpful suggestion. We hope the additional analysis and clarification are useful.
Kind regards,
The Authors
Thank you for the update. I have increased the soundness score from 2 to 3.
Dear Reviewer G4UF,
Thank you for your positive assessment and constructive questions. We address your concerns and questions below.
Weaknesses and Questions
W1 & Q1: Synthetic Prior and Generalization
We agree that there is room to further develop the synthetic prior, and we do not claim that our current prior is optimal. We also acknowledge that the transfer from synthetic to real-world tasks was not sufficiently discussed in the paper.
Nevertheless, we view TimEE's competitive performance on real-world UCR tasks, despite being pretrained exclusively on synthetic tasks, as evidence that the prior captures at least some of the structure underlying real-world classification problems. Similar synthetic-to-real generalization has been observed in tabular foundation models (TabPFN, TabICL) and time-series models pretrained on CauKer [1] (e.g., MantisV2).
Our prior is designed for diversity rather than direct imitation of real-world distributions. Instead of targeting the characteristics of a particular domain or dataset, we aim to capture broad, generic time-series structures and diverse mechanisms through which classes may differ. These mechanisms are sampled from broad meta-distributions (Table 5, Appendix C.1).
Our prior ablations (Appendix C.5, Tables 6–7) provide further evidence for this design choice: each class-generation mechanism individually yields a competitive prior, while combining them achieves the strongest overall performance.
Domain-wise analysis on UCR. To better understand where TimEE transfers successfully and where limitations remain, we additionally break down UCR performance by the domain labels provided in the archive:
TimEE matches or exceeds MiniRocket across several categories of recorded physical signals (Sensor, Motion, ECG, Spectrum) and performs comparably on image outlines. Its largest performance gaps occur in two domains:
These gaps suggest opportunities to improve the prior. We also agree that evaluation beyond UCR/UEA would provide valuable additional evidence of generalization, and will explicitly identify this as future work.
Reference
[1] Xie, Shifeng, et al. "CauKer: Classification Time Series Foundation Models Can Be Pretrained on Synthetic Data." International Conference on Learning Representations (ICLR), 2026.
Q2: Combining One-vs-Rest Outputs
For classification tasks with more than 10 classes (C>10), we construct C binary contexts. In context c, support examples belonging to class c are labeled positive, while all remaining examples are labeled negative. A forward pass through TimEE then produces the positive-class probability pc.
Because these C contexts are evaluated independently, the resulting probabilities do not necessarily sum to one. We therefore normalize them across classes for each query:
p(y=c∣x)=∑j=1Cpjpc.
Yes. The predicted class is selected by taking the argmax of the normalized probability distribution (equivalently, the argmax of the unnormalized positive-class probabilities). ROC AUC and log loss are computed using the same normalized distribution.
We will clarify this in Section 3.3 of the paper.
Q3: TiCT Preprocessing
Yes, our TiCT evaluation follows the reference preprocessing procedure.
Each time series is first resampled to a length of 512 using
scipy.signal.resample(X, 512, axis=2), where the input has shape(samples, channels, time). The resampled series are then z-normalized individually.For context construction, we retrieve the 64 nearest neighbors from the training set for each query.
We will make these preprocessing details explicit in the revised manuscript.
We hope these responses clarify the scope of our work, the motivation behind the synthetic prior, and the evaluation methodology.
Thank you for your thoughtful feedback.
Kind regards,
The Authors