- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
To apply current time series foundation models in practice, the authors identify two challenges: retaining memory over an endless stream of past timestamps, and keeping inference time short enough to process data on the fly. They formalize this as the Continuous & Live Time Series Understanding (CL-TSU) problem. They also introduce LIVETS-SUITE, a dataset for training and evaluating time series foundation models across 6 core capabilities and 18 tasks under the CL-TSU framework. Building on this, they propose TIMEOMNI-LIVE, a foundation model designed for CL-TSU, which combines hybrid time series encoding, stream-persistent hybrid memory, and elastic stream-inference synchronization. Experiments show that TIMEOMNI-LIVE outperforms frontier models on LIVETS-SUITE, and ablations further confirm the complementary roles of its encoding, memory, and scheduling components.
Critical strengths
- The paper is well written and addresses an important problem. It goes beyond isolated time series windows to study continuous monitoring, historical event tracking, and changing instructions. The experiments are also well designed and support the paper's conclusions.
- The paper considers deployment efficiency as well as accuracy. The experiments report token consumption, real-time factor (RTF), and latency, and include an evaluation of a deployment on a Jetson AGX Orin.
- The paper provides a benchmark for the CL-TSU problem, comprising 18 subtasks, which offers a standard foundation for future research on this problem.
Critical weaknesses
- It is unclear whether each subtask tests an independent capability of the model. For example, Task 1 and Task 15 can both be solved with the same naive threshold-based method.
- The robustness of TIMEOMNI-LIVE against numerical shifts is doubtful. Although the authors offer some explanations, they do not provide a solution.
- The benchmark generation process combines synthetic signals, injected events on transformed real backgrounds, and native label alignment. This enables controlled evaluation, but good performance on such tasks does not establish reliability on naturally occurring, unmodified operational streams with ambiguous events and evolving noise. The additional KPI experiment helps, but it covers only one external anomaly-detection setting.
Questions for authors
- For the metrics in the experiments section, could you provide more detail on how the content accuracy C_j is calculated?
- Regarding the architecture of TIMEOMNI-LIVE, Mantis V2 already encodes the mean and standard deviation of the time series. What is the benefit of encoding this information again in text form?
- Point 2 & 3 in Section 'Critical Weaknesses'.
11 comments
Response to Reviewer C7iU [Part 2]
W3: The benchmark generation process combines synthetic signals, injected events on transformed real backgrounds, and native label alignment. This enables controlled evaluation, but good performance on such tasks does not establish reliability on naturally occurring, unmodified operational streams with ambiguous events and evolving noise. The additional KPI experiment helps, but it covers only one external anomaly-detection setting.
Thank you for your insightful and constructive comments. Our testbed already includes naturally occurring real-world streams across several Real tasks, with their original event timing and order left unmodified and no artificial events injected.
Furthermore, we added two external evaluations on naturally recorded signals beyond anomaly detection. We detail these two points below.
(1) Our testbed includes naturally occurring real-world streams without artificial event modification.
T8 & T10 use the MIT-BIH Arrhythmia Database [1], while T16 & T17 use the MIT-BIH Long-Term ECG Database [2]. These tasks use continuous segments of real ECG recordings and their original beat annotations: the events occur naturally in the recordings rather than being synthesized or injected.
We select segments for task suitability and signal quality and apply amplitude standardization, while preserving the original event timing and order within each segment. We then align native annotations with task requirements, such as event counting and reference-event recognition. Defining these tasks and aligning their annotations therefore do not require modifying or injecting events into the streams.
(2) We added two additional evaluations on naturally recorded signals.
We added Sleep-EDF-20 sleep staging [3] and CAPTURE-24 activity recognition [4], using overnight EEG and everyday wrist-accelerometer recordings, respectively. Both evaluations use naturally recorded signals and existing annotations without artificial event injection.
We have added the evaluation settings and results to , with both datasets reported in .
Setting. For each dataset, we evaluate zero-shot transfer and LoRA adaptation. LoRA uses a 1,000-step training budget with validation-based checkpoint selection; training, validation, and test subjects are disjoint within each split. The supplementary results below use independent-segment evaluation, resetting context for each segment while retaining the original checkpoints. Scores are pooled test macro-F1 (%), higher is better; baselines are reproduced using the authors’ implementations.
-
Sleep-EDF-20: sleep staging. We classify five sleep stages from 30-second Fpz-Cz EEG segments, using 20 subject-held-out folds covering 39 nights and 44,220 segments.
Method Dataset-specific training Macro-F1 ↑ TinySleepNet [5], reproduced Yes 79.55 TimeOmni-Live, zero-shot No 5.26 TimeOmni-Live + LoRA Yes 72.71 -
CAPTURE-24: activity recognition. We classify ten activities from non-overlapping, 10-second three-axis accelerometer segments, using 80 training, 20 validation, and 51 test subjects, with 308,448 test segments.
Method Dataset-specific training Macro-F1 ↑ CNN [4], reproduced Yes 47.36 TimeOmni-Live, zero-shot No 6.42 TimeOmni-Live + LoRA Yes 41.78
Findings. After fine-tuning, TimeOmni-Live achieves competitive performance on both external datasets. These tasks require only a class label for each complete segment, so they evaluate our model as a classifier rather than under the full continuous-understanding setting. Nevertheless, the results provide evidence of effective adaptation to naturally occurring real-world signals.
We also discuss the limited coverage of natural data and future extensions in .
[1] The impact of the MIT-BIH Arrhythmia Database. IEEE Engineering in Medicine and Biology Magazine, 2001.
[2] PhysioNet as a Global Platform for Biomedical Research. Nature Health, 2026.
[3] Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Transactions on Biomedical Engineering, 2000.
[4] CAPTURE-24: A large dataset of wrist-worn activity tracker data collected in the wild for human activity recognition. Scientific Data, 2024.
[5] TinySleepNet: An Efficient Deep Learning Model for Sleep Stage Scoring based on Raw Single-Channel EEG. IEEE EMBC, 2020.
Response to Reviewer C7iU [Part 3]
Q1: For the metrics in the experiments section, could you provide more detail on how the content accuracy C_j is calculated?
Many thanks for pointing this out. Content accuracy is computed using task-specific rule-based scoring. We extract the required fields from each response and compare them with their reference values.
(1) Numerical and discrete fields are evaluated separately.
Each task specifies which information should be evaluated. For example, T1 evaluates the reported excess above a threshold, whereas T11 evaluates the previous record and the increase over that record. The scoring criteria for all 18 tasks are provided in .
- Numerical fields. We use tolerance-based accuracy scoring. For a numerical quantity, let and denote its predicted and reference values. The relative error is calculated as where is a field-specific floor to handle reference values close to zero. The accuracy score is calculated as
Response to Reviewer C7iU [Part 1]
Thank you for your positive and constructive feedback. Below, we provide detailed responses addressing each comment.
Thank you for your careful reading and positive assessment of our work.
Our paper does not claim that the 18 tasks correspond to 18 independent capabilities. As stated in the abstract and task descriptions, LiveTS-Suite contains 18 tasks spanning six core capabilities.
T15, T16, and T17 belong to C6: Ultra-Long Reliability. Their main purpose is to test whether a model can continue to fulfill task requirements over a much longer stream. For your convenience, we summarize their relationship to the corresponding basic tasks below.
As you correctly noted, T1 and T15 can be solved using the same threshold-based method. We intentionally preserve the underlying detection rule while extending the stream length to examine whether the model remains responsive during prolonged operation.
However, apart from T15–T17, the remaining tasks address distinct task requirements. For T15–T17, the emphasis is specifically on the reliability of existing capabilities over longer periods of operation.
Thank you for your thoughtful comments. Our proposed solution is to broaden the numerical coverage of the training data and use lightweight LoRA adaptation for new numerical ranges in downstream applications.
(1) Why we report the numerical-shift results.
Although TimeOmni-Live outperforms several strong baselines under numerical shifts, generalization to unseen numerical ranges remains challenging. One possible reason is that training on a limited numerical range may cause the model to rely on familiar numerical patterns, reducing its ability to generalize to unseen numerical values and task parameters.
This motivates us to broaden numerical coverage during subsequent training, allowing the model to encounter a wider range of numerical values and task parameters. We plan to explore this direction in our future work. We have clarified this limitation and the need for broader numerical coverage in Appendix F: Limitations and Future Work. To further address your concern, we provide experimental evidence supporting lightweight LoRA adaptation as a practical solution.
(2) LoRA adaptation using a small amount of data from the new numerical range.
For downstream applications involving new numerical ranges, we adapted the model using LoRA and the time series adapter with a small amount of data from the new range, while keeping the task rules unchanged.
Setting. We generated 360 training streams (3,276 windows) and 90 separate validation streams (820 windows). Adaptation used 300 steps and took 40 minutes on one H100. We evaluated both the original and adapted models on the same test set from the new numerical range. For your convenience, we summarize the results below.
Findings. LoRA adaptation improves the score on the new numerical range by 14.17 points, demonstrating that lightweight adaptation is a low-cost and effective solution for improving performance on new numerical ranges.