- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2(+1)
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces Latent Stochastic Differential Equation (LSD) for anomaly detection. It is a reconstruction-based generative framework for multivariate time-series anomaly detection, which primarily models normal data using continuous-time stochastic dynamics in a low-dimensional latent space. The method is built upon latent SDEs on homogeneous spaces and employs masked likelihoods to handle irregular sampling and missing data, thereby avoiding the need for imputation or resampling. The paper also investigates two types of latent geometric structures: Euclidean spaces and hyperspheres. Experiments on six widely used benchmark datasets and one industrial dataset with recurring dynamic patterns demonstrate that LSD achieves a competitive overall ranking.
Critical strengths
- Leverageing latent SDEs on homogeneous spaces for Multivariate Time Series Anomaly Detection (MTSAD), to my knowledge thus far, is the first time.
- Broad benchmark coverage. Ablations and runtime notes (albeit limited) and a sparsity study that concretely tests the core claim of handling irregular/sparse data.
- The used codebase seems available, which is good for reproducing the experiment.
Critical weaknesses
- I find that the proposed method essentially amounts to adapting the algorithm in [1] to a simple time-series anomaly detection framework. Moreover, Neural/latent SDE/CDE approaches for irregular time series [2,3,4] have already been extensively studied. Therefore, neither the motivation nor the proposed method itself offers the authors' claimed novelty.
- A bigger issue lies in the organization and storytelling of the paper. First, regarding the Introduction section, I think most of the preceding content overly redundant, especially considering the subsequent Related Work section. In contrast, only a small portion at the end introduces the contributions without providing sufficient methodological motivation or context. I suggest substantially shortening the earlier discussion to make room for content that is more important to the overall story, such as why the authors came up with this particular approach and what limitations of other latent ODE methods motivate it. Second, regarding the Method section, I question the necessity of the first three paragraphs, which mainly provide an overview. Their length is almost comparable to that of the formal description in Section 3.2, while the latter is overly concise. I suggest that the authors refer to [1] and revise and elaborate on the algorithmic details. Overall, the paper currently requires a major restructuring of its content and presentation.
- Likelihood-based reconstruction scoring is known to suffer from calibration/pathologies in deep generative models; while the weak decoder and structured dynamics mitigate this, the paper does not probe failure modes or compare to compliance/GOF-based tests that can be more robust.
- Computational cost of latent SDE integration is high; solver and step-size choices, stability, and trade-offs are not deeply examined in the manuscript.
- In sparsity experiments, baselines are evaluated only after imputation, which may hand LSD an advantage; a fairer setup would include baselines that can ingest irregular data directly. Best-F1 is selected on test by sweeping all thresholds (optimistic). Segment-level metrics or fixed-thresholding (e.g., POT/MAD) could better reflect deployment use.
References:
[1] Zeng, Sebastian, Florian Graf, and Roland Kwitt. "Latent sdes on homogeneous spaces." Advances in Neural Information Processing Systems 36 (2023): 76151-76180.
[2] Verma, Yogesh, Markus Heinonen, and Vikas Garg. "Climode: Climate and weather forecasting with physics-informed neural odes." International Conference on Learning Representations. Vol. 2024. 2024.
[3] Jeon, Jinsung, et al. "GT-GAN: General purpose time series synthesis with generative adversarial networks." Advances in Neural Information Processing Systems 35 (2022): 36999-37010.
[4] Jhin, Sheo Yon, Jaehoon Lee, and Noseong Park. "Precursor-of-anomaly detection for irregular time series." Proceedings of the 29th ACM SIGKDD conference on knowledge discovery and data mining. 2023.
Questions for authors
- See the Critical Weaknesses.
- Was min-max scaling fit strictly on training data (per-variable) and then applied to validation/test, or on the full dataset? Please clarify to rule out leakage.
- To what extent do LSD’s gains at 1% retention persist if baselines that can handle irregular sampling without imputation are included? If you re-run with such baselines, how do rankings change?
4 comments
Response to Reviewer TWUM - Part 2
▶ W3: Likelihood-based scoring and failure modes We thank the reviewer for this suggestion. First, the known pathologies of likelihood-based detection (e.g., Nalisnick et al., 2019) mainly concern the marginal likelihood p(x) of deep generative models, which can be dominated by low-level input statistics. Our score is instead the expected conditional log-likelihood of the observations given posterior sample paths under a Gaussian emission model with fixed variance. As shown in Eq. 2, it decomposes into the deviation from the mean reconstruction and the variance of the reconstructions across sample paths, and is therefore not inflated by low input complexity in the same way. We agree, however, that reconstruction-based scores share a related failure mode: anomalies that leave the observed dynamics largely unchanged remain well reconstructed.
To probe this, we added a qualitative analysis on QAPPD (Appendix C.4), where the anomaly types are documented by Nosrati et al. (2027), evaluating both LSD variants and the latent Neural ODE per trace and anomaly type. Delay anomalies are detected reliably by all methods (AUC between 92 and 99), and pick-up position anomalies are detected well on most traces but less reliably on one. Voltage anomalies, in contrast, are not detected by any method (AUC between 53 and 57), which we attribute to the voltage deviations having only a marginal effect on the observed trajectories. This is precisely the failure mode described above, which we now discuss as a limitation in Section 5. As this anomaly type occurs in a single trace only, we refrain from broader conclusions.
We agree that conformal and goodness-of-fit-based tests are a promising direction, as they could also flag observations that are reconstructed suspiciously well. As the per-variate scores and sample paths of LSD provide a natural basis for such tests, we now mention them as future work.
▶ W4: Computational cost of latent SDE
Following Zeng et al. (2023), we use a fixed-step geometric Euler–Maruyama scheme for both the and the variant. Each step applies a matrix exponential to the latent state, preserving the group structure at any step size: the update matrix is orthogonal for and invertible for . The step size trades discretization accuracy against the number of updates, and reparameterizing the Gaussian increments allows backpropagating directly through the updates, so neither adaptive step-size control nor a separate adjoint solve is required.
Training is dominated by the forward and backward pass through the solver and scales linearly with the number of solver steps, sample paths, and the window length. Table 8 (Appendix C.1) reports the resulting training times, which are substantially higher than for the baselines; scoring requires no backpropagation and is considerably cheaper. We acknowledge this as the primary limitation of LSD in Section 5.
▶ W5: Fairness of the sparsity experiment and thresholding
Baselines after imputation. We agree, and have added the latent Neural ODE of Rubanova et al. (2019), which ingests irregular data directly, to the sparsity experiment; see W1 and Q3.
Best-F1 thresholding. We follow the protocol of Sarfraz et al. (ICML 2024), which selects the F1-maximizing threshold, as is common in the literature. We agree that this is optimistic and does not reflect deployment, where thresholds are application dependent. For this reason, two of our three metrics, AUC-ROC and AUC-PR, are threshold-free, accounting for two thirds of the ranking in Table 3.
▶ Q2: Min-max scaling
The min-max scaling is fitted per variable exclusively on the training data and applied unchanged to the validation and test data, which rules out leakage through this step.
▶ Q3: Gains at 1 % retention with baselines that handle irregular sampling natively
The latent Neural ODE of Rubanova et al. (2019) is such a baseline: it operates directly on the irregularly observed data and is evaluated under the same protocol as LSD. On QAPPD with full observations, it ranks between our two LSD variants; under burst subsampling down to 1 %, however, it falls behind both. Hence, LSD's gains in the sparsity experiment are not merely an artifact of imputing the baselines (Section 4.2).
We thank the reviewer again for the detailed feedback, which has substantially improved both the presentation and the empirical analysis of the paper. We acknowledge that LSD builds on an existing model class; we hope, however, that the revised manuscript makes clearer why this model class is well suited for anomaly detection on sparse and irregular data, and how our design choices and evaluation contribute in this setting. We would be grateful if the reviewer could take these revisions into account in the final assessment.
Thank the authors for their response. The writting of the manuscript has now improved (while I suggest highlighting the revised parts in a different, more distinguishable color, e.g., in blue). Some of my concerns have also been addressed, and I have accordingly increased my rating.
We sincerely thank the reviewer for the follow-up and for increasing the rating. Regarding the highlighting of revisions, we had assumed that the automatically generated pdfdiff, which according to the ICLR 2027 author guidelines compares each revision against the original submission, would serve this purpose, and therefore did not additionally mark the changes in color. We apologize for any inconvenience this may have caused. For orientation, the main revisions concern the introduction and the method section (Sections 1 and 3), the latent Neural ODE baseline in all experiments (Sections 4.1 and 4.2), and the new analyses in Appendices C.3 to C.6.
Response to Reviewer TWUM - Part 1
We thank the reviewer for the thorough and critical review. We take the concerns seriously and have revised the manuscript substantially in response: we restructured the introduction and method section, now motivating the approach through the limitations of latent NeuralODEs and stating explicitly which components are adopted from prior work; we added a latent NeuralODE as a baseline that operates directly on irregular data, an ablation isolating the stochastic component, and a qualitative analysis of failure modes; and we clarified the solver, the normalization, and the evaluation protocol. We address each point below.
▶ W1: Novelty relative to Zeng et al. (2023) and irregular time series modeling
We agree that LSD builds on the latent SDE framework of Zeng et al. (2023), and that the modeling of irregular time series with NeuralODEs, SDEs and CDEs has been studied extensively. However, our goal is not a new time series model, but address a different research question: We use the latent SDE as a tool for multivariate time series anomaly detection: modeling the benign time series is the surrogate, unsupervised task, and the learned model is then used to measure how likely each observation is under the learned latent dynamics. The works in [2] and [3] address forecasting and generative synthesis, respectively, and do not consider anomaly detection.
Within anomaly detection, to the best of our knowledge, LSD is the first approach based on neural differential equations that operates on sparse and irregularly sampled data without imputation or interpolation as a preprocessing step. Methodologically, beyond adopting the framework of Zeng et al. (2023), our contributions are the mask-based training and scoring on partially observed inputs, the instantiation and comparison of two latent geometries (the realization of the GL(n) action on Rn, complementing the original SO(n+1) action on Sn), a deliberately weak decoder, and a point-wise anomaly score based on the expected conditional log-likelihood (Section 3.3, Eq. 2). We now state explicitly in Section 3 which components are adopted from Zeng et al. (2023) and which are new.
Regarding [4] and Sun et al. (2026), we considered both as baselines. However, both methods construct a continuous input path by cubic spline interpolation in a first stage, which reintroduces exactly the interpolation step LSD is designed to avoid and which would place them in the same position as the imputed baselines in the sparsity experiment (see also Q3). We agree, though, that a simpler model that also operates directly on the sparse data is the right reference to justify our more complex one. We have therefore added the latent NeuralODE of Rubanova et al. (NeurIPS 2019) as a baseline on all benchmarks and in the sparsity experiment, sharing the recognition network, decoder, and anomaly score of LSD. LSD outperforms it on all benchmarks except QAPPD with full observations, where it ranks between our two LSD variants; under burst subsampling with 1 % of the data retained, it falls behind both. To further separate the contribution of stochasticity from that of the structured dynamics, we added an ablation that removes only the diffusion term (Appendix C.3, see also our response to Reviewer xop4, W3). On QAPPD, the stochastic model outperforms its deterministic counterpart for both geometries, while on PSM the picture is mixed.
▶ W2: Organization and storytelling We thank the reviewer for this comment. The structure of the paper reflects a trade-off between different needs: being accessible to readers from the anomaly detection community who are less familiar with latent SDEs, being self-contained, and avoiding redundancy for experts. We aimed to preserve the overall structure, but we agree that it can be improved in the direction suggested by the reviewer. We therefore revised the manuscript as follows:
With these changes, we hope to have found a structure that serves both readers new to the field and experienced readers.