- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces NeuralRos, a framework that repurposes the Rosenblatt transformation from a diagnostic tool into a learning mechanism for multivariate time series. The key idea is to jointly learn cross-series dependencies and localize anomalies by modeling the conditional distributions induced by a learned Rosenblatt ordering. The method is evaluated on eight synthetic datasets for dependency identification and three real-world datasets (SMD, MSDS, SWaT) for anomaly localization.
Critical strengths
- Repurposing the Rosenblatt transformation as a learning objective is novel.
- Most existing methods assume purely continuous variables. The randomized quantile extension is a practical way to handle discrete series.
- Extensive experiments on 11 datasets indicate the effectiveness.
Critical weaknesses
- The ordering score is derived from attention asymmetry ( - ), but it is unclear why attention asymmetry could indicate directional ordering in a Rosenblatt factorization.
- The LRO uses a straight-through estimator with hard sorting in the forward pass. It is unclear whether the learned ordering converges consistently across runs.
- This paper states that NeuralRos "also has generative capabilities, which are important for system diagnosis," but no generation experiments or qualitative samples are provided.
- The largest real-world dataset has only 51 variables (SWaT), which doubts whether NeuralRos can scale to hundreds or thousands of channels.
Questions for authors
- Does the learned Rosenblatt ordering converge to a consistent permutation across different random seeds? Can you provide quantitative analysis?
- Why does attention asymmetry provide directional ordering evidence? Is there a formal link to conditional independence or causal ordering? How do you handle numerical issues from polynomial transformations (e.g., negative values, large magnitudes)?
- How does NeuralRos scale to high-dimensional MTS?
- Due to the claim that NeuralRos has generative capabilities, can you demonstrate this by generating realistic MTS samples and showing their utility for diagnosis or anomaly simulation?
- In the ablation "without Rosenblatt-based learning process", what exactly is removed? Is it the uniformity and independence losses, the entire Rosenblatt transform, or both? Please clarify the ablated variant.
4 comments
Comment 4
Comment 4
We have included the available real-world datasets suitable for evaluating the anomaly localization task, as datasets with reliable feature-level ground-truth labels remain limited. Nevertheless, the computational cost analysis presented in Table 3 of the revised manuscript (page 10) provides insights into how model complexity and inference time scale with increasing numbers of time series. The results show that NeuralRos remains highly computationally efficient as the number of variables increases. Specifically, on SWaT, the largest real-world dataset considered (), NeuralRos requires only approximately 2.8 million learnable parameters, compared with approximately 28.9 million for AERCA, one of the strongest baselines for cross-series dependency identification. Similarly, NeuralRos achieves an inference time of only 0.11 ms per sample, compared with 45 ms for AERCA. These results demonstrate the computational efficiency of the proposed approach, even as the number of time series increases.
Q1
To quantitatively assess the consistency of the learned Rosenblatt ordering, we examined variations in the learned permutations across 30 independent runs with different random seeds. We observed that the learned orderings exhibit only minor variations, with approximately 2–3 changes in variable positions for SMD, 1–2 for MSDS, and 3-4 for SWaT, on average. These results indicate that the LRO module learns relatively consistent orderings across independent runs, with small but expected variations. We emphasize that the Rosenblatt transformation is theoretically valid for any variable ordering, and the purpose of the LRO module is to identify a suitable ordering that facilitates dependency learning in each independent run, rather than enforcing an identical permutation across all runs. Furthermore, the robustness of the proposed approach is supported by the consistently strong mean performance and low standard deviations reported across the evaluation metrics (see Tables 5 and 6 of Appendix B, page 25-26). These findings suggest that small variations in the learned ordering do not substantially affect the overall performance of NeuralRos. To address the Reviewer's comment, we have included this additional analysis in Appendix B of the revised manuscript, under “Supplementary Ablation Studies” (page 27, lines:1250-1260).
Q2
Regarding the motivation for using attention asymmetry to determine the Rosenblatt ordering, please see the reply to Comment 1.
Regarding the numerical stability of the polynomial transformations, we clarify that all datasets undergo preprocessing, including normalization, before being provided as input to NeuralRos. Consequently, the Query and Key representations are constructed from normalized time-series data, reducing the risk of excessively large values during polynomial transformations. Furthermore, as explicitly described in Section 4.2, the resulting Query and Key representations are also row-normalized before computing the attention matrices, ensuring that the attention scores remain bounded between −1 and 1. Regarding negative input values, the polynomial transformations use integer powers, which are mathematically well-defined for both positive and negative values. Odd powers preserve the sign of negative inputs, while even powers produce non-negative values. Therefore, negative values do not introduce numerical difficulties in the polynomial transformations. These normalization steps help maintain numerical stability throughout the proposed LRO mechanism. We appreciate the Reviewer's comment and welcome any further suggestions for improving numerical stability. Nevertheless, we did not encounter any numerical stability issues during our experiments across the evaluated datasets.
Q3
Please see our reply to your Comment 4
Q4
Please see our reply to your Comment 3
Q5
We thank the Reviewer for this comment. We clarify that the ablated variant removes the entire Rosenblatt-based learning mechanism, including the Rosenblatt transformation and its associated uniformity and independence losses. Specifically, the ablation compares two models with the same neural conditioner architecture: one trained using the proposed Rosenblatt-based learning procedure and the other trained without it. This allows us to isolate the contribution of our core methodological novelty, namely, using the Rosenblatt transformation as a learning mechanism rather than solely relying on fitting the conditional distributions through likelihood optimization. The results (Main Manuscript: Fig. 1; Appendix: Table 6 and Fig. 6, pp. 26–27) demonstrate that the performance improvements arise from the proposed Rosenblatt-based learning mechanism rather than simply from the expressive capacity of the neural conditioners. To avoid any ambiguity, we have explicitly clarified this distinction in the ablation study discussion on page 9 of the revised manuscript.
Finally, we would like to note that we have included three additional baseline methods for comparison in the revised manuscript to further strengthen our experimental evaluation.
Thank you for your rebuttal. Most of my concerns have been resolved and I will increase my rating to 3.
Comment 1:
We thank the Reviewer for this insightful comment. The motivation behind using attention asymmetry is to identify a suitable ordering for the Rosenblatt transformation based on cross-series dependencies. As explained in Section 4.2, the attention mechanism compares the original time series with linear and nonlinear transformations of the other series, allowing us to assess their relative dependencies. Specifically, if modeling the conditional distribution of series i relies more strongly on the representations of series j than the reverse, we favor placing j before i in the Rosenblatt ordering. This allows the current observation of series j to be used when estimating the conditional distribution of series i, thereby facilitating dependency learning. The attention asymmetry therefore provides a data-driven preference for the relative ordering of each pair of time series, which is subsequently aggregated to obtain the final ordering. We have further clarified the above points in the revised manuscript (see Section 4.2, pp. 4–5, lines 180-195).
Furthermore, in response to a related comment from another Reviewer, we have extended our ablation study by comparing the proposed LRO module with both a fixed natural ordering and a marginal variance-based ordering. The additional results, reported in Table 7 of Appendix B (page 26), show that LRO consistently achieves substantially lower HHD across all four datasets, providing further empirical support for the effectiveness of the proposed ordering mechanism.
Comment 2
We thank the Reviewer for this insightful comment. The Rosenblatt transformation is theoretically valid for any variable ordering. The proposed LRO module allows the model to learn a suitable ordering in a data-driven manner, adapting to the underlying dependencies of each dataset. However, this does not necessarily imply that the learned ordering must be identical across independent training runs. We acknowledge this potential variability, which was an important consideration in our experimental design. Specifically, we evaluate NeuralRos over 30 independent runs with different random seeds, which may result in different learned orderings, and report the mean performance together with the corresponding standard deviations. As shown in Table 5 of Appendix B, the standard deviations across the cross-series dependency identification metrics are consistently very small, indicating that NeuralRos achieves stable dependency identification performance despite potential variations in the learned ordering. These results provide empirical evidence of the robustness of the proposed approach across independent training runs.
To further address the Reviewer's comment, we conducted an additional quantitative analysis of the learned permutations across the 30 independent runs. The results show only minor variations, with approximately 2–3 changes in variable positions for SMD, 1–2 for MSDS, and 3-4 for SWaT, on average. These findings provide further evidence of the consistency of the learned Rosenblatt ordering across different random seeds. We have included this additional analysis in Appendix B of the revised manuscript, under “Supplementary Ablation Studies” (page 27, lines:1250-1260).
Comment 3
Many thanks for your comment.
NeuralRos has generative capabilities, since the neural conditioners learn the conditional distributions of the individual time series, and the Rosenblatt factorization provides a probabilistic representation of their joint distribution, from which new observations can be generated. We would like point out that the intention was not to overclaim this capability, as it follows from the probabilistic formulation of the proposed model. Nevertheless, we agree with the Reviewer that these capabilities were not explicitly evaluated in our experimental study. Therefore, we have removed this statement from the list of contributions in the revised manuscript. We nevertheless consider generative capabilities an important advantage of the proposed probabilistic framework compared with commonly used reconstruction-based approaches for anomaly detection, which do not explicitly model the joint probability distribution of the observations.