- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This work proposes a geometric framework that models normal temporal behavior using a compact set of learned implicit constraints. These constraints are learned exclusively from normal training samples, while anomalies are identified at inference time based on their violations of the learned constraints.
Critical strengths
The main strength of this work lies in its competitive experimental performance. Beyond this, however, I find it difficult to identify other particularly compelling strengths.
Critical weaknesses
I discuss the weaknesses one by one below, in descending order of importance.
-
The novelty of this work is difficult to assess due to the unclear and, at times, unprofessional presentation of the methodology, which makes the authors’ core ideas hard to follow. First, the mathematical formulation is insufficiently rigorous and contains several apparent inconsistencies. For example, there seem to be potential errors or ambiguities in Eqs. (4)–(7), and I found the derivation particularly difficult to follow. The relationship between and is not clearly explained. Similarly, the motivation for introducing the so-called temporal constraint network is unclear, as is its specific role within the overall framework. More generally, similar issues appear throughout the methodology section. Many key concepts, mathematical relationships, and design motivations are introduced without sufficient explanation, making it difficult to understand the proposed method and to properly evaluate its technical novelty.
-
The overall organization of the paper is rather unusual. In particular, the writing style of the Introduction is noticeably different from what I typically encounter in academic manuscripts. Based on my more than six years of reviewing experience, the highly formulaic and somewhat unnatural presentation raises concerns that the manuscript may have been heavily assisted by generative AI. This concern is further reinforced by Fig. 2, where several arrows exhibit visually implausible shapes and inconsistent structures.
-
Although the experimental results appear competitive, the paper does not clearly explain how the proposed method exploits cross-variable dependencies in multivariate time series to improve anomaly detection.
-
The visualization of temporal anomaly localization is rather limited, which makes it difficult to qualitatively assess and better understand the effectiveness of the proposed method. I suggest that the authors provide more comprehensive visualization results, following prior works [1,2], for example, by illustrating the localization performance on different types of anomalies, such as point anomalies and trend anomalies. Additionally, more most recently developed MTS analysis methods should also be included [3, 4].
[1] Anomaly transformer: Time series anomaly detection with association discrepancy. ICLR 2022.
[2] iTransformer: Inverted Transformers Are Effective for Time Series Forecasting. AAAI 2024.
[3] TimeFilter: Patch-Specific Spatial-Temporal Graph Filtration for Time Series Forecasting. ICML 2025.
[4] TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysis. ICLR 2025.
Questions for authors
See weaknesses above.
7 comments
Response: 2
We thank the reviewer for the constructive feedback regarding the manuscript's organization, writing style, and visual presentation. We acknowledge that certain aspects of the Introduction and Fig. 2 could be improved to ensure a more natural academic narrative and clearer technical presentation. These are primarily matters of exposition and figure design, which can be addressed directly in the revision.
Regarding generative AI assistance, we would respectfully clarify that its use was explicitly disclosed in the AI Use Statement of the original submission. As stated therein, generative AI tools were used for language-level assistance, including paraphrasing, rephrasing, and formatting, with the resulting content reviewed by the authors. The scientific contributions, mathematical formulation, methodological development, experimental design, implementation, reported results, and conclusions remain the responsibility of the authors. We recognize that some language-level revisions may have resulted in an overly structured writing style, and we will refine these passages to improve readability and academic presentation.
Regarding the introduction, we agree that its narrative can be made more direct and conventional. We will streamline the discussion by establishing a clearer progression from the limitations of existing MTSAD approaches to the motivation for learning implicit normality constraints, followed by the geometric formulation and principal contributions of ZERO-AD. We will also remove unnecessary rhetorical transitions and repetitive phrasing. These changes will improve the clarity of the scientific motivation without altering the proposed method.
Regarding Fig. 2, we appreciate the reviewer's observation about the arrow alignment and visual consistency. The figure was designed to summarize the complete ZERO-AD framework, including constraint learning, geometric regularization, calibration, and anomaly scoring, within a compact layout to accommodate the manuscript's space constraints. Consequently, some connectors and arrows were not optimally aligned. We agree that these minor presentation details can be improved and will provide a revised figure with consistent arrowheads, properly aligned connectors, and a clearer visual arrangement of the existing components. This refinement will improve readability while preserving the same computational flow and technical content.
We appreciate the reviewer bringing these presentation issues to our attention. We will address them through careful editing and figure refinement. Importantly, these revisions do not require changes to the proposed mathematical framework, experimental methodology, or reported results. We believe the improved presentation will allow the technical contributions and empirical findings to be assessed more clearly on their scientific merits.
Response: 3
We thank the reviewer for this observation and the opportunity to clarify the role of cross-variable dependencies in ZERO-AD. A key aspect of our framework is that normality is characterized through joint constraints over the entire multivariate temporal window, rather than independent per-variable modeling. This allows ZERO-AD to represent relationships among variables and identify anomalies arising from violations of learned joint behavior. Below, we explain the underlying mechanism and present additional controlled ablation experiments demonstrating its contribution to detection performance.
- Joint multivariate constraint learning. ZERO-AD does not learn separate constraints for individual variables. Instead, each constraint is defined over the complete multivariate window . The augmented input is
combining all variables and their temporal differences. The initial point-wise projection jointly maps these features into a shared hidden representation. Dilated depth-wise convolutions capture temporal patterns, while gated point-wise channel mixing enables interactions across learned features. The resulting representation is mapped to
Thus, each can depend jointly on multiple variables and their temporal evolution, rather than being restricted to an individual channel. This enables ZERO-AD to represent cross-variable relationships without requiring a predefined dependency graph.
- Cross-variable dependencies in the learned geometry. The geometric formulation also operates on the complete multivariate window. Equation (6) defines
Each Jacobian row characterizes the sensitivity of a constraint across the temporal-variable coordinates. Jacobian orthogonality encourages complementary local departure directions, while temporal consistency encourages invariance along observed normal evolution.
For example, two variables may normally satisfy a lagged relationship, . Both may remain individually within normal ranges while their relationship becomes anomalous. A learned joint constraint can respond to such a relational violation, which independent marginal modeling may overlook. This illustrates the type of dependency ZERO-AD can learn implicitly.
- Additional cross-variable ablation experiments. To evaluate this contribution directly, we conducted three controlled ablations following the TSB-AD-M evaluation protocol: (i) Dependency-destroyed, which disrupts cross-variable alignment while preserving channel-wise marginal and temporal behavior; (ii) Channel-independent ZERO-AD, which learns constraints separately for each variable and aggregates their scores; and (iii) Without cross-channel mixing, which removes gated point-wise mixing within the temporal blocks while retaining the initial multivariate projection.
The experimental results are summarized below:
| Variant | VUS-PR | VUS-ROC | Range-F1 | AUC-PR | AUC-ROC | Point-F1 |
|---|---|---|---|---|---|---|
| Dependency-destroyed | 0.379 | 0.731 | 0.372 | 0.335 | 0.724 | 0.418 |
| Channel-independent ZERO-AD | 0.406 | 0.765 | 0.391 | 0.352 | 0.755 | 0.421 |
| w/o cross-channel mixing | 0.418 | 0.771 | 0.411 | 0.364 | 0.763 | 0.441 |
| Full ZERO-AD | 0.437 | 0.780 | 0.435 | 0.396 | 0.782 | 0.470 |
Full ZERO-AD outperforms all three variants across all six metrics. Compared with channel-independent learning, VUS-PR improves from 0.406 to 0.437 and Point-F1 from 0.421 to 0.470, supporting the benefit of learning joint multivariate constraints. Removing gated cross-channel mixing reduces VUS-PR to 0.418, indicating the contribution of feature interactions within the temporal blocks. Disrupting cross-variable alignment produces the largest VUS-PR degradation (0.437 to 0.379), further highlighting the importance of preserving multivariate relationships.
These results provide direct empirical support that ZERO-AD's detection performance benefits from joint multivariate modeling rather than solely independent per-variable temporal patterns.
We will incorporate these additional cross-variable ablation results into the revised manuscript, either in the main ablation study (Section 5.2) or in the Appendix, depending on space availability.
Response:1
We thank the reviewer for the constructive feedback. We clarify that Eqs. (4)–(7) are consistent with ZERO-AD's formulation. To keep the manuscript concise, some intermediate definitions and connections were presented compactly. We recognize that this made the relationship between input augmentation, the constraint map, and its Jacobian difficult to follow. We clarify these steps below without changing the objectives or results.
1. Eqs. (4)–(5): Input and constraint map. For a window Z=[z1,…,zL]⊤∈RL×D, Eq. (4) defines Δz1=0 and Δzℓ=zℓ−zℓ−1 for ℓ=2,…,L. Thus ΔZ∈RL×D and U(Z)=[Z,ΔZ]∈RL×2D, with feature-wise concatenation. Writing the temporal network as gθ, the full mapping is
Fθ(Z)=gθ(U(Z))=[f1(Z),…,fK(Z)]⊤∈RK.
Hence U(Z) supplies observations and temporal changes; it is not another learned constraint map. Eq. (5),
Lzero=K1∥Fθ(Z)∥22,
encourages normal windows to satisfy the constraints, but alone permits the trivial solution Fθ≡0.
2. Eqs. (6)–(7): Jacobian and constraint geometry. The Jacobian is defined with respect to the original window:
Jθ(Z)=∂vec(Z)∂Fθ(Z)∈RK×LD.
As U(Z) is deterministic, the chain rule gives
Jθ(Z)=∂vec(U)∂gθ(U)U=U(Z)∂vec(Z)∂vec(U(Z)).
Thus each Jacobian row is a constraint gradient over the full multivariate window, including dependence through ΔZ. Eq. (7),
Lorth=∥Jθ(Z)Jθ(Z)⊤−IK∥F2,
encourages approximately unit-norm, mutually orthogonal local gradients, discouraging flat or redundant constraints. In particular, Fθ≡0 implies Jθ=0 and a nonzero orthogonality penalty; no global orthogonality is claimed.
3. Temporal network and geometric objectives. The network in Section 3.2 is a lightweight differentiable parameterization of Fθ, not a separate architectural novelty. Point-wise projection and channel mixing capture cross-variable interactions; dilated residual blocks capture temporal context; pooling and an MLP produce K constraints. This compact design is useful because Jacobian regularization adds training cost. The other objectives are complementary: Eq. (8) penalizes ∥Jθ(Z)vec(tZ)∥22 for a normalized transition between nearby normal windows; Eq. (9) preserves constraint satisfaction along a finite temporal step; and Eq. (10) encourages controlled finite-step growth in a sampled constraint-gradient direction. Together they shape sensitivity to departures while preserving observed normal temporal evolution.
4. Novelty, compactness, and evidence. We do not claim that zero-level sets or Jacobian regularization are individually new. ZERO-AD unifies (i) implicit normality constraints, (ii) complementary local departure geometry and temporal consistency, and (iii) detection through calibrated violations of those same constraints, without reconstruction or forecasting heads. This directly couples normality learning with anomaly evidence. Despite using only 0.07M parameters versus 0.3M for PaAno (approximately 4.3× fewer), ZERO-AD achieves the best aggregate results on five of six TSB-AD-M metrics (Table 1). Table 3 further confirms the contribution of geometric regularization through component ablations. These findings support competitive or improved detection performance with a substantially smaller model, although Jacobian-based training increases runtime.
We will revise Sections 3.2–3.3 to make the dimensions, composition, chain-rule derivation, and purposes of Eqs. (5)–(10) explicit, and clarify that the contribution is the geometry-aware constraint-learning framework rather than the backbone. We appreciate the reviewer's feedback on improving clarity.