- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper presents SVStMFM for learning feature-state dependence in high-dimensional anomaly detection. The method uses Bernoulli structural variables to adaptively learn component-dependent and component-invariant parameters without removing observed variables. A low-rank Student-t factor structure captures high-dimensional correlations and heavy-tailed behavior. Structured variational Bayesian inference jointly learns latent states and variable structures. A marginal-conditional decomposition of the Student-t distribution yields a locally adaptive anomaly score. Experiments on the Tennessee Eastman process and real industrial data report improved anomaly-detection performance over the comparison methods while reducing model parameters by 83.1%.
Critical strengths
The robust Student-t mixture factor model is a clear strength. Its low-rank latent representation reduces the complexity of modeling high-dimensional correlations. Local scale variables yield a robust Student-t representation within a single probabilistic framework. Appendix B.1 shows the model size depends approximately linearly on the observed dimension. Figure 6 reports 1213 parameters against 7159 for VBStMM.
Critical weaknesses
W1. Consistency of the main results on the Tennessee Eastman process. Section 4.1 and Appendix D.1.1 use a 72 h sequence for testing with faults injected at 60 h and a sampling interval of 3 min. This setup gives 1200 normal samples and 240 faulty samples in each test sequence. The reported results instead correspond to 160 normal samples and 800 faulty samples per fault. Every per-fault FAR of the three comparison methods in Table 2 is a multiple of up to rounding. The Accuracy values of all seven comparison methods in Table 1 also match this split. The FAR and DR of GMM would give an Accuracy of under the stated setup instead of the reported .
Averaging the per-fault results of VBStMM in Table 2 over the 21 faults reproduces its Table 1 values of FAR , Accuracy , and F1 up to rounding in the last digit. The same averaging does not reproduce the SVStMFM row. The per-fault results of SVStMFM give FAR , Accuracy , and F1 against the reported , , and . The reported Accuracy of SVStMFM also falls below both its proportion of correctly identified normal samples of and its DR of . A single confusion matrix cannot produce these three values for any split of normal samples and faulty samples.
The paper does not define Accuracy. Eq. (85) defines only FAR, DR, Precision, and F1. The main results on the Tennessee Eastman process are therefore difficult to verify.
W2. Insufficient isolation of feature-state dependence learning. Section 4.3 states that Table 2 isolates the effects of heavy-tailed modeling and variable-level structure learning. Appendix D.1.3 attributes the improvement of the mean DR from to over VBStMM to variable partitioning.
Yet SVStMFM also differs from VBStMM in the low-rank factor representation and in the anomaly score with responsibility weighting and EMA accumulation. Figures 5 and 10 compare the VBStMM NLL with the SVStMFM weighted NLL + EMA. Appendix D.1.3 explains the more stable monitoring curves of SVStMFM by responsibility weighting and EMA accumulation. The comparison therefore leaves open how much of the improvement comes from learning which variables share parameters across mixture components. VBStMM-NS appears only in Table 2 and is never defined. Its role as the ablation of variable-level structure learning remains unclear.
The reduction of model parameters by 83.1% likewise combines the low-rank factor representation with cross-component parameter sharing. Removing cross-component parameter sharing would give each of the 23 component-invariant variables parameter sets instead of one. Eq. (47) with the 29 component-dependent variables reported in Section 4.3 bounds the resulting increase by a factor of for any at fixed . The model without this sharing would still have fewer than 2175 parameters and remain about 70% below the 7159 parameters of VBStMM in Figure 6. At most about 13 of the 83.1 percentage points can therefore come from cross-component parameter sharing. The current evidence does not isolate the benefit of the variable-level component-dependence structure-learning mechanism in contribution (1).
Questions for authors
Q1. Experimental setup and metric definitions on the TEP dataset. The per-fault FAR values in Table 2 indicate 160 normal samples per fault. A 72 h test sequence with faults injected at 60 h contains 1200 normal samples. Counting the 60 h from the start of the 48 h training data would leave 240 normal samples in the test sequence. Which test data produce the 160 normal samples per fault? How do the six operating conditions enter Tables 1 and 2?
Please report the numbers of normal samples and faulty samples and the TP, FP, TN, and FN counts for each fault and operating condition. Please also give the definitions of Accuracy and AUC and state how each metric in Table 1 is averaged over faults and operating conditions. How do these counts reconcile the SVStMFM row of Table 1 with its per-fault results in Table 2 and with its own FAR and DR?
Q2. Ablation of variable-level structure learning. Could the authors define VBStMM-NS? Its DRs of on d04 and on d14 fall far below those of the other three models in Table 2. These three models reach or higher on both faults. Is VBStMM-NS the SVStMFM model retrained with for every variable under the same number of mixture components, latent-factor dimension, prior hyperparameters, anomaly score, EMA smoothing coefficient, and control limit?
Please add this ablation if VBStMM-NS is a different model and report its DR, FAR, AUC, and parameter count next to SVStMFM. Please also state the latent-factor dimension and the final number of mixture components used for SVStMFM. How much of the gain in anomaly-detection performance and of the reduction of model parameters remains attributable to learning the variable structure when these settings are held fixed?
Q3. Per-fault comparison across decision thresholds. The FAR of SVStMFM under the 95% control limit ranges from on 14 faults to on d21. Its DR of on d03 comes with an FAR of . Do the comparison methods in Tables 1 and 3 use the same EMA accumulation? Could the authors report the per-fault AUC of all methods or their DR at the same FAR?
Q4. Hyperparameter settings. The hyperparameters , , and in Appendix D.1.2 do not appear in the Normal-Gamma priors of Eqs. (11) to (14). The hyperparameters , , and of these priors are not reported. Could the authors give the complete hyperparameter settings? How is set before the variable structure is learned? Table 1 reports DAGMM instead of the DPGMM listed among the comparison methods in Appendix D.1.2.
Response to Critical Weakness 1
Thank you very much for pointing out these important issues. We re-examined the experimental code, original prediction results, and data-splitting procedures. We have now unified the experimental settings and recomputed the reported results in the revised manuscript.
First, regarding the metric inconsistency in Table 1, we reran the experiments on the TEP dataset and consistently recomputed FAR, DR, Accuracy, Precision, F1, and AUC from the same binary predictions using a unified aggregation protocol. After correction, SVStMFM achieves an average FAR of 0.0467, DR of 0.9310, Accuracy of 0.9347, and F1 score of 0.9515. The related results in the tables and main text have been updated accordingly.
Second, we confirm that the original manuscript incorrectly described the duration and fault-injection time of the TEP test sequences. In the actual experiments, each test sequence contains 960 samples with a sampling interval of 3 min, corresponding to 48 h in total. The first 160 samples (8 h) represent normal operation, and the fault is introduced from sample 161 onward, leaving 800 faulty samples. Therefore, the fault onset around sample 160 in Fig. 5 is consistent with the actual experimental protocol. The original description of “72 h testing with fault injection at 60 h” has been corrected to “48 h testing with fault injection after the first 8 h,” and the corresponding descriptions in the main text, figure captions, and appendix have been revised consistently.
Third, we have clarified the data split for the SRCC dataset. The SRCC dataset contains a total of 46,291 samples, including vibration- and temperature-related variables. Among these samples, 37,033 are used for training and 9,258 are used for testing.
Thank you again for identifying these inconsistencies. These revisions ensure consistency among the experimental protocol, evaluation metrics, dataset splits, and reported figures, thereby improving the transparency and reproducibility of the experimental evaluation.
Updated per-fault results on the TEP dataset