- Rating
- 4
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies graph-level anomaly detection (GLAD) from the perspective of shared departures across an unlabeled population and introduces a new GLAD method called PopGLAD. PopGLAD represents graphs through normalized attributed WL counts and complementary size statistics, with normal data determining the feature weighting, precision estimates, and directional calibration. Each query is evaluated against the mean departure of the remaining graphs, allowing recurrent changes to contribute evidence even when individual distances are uninformative. Experiments on eight benchmarks demonstrate the effectiveness of PopGLAD.
Critical strengths
-
Methodological novelty. PopGLAD introduces a population-based scoring approach that captures structural deviations shared across graphs. The idea is novel and offers a valuable way to identify anomaly evidence that individual-distance scoring methods may overlook.
-
Theoretical contribution. This paper provides a bound on ranking error that accounts for uncertainty in the population reference and dependence between scores. The analysis clarifies when directional scoring offers an advantage over individual-distance scoring and links ranking reliability to the strength and stability of the estimated population direction.
-
Strong empirical results. PopGLAD achieves strong performance on seven of eight benchmarks. Ablation studies further support the benefits of population scoring, covariance estimation, and view fusion.
Critical weaknesses
-
Roles of weighting and calibration. As I understand it, the structural view employs a diagonal precision matrix to weight features and utilizes covariance information to normalize scores. However, the authors need to clarify the interaction between these two components and explain how correlations among WL features are handled.
-
Rationale for the fitting/calibration split. The authors should provide a more thorough justification for how normal data is partitioned, specifically, how they balance the estimation of normal statistics with the calibration of scores. This is crucial for bridging the practical implementation with the discussion of normal-center accuracy.
-
Connection between theory and empirical analysis. In Figure 5 and Theorem 1, the authors examine reference-direction stability using different transformations. However, the connection between the plotted cosine similarity and the theoretical analysis should be further clarified.
-
Specification of the denominator floor. The numerical value of is not explicitly given. The authors should clarify the practical effect on scoring.
Questions for authors
-
How do precision weighting and directional calibration work together when WL features are correlated? Moreover, what is the rationale behind using the same regularization parameter () for both stages?
-
Given that at most 128 calibration graphs are used, what is the basis for the split between the fitting set and the calibration set? I suggest that the authors provide a brief explanation of the balance between normal-statistic estimation and score calibration.
-
Could the authors explain how the observed cosine similarities support the theoretical claims regarding reference stability?