- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper presents RECAP, a label-free framework for generalist graph anomaly detection. The method performs graph-wise feature preprocessing and constructs multi-hop ego-neighbor residual representations. It then builds a residual-similarity graph and learns soft residual-community assignments. At test time, target-specific community prototypes are derived from the predicted assignments, and anomaly scores are computed using prototype deviation together with a neighborhood-context inconsistency term. Experiments show improvements on the given datasets compared to the given baselines.
Critical strengths
- The paper targets a meaningful and difficult setting.
- Experiments show improvements on given datasets compared to given baselines.
Critical weaknesses
- The evaluation seems to tune hyperparameters on the unseen target graphs. The main page describes Setting A as training on PubMed, Flickr, Questions, and YelpChi and testing on eight unseen target graphs. However, Appendix D.4 states that these experiments train on PubMed/Flickr/Questions/YelpChi and evaluate on Facebook, Cora, CiteSeer, ACM, BlogCatalog, Weibo, Reddit, and Amazon. It looks like test model selection uses target labels.
- The experiments do not prove that "transferable residual-community learning" is useful. Removing the proposed community-consistency loss and the assignment regularization changes performance little. The two losses for learning the proposed residual-community structure contribute almost nothing to final gains.
- RECAP fits PCA independently on every graph, including every target graph, before feeding the result into a shared MLP. This makes dimensionality equal, but it does not prove cross-graph coordinate alignment.
Questions for authors
- Can the authors rerun the experiments where test graphs are never used for hyperparameter selection?
- What evidence demonstrates that source-trained community learning itself is necessary for the gains?