- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the supervised graph anomaly detection problem and proposes a role-aware GAD method. The motivation of this method is that anomalies are heterogeneous and fragmented while normal nodes follow a few recurring patterns. Role-GAD encodes nodes and edges with MLPs and quantizes them into a semantic-role codebook and an interaction-role codebook, respectively. Then each edge is represented as a <node role, edge, role, node role> triplet. The log-frequency of each triplet over the graph is added as a prior to the graph attention over the quantized representations, and the model is trained with weighted cross-entropy plus reconstruction and commitment losses. Experiments conducted on several graph benchmarks demonstrate the effectiveness and efficiency of the proposed method.
Critical strengths
- The proposed Role-GAD is based on a clear and well-motivated idea. Factorizing nodes and edges into discrete roles and using global triplet frequencies as a structural prior is an intuitive and fairly novel use of VQ for GAD.
- The proposed method is effective and more efficient compared to baselines. The training is less costly, with complexity linear in |E| for a fixed codebook size.
- Experiments are comprehensive. The paper reports the GAD performance, efficiency, and interpretability analyses of the learned roles. The appendix also covers weighted vs. unweighted loss, codebook utilization and collapse, the Hadamard term, EMA decay, loss weights, codebook size, etc.
Critical weaknesses
- The motivation is not completely new. Anomalies with low or heterogeneous homophily have been well studied in previous studies, e.g., BWGNN, GHRN, and others in the GAD heterophily literature. Additionally, two of the five datasets contradict one of the two observations.
- Although the proposed Role-GAD is well-motivated, it is based on empirical observations, and there is no theoretical analysis.
- The ablation studies (shown in Table 3) show that Interaction Role dominates in both roles. Interaction Role Only already reaches 90.37 AUPRC on YelpChi, versus 90.66 for Dual Roles. More explanations should be provided.
- Edge roles are a deterministic function of features. The roles are computed only from x_u and x_v, with no structural input, so an interaction role is essentially a cluster of feature pairs. This makes it unclear whether the role adds more information beyond a strong edge-feature attention.
- The baselines are a mix of results from CGADM and rerun with an added cross-entropy loss, which makes the comparison less fair.
- Unsupervised autoencoders outperform dedicated supervised GAD methods by a wide margin on YelpChi (GUIDE 91.48 and DOMINANT 86.69 vs. BWGNN 49.15 and GHRN 49.78). XGBGraph reaches 75.91 here, but 91.11 AUPRC under GADBench in Table 4.
- Some results are inconsistent. For example, Table 1 gives YelpChi AUROC 98.64, while Table 2 and D.1 give 97.88.
- Weighting is slightly worse on most datasets, then why is weighting the selected strategy in the experiments?
Questions for authors
- Why does the Interaction role achieve similar performance to the dual roles?
- Why does YelpChi Semantic Role Only have very low performance?
- Explain the design of the edge role (see above).
- Make a fairer comparison with all rerun results.
- Why are some results inconsistent?
4 comments
A4. Interaction Role Design and Its Contribution Beyond Edge-Feature Attention (W4 + Q3)
Interaction roles are learned from node features, but their purpose is not to introduce additional information. Instead, vector quantization maps similar interactions to shared discrete roles, allowing recurring interaction patterns to be explicitly identified. These learned interaction-role representations are directly incorporated into role-aware attention, enabling the model to distinguish different interaction patterns during message passing. Furthermore, interaction roles are combined with semantic roles to construct role triplets, whose global frequency statistics capture structural regularities and further guide message passing (Eqs. 10–12). Therefore, interaction roles not only provide explicit interaction representations for local message passing but also enable global role-triplet modeling, connecting local interaction patterns with global structural regularities.
A5. Baseline fairness and supervised/unsupervised comparisons (W5 + W6 + Q4)
Our main experiments (Table 1) follow the evaluation protocol of CGADM (NeurIPS 2025), a recent SOTA GAD method, using 20%/10%/70% train/validation/test splits and reporting average results over 10 random splits. Specifically, the supervised GNN and GAD baseline results are directly adopted from CGADM rather than rerun by us. To provide a more comprehensive comparison, we additionally include autoencoder-based GAD methods, which are predominantly unsupervised in their original formulations. This comparison is particularly relevant because Role-GAD also incorporates encoder–decoder architectures and reconstruction objectives to support role learning. These baselines are evaluated using the same data split protocol, with an additional cross-entropy loss to incorporate training labels and enable comparison under a supervised setting. The strong performance of GUIDE and DOMINANT on YelpChi is therefore not inherently contradictory, as different model architectures can exhibit different performance characteristics even under the same supervision setting.
Regarding XGBGraph, the difference between 75.91 AUPRC in Table 1 and 91.11 in GADBench reflects different evaluation settings. Specifically, Table 3 of the GADBench paper reports a 70% training ratio for YelpChi, whereas CGADM uses 20%. Thus, these results should not be directly compared under the assumption of identical experimental settings.
To further assess whether Role-GAD's effectiveness depends on the CGADM evaluation protocol, we additionally evaluate it against GADBench-reported baselines in Appendix D.2, covering seven datasets. Role-GAD achieves higher reported AUPRC across all seven comparisons, providing further evidence of its effectiveness across different evaluation settings. We will clarify the sources of baseline results, training configurations, and protocol differences in the revised manuscript.
A6. YelpChi AUROC inconsistency (W7 + Q5)
The two values correspond to different reporting purposes. Table 1 reports the average AUROC of 98.64 over 10 independent runs, with the corresponding standard deviation provided in Table 5 of Appendix D.3, demonstrating the stability of our results. In contrast, Table 2 and Appendix D.1 report the AUROC of 97.88 from one of these runs, which was selected for the convergence efficiency analysis. Therefore, the difference arises from reporting the average performance versus a single-run result, rather than inconsistent experimental settings. We will clarify this distinction in the corresponding table captions to avoid confusion.
A7. Why use weighted cross-entropy? (W8)
| Dataset | Weighted | Unweighted | p-value | |
|---|---|---|---|---|
| YelpChi | 94.90 ± 0.76 | 92.33 ± 0.93 | +2.57 | 0.00017 |
| Elliptic | 91.96 ± 0.18 | 92.05 ± 0.60 | −0.09 | 0.67849 |
| Tolokers | 50.08 ± 2.92 | 50.11 ± 1.74 | −0.04 | 0.97959 |
| Questions | 18.74 ± 0.31 | 17.83 ± 0.60 | +0.91 | 0.00118 |
| 11.45 ± 0.48 | 10.36 ± 1.06 | +1.08 | 0.02017 |
We adopt weighted cross-entropy to address class imbalance in graph anomaly detection, where anomalous nodes are typically much less frequent than normal nodes. To further examine its impact, we compare weighted and unweighted cross-entropy across five datasets. The results show that weighting improves AUPRC on YelpChi (+2.57), Questions (+0.91), and Reddit (+1.08), while having minimal impact on Elliptic (−0.09) and Tolokers (−0.04). These findings suggest that the benefits of loss weighting are dataset-dependent. We therefore adopt weighted cross-entropy as a consistent training strategy rather than selecting the loss function separately for each dataset.
The authors' rebuttal addresses most of my concerns, except for novelty and theoretical analysis. I have therefore increased my rating.
We sincerely thank the reviewer for carefully reconsidering our rebuttal and for increasing the rating. We appreciate the recognition of our efforts to address the concerns.
Regarding the remaining concerns, we would like to reiterate that our key contribution lies in jointly modeling semantic and interaction patterns through discrete roles and their global compositions, rather than simply revisiting heterophily in GAD. We will further clarify this distinction and the empirical evidence supporting our design in the revised manuscript. We thank the reviewer again for the constructive feedback.
We thank the reviewer for the constructive feedback. We acknowledge that some experimental settings and details were not sufficiently clarified, which may have caused confusion. We provide detailed clarifications below.
A1. Novelty and empirical motivation (W1)
We agree that heterophily in graph anomaly detection has been extensively investigated. However, our work addresses a different aspect of anomaly heterogeneity. Specifically, BWGNN analyzes the spectral energy shift caused by anomalies and designs wavelet filters to capture high-frequency signals, while GHRN identifies and prunes heterophilic edges to reduce their negative influence on message passing. In contrast, our analysis examines both feature diversity and neighborhood composition, motivating the explicit modeling of recurring semantic and interaction patterns rather than treating heterogeneous connections primarily as signals to filter or remove.
We acknowledge that Elliptic and YelpChi are exceptions to the corresponding observations. Importantly, Role-GAD does not assume that anomalies must exhibit low homophily or dispersed features. Instead, we propose dual semantic and interaction role codebooks, allowing different interaction patterns to be distinguished and further combined into global role triplets for role-aware message passing. Therefore, our novelty lies not in rediscovering heterophily, but in jointly modeling recurring semantic and interaction patterns through discrete roles and their global compositions.
A2. Theoretical motivation and analysis (W2)
We acknowledge that Role-GAD is empirically motivated and does not currently provide formal theoretical guarantees. However, the proposed design is supported by both its modeling mechanism and empirical analysis. Discrete semantic and interaction roles enable the construction of reusable role triplets, whose global frequencies are incorporated into role-aware message passing (Eqs. 10–12). Section 4.3 provides further empirical evidence: Figure 3 shows that frequently occurring semantic roles are predominantly associated with normal nodes, while Figure 4 demonstrates that role triplets capture not only common Normal–Normal interactions, but also distinct patterns associated with Anomaly–Anomaly and Anomaly–Normal interactions. Together with the improvements from global role-triplet modeling in Table 3, these findings support the effectiveness of role-based modeling, although they do not constitute a formal theoretical guarantee.
A3. Detailed ablation analysis
To clarify the ablation settings in Table 3, Role-GAD uses 256 semantic and 64 interaction prototypes on YelpChi. Interaction Role Only retains the original node features while learning 64 interaction roles, without semantic quantization. In contrast, Semantic Role Only quantizes node features into 256 semantic roles but removes interaction-role learning. Since YelpChi contains only one untyped edge relation, this variant cannot explicitly distinguish different interaction patterns.
On YelpChi, Interaction Role Only achieves 90.37 AUPRC, close to 90.66 for Dual Roles. This may be attributed to YelpChi's highly homophilic anomaly patterns, where modeling pairwise interactions already provides strong discriminative signals, while the original node features preserve semantic information without quantization. While semantic quantization alone brings a modest improvement, global role-triplet modeling further increases AUPRC from 90.66 to 94.90, highlighting the value of combining semantic and interaction roles for global role-aware message passing. These results suggest that the contribution of semantic roles extends beyond local quantization to supporting global role-triplet modeling.
On YelpChi, Semantic Role Only compresses node features into 256 semantic prototypes, while the graph contains only a single untyped edge relation. Without learned interaction roles, the model cannot explicitly distinguish heterogeneous pairwise interaction patterns, resulting in a low AUPRC of 18.57. This highlights the limitation of relying solely on semantic roles to capture the diverse interaction patterns in YelpChi.