acceptodds
Under review as a conference paper at ICLR 2027

Spectral Topology Diffusion on Memory Residuals for Anomaly Detection in Dynamic Graphs

Abstract

Anomaly detection in continuous-time dynamic graphs (CTDGs) aims to identify nodes whose behavioral patterns deviate from the normal majority within an evolving edge stream. Two critical yet underexplored requirements complicate practical application: a model trained on a labeled source domain should generalize to unseen target domains without fine-tuning, and it should maintain stable discrimination across diverse temporal gaps from short-interval bursts to extended-dormancy horizons. Existing methods based on self-supervised contrastive learning or reconstruction objectives tend to overfit domain-specific distributions and couple anomaly scoring with the immediate temporal context, limiting transferability and temporal robustness. We propose TopoDiff, a topology-aware diffusion framework that models the generative distribution of memory residuals, defined as the difference between a node's posterior and prior memory representations after an interaction. For normal interactions, these residuals empirically exhibit structured, topology-conditioned patterns that remain more consistent across domains and time scales than raw embeddings, whereas anomalous events produce significant deviations. A stable topology projection built on a Chebyshev polynomial basis over the spectrum of the normalized graph Laplacian yields a positive definite spectral operator, whose inverse is efficiently solved via batched conjugate gradient on event-induced subgraphs. A denoising diffusion process conditioned on the projected topology and filtered residuals learns the normal residual distribution in a latent space. Experiments demonstrate that TopoDiff achieves strong zero-shot cross-domain generalization and stable performance across short-term and long-term horizons.

Primary area:
learning on graphs and other geometries & topologies
Keywords:
graph anomaly detection, memory networks, continuous-time dynamic graphs, graph representation learning

Reviews

Among:
Shape:
1234this paper, Top 30%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.67 over 3 reviews, above 70% of the others.
Reviewer_rWnAOpenReview ↗
Rating
3
Confidence
2
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper proposes TopoDiff, which models memory residuals with topology-conditioned diffusion for anomaly detection in continuous-time dynamic graphs.

Critical strengths
  1. Extensive experiments and ablation studies support the method’s effectiveness.

  2. The proposed approach seems reasonable overall.

Critical weaknesses
  1. The paper does not provide sufficient evidence that memory residuals are more consistent across domains than raw embeddings. Showing actual residual distributions across datasets would help support this claim.

  2. Several design choices need clearer justification, particularly inverse spectral projection and the use of diffusion rather than simpler residual models. Eqs. (7) and (8) are differently weighted versions of the same noise prediction error, but their complementary value is not established.

  3. The cross-domain results lack analysis. Transfer from MOOC to Bitcoin is weaker than transfer from the other source datasets, while CTDG-SSM is competitive on MOOC-to-Bitcoin-OTC. These differences deserve further discussion.

Questions for authors
  1. Can the authors show the memory residual distributions for normal and anomalous events across datasets, and compare their cross-domain consistency with raw embeddings?
  2. The paper distinguishes its approach from snapshot-based graph generation, but the event-induced subgraph appears to be a local snapshot. How is temporal ordering used in its spectral processing?
  3. Why is inverse spectral projection needed, and what does diffusion offer over simpler residual models? Does combining Eqs. (7) and (8) improve performance over using either alone?
  4. Why is MOOC-to-Bitcoin transfer weaker, and why does CTDG-SSM perform relatively well on MOOC-to-Bitcoin-OTC? Could the authors evaluate the reverse B to A transfers to examine whether generalization depends on the transfer direction?
  5. The anomaly scores are evaluated at a fixed set of diffusion steps. How are these steps chosen, and how does the selection balance detection performance against inference cost? Is the same selection strategy used across datasets and in zero-shot cross-domain transfer?
3 comments
AuthorsOpenReview ↗

Residual distributions, the inverse projection, transfer direction, and the diffusion-step rule

We thank the reviewer for the precise questions.

For W1 and Q1:

Residual against raw-memory consistency, and the requested distributions.

Answer.

The residual is the consistent representation. Its normal energy keeps a shared range across the six domains while the prior and posterior energies do not.

Evidence and revision.

Appendix A.7.1 adds Table 10 and Figs. 8-9 with the requested distributions, the prior and posterior columns being the raw-memory comparison. Prior and posterior energy are below chance on all six while residual energy is above chance on five, and the anomaly-to-normal ratio runs from 1.45 to 4.29 with Amazon inverting to 0.58. The mean pairwise Wasserstein-1 distance of normal per-coordinate energy is 3.34e-4 for residuals against 1.31e-3 for priors and 1.56e-3 for posteriors.


For Q2:

The subgraph as a local snapshot, and how temporal ordering enters the spectral processing.

Answer.

Temporal order enters through the history-visible edge set, the attention weights that form the node embeddings and the continuous-time encoding in Eq. (5), not through the Laplacian spectrum.

Evidence and revision.

Sec. 4.2 now states this, calls the subgraph a causal snapshot, and notes that the eigenvalues of L_t carry no ordering information.


For W2 and Q3:

Why the inverse projection and diffusion over simpler residual models, and whether Eqs. (7) and (8) are complementary.

Answer.

The inverse is a scale-comparability device rather than an accuracy device, diffusion adds conditioning a fixed residual density cannot express, and Eqs. (7) and (8) are two scalings of one error whose sum matches the better term.

Evidence and revision.

Proof C.1 bounds the spectrum of p(L_t) in an interval independent of the subgraph, which lets the inverse rescale every spectral component by a bounded factor on any graph. Table 11 in Appendix A.7.2 retrains the identity inverse, a Gaussian density and a prior-posterior concatenation, and all three trail the reported model on all six. Table 13 in Appendix A.7.4 reads the components out at step 50, where s1 and s2 differ by at most 0.20 AUROC and their equal-weight sum never exceeds the better term. s2 is retained for scale removal under transfer rather than as a second ranking (Sec. 4.4), s3 is the independent component and leads on Wikipedia, Bitcoin-Alpha and Bitcoin-OTC.


For W3 and Q4:

Why Mooc to Bitcoin is weaker, why CTDG-SSM is competitive there, and whether the reverse transfers were run.

Answer.

One cause explains both observations. The four-dimensional Mooc edge features force the edge projection layer to be rebuilt on every transfer into or out of Mooc, while the HiPPO memory of CTDG-SSM needs no such projection. All eighteen directed pairs were evaluated. The rebuild is symmetric, and the direction comes from the target feature space the reinitialized layer faces. The most direct reading is that a transfer into Mooc faces action features carrying far less information than the 172-dimensional space the other five share, which leaves that layer little structure to recover and gives the weakest group of Table 17 at 49.53, 51.36 and 56.24. A transfer out of Mooc faces that shared space, where the residual normalization of Sec. 4.1 absorbs the scale of a fresh layer, and those three span 56.51 to 72.72.

Evidence and revision.

Sec. 5.3, Appendix B.1, A.7.6 and Table 17 carry this analysis. On Mooc to Bitcoin-OTC, CTDG-SSM reaches 67.51 against 69.43 and takes AUPRC 19.37 against 17.53, the only pair in Table 2 where a baseline leads a metric. Clearing the inherited memory moves that pair to 62.77 while leaving Wikipedia to Bitcoin-Alpha at 73.76, which Appendix A.7.6 reads as the memory carrying part of the transfer once the projection is rebuilt.


For Q5:

How the steps are chosen, the detection-against-cost balance, and whether the strategy is shared.

Answer.

One shared step, 50, fixed a priori for every dataset and every transfer at the midpoint of the cosine schedule where the retained-signal coefficient is about 0.5. The per-event cost is flat across steps, which leaves no trade-off.

Evidence and revision.

Sec. 4.4 and Appendix A.7.4 give the rule, Table 15 lists s1 at steps 10, 25, 50, 75 and 90 with every entry inside a 43.70 to 57.58 band, and Table 16 gives the batched cost, which changes by under 0.01 ms per event between steps 10 and 90. Table 15 is the s1 read-out rather than the final metric, and step 50 was fixed before any target measurement, since choosing the best step per dataset would be a target-side choice the protocol excludes. Appendix A.7.6 states that the scoring weights and the step are inherited by all eighteen transfers.

New in the revision: Appendix A.7.1 to A.7.6 with Tables 10 to 17, Figs. 8-9, and clarifications in Sec. 4.1, 4.2, 4.4 and 5.3.

Thanks for the author's response, which addressed most of my concerns. I will maintain my positive rating.

We thank Reviewer rWnA for the positive rating and are pleased that our response addressed most of the concerns.

Reviewer_MNXAOpenReview ↗
Rating
3
Confidence
4
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

TopoDiff detects node anomalies in continuous-time dynamic graphs. It models memory residuals, but includes a conditional diffusion model which learns the distribution of normal residuals. Thus, allowing discrimination on anomalous residuals. The resulting diffusion and topology anomaly score is fused with a supervised classifier reporting state-of-the-art results on anomaly detection, zero-shot cross-domain transfer, and robustness to temporal gaps.

Critical strengths
  • Best performing results on cross-domain zero-shot evaluation compared to previous methods.
    • These experiments should be common in the evaluation of methodology that has application in real-world datasets, since cross-domain generalization is often the scenario in which they will deployed.
    • As such, these empirical results demonstrate a superior method, without introducing too much computational overhead, that generalizes to cross-domain graphs in anomaly detection
  • Well defined and stated methodology with a novel three-component anomaly scoring scheme
  • Short-term/long-term study
    • The robustness to short-term and long-term anomaly detection makes this methodology more practical in a real-world setting.
Critical weaknesses
  • Does the diffusion component account for gains?
    • The ablation study shows that in many cases removing diffusion marginally changes the AUROC. However, there are cases where there are significant gains.
    • Similarly, the performance gains attributed to diffusion are within the variances reported. For example, Table 5. under AUROC for Amazon. There are many large variance reported without diffusion.
    • This potentially suggests that the diffusion process isn't the main component that gives the superior performance
Questions for authors

Clarifications for weaknesses.

3 comments
AuthorsOpenReview ↗

What the diffusion component carries: rare-anomaly precision and the stability of the ranking head

We thank the reviewer.

For W1:

Does the diffusion component account for the gains, given the marginal and within-variance AUROC ablation.

Answer.

The diffusion objective carries rare-anomaly precision and the stability of the ranking head, and its AUROC effect is dataset-dependent rather than uniform. Removing it lowers AUPRC on all six datasets and lowers AUROC by 5.36 on Reddit and 11.72 on Bitcoin-OTC, while on Wikipedia, Mooc and Bitcoin-Alpha the change is 0.06 to 0.35 where the classification head already saturates. On the variance point we agree with the reviewer's reading of Table 5 and we would add that the large AUROC deviations on Amazon, Bitcoin-OTC and Reddit are produced by the removal itself rather than being a property of the model. The AUROC deviation is ±0.08 for TopoDiff against ±7.04 for W/Diffusion on Amazon, ±0.05 against ±6.27 on Bitcoin-OTC, and ±0.06 against ±2.77 on Reddit. Stabilizing the ranking head is therefore a second effect of the component, alongside AUPRC, and Appendix A.7.3 quantifies the Amazon spread with three seeds.

Evidence and revision.

Sec. 5.2 and the new paragraph of Appendix A.2 state this attribution. Tables 5 and 6 give the ablation, and the row that removes the classification loss drops AUROC by 14.64 to 30.77 points on five of the six datasets, the exception being Amazon at 0.43, which shows that the AUROC margins are carried mainly by the supervised head:

DatasetAUROC withAUROC withoutAUPRC withAUPRC without
Wikipedia90.2890.095.651.91
Reddit73.2167.850.590.28
Mooc78.3878.036.385.56
Bitcoin-Alpha78.8778.8120.2419.51
Bitcoin-OTC77.0965.3722.4414.28
Amazon60.3351.79 (std 7.04)22.2915.61

The AUPRC drop is positive on all six and exceeds the reported deviation on five of them, the exception being Reddit where 0.59 carries a deviation of 0.51. Appendix A.7.3 measures a different quantity from W/Diffusion. It holds the logit mixture of Eq. (11) at zero in both arms, so the two arms share one head and the difference bounds run-to-run variation:

SeedAUROC withAUROC withoutAUPRC withAUPRC without
7360.8760.4420.7920.45
7461.5161.3523.8624.25
7561.6560.9722.8621.72
Mean61.3460.9222.5022.14

That bound is 0.42 AUROC and 0.36 AUPRC over the three seeds and lies inside the seed range, while the 6.68 AUPRC of Table 5 is the effect of the whole component. Appendix A.7.3 now reports the seed spread instead of a single Amazon number, and the reported entry of Tables 1 and 5 remains 60.33.

To keep the Amazon numbers apart, 60.33 in Tables 1 and 5 is the seed-averaged reported entry, 60.27 in Table 14 is the same model under the checkpoint replay of Appendix A.7, 61.34 against 60.92 in Table 12 is a separate three-seed study with the logit mixture of Eq. (11) held at zero in both arms, and 56.46 is that replay after the mixture is added post hoc at coefficient 0.1, which stays within 0.2 AUROC on the other five. Appendix A.7.4 with Tables 13 and 14 adds the per-component read-out at the shared diffusion step.

New in the revision: Appendix A.7.3 and A.7.4 with Tables 12 to 15, and the attribution paragraph in Sec. 5.2 and Appendix A.2.

I thank the authors for answering my questions and providing detailed experiments which address my concerns. These experiments strengthen the paper and I will consider this in the final evaluation.

We thank Reviewer MNXA for the positive assessment and for the constructive feedback throughout the review process. We are glad that the additional experiments have addressed the concerns and further strengthened the paper.

Reviewer_NLTMOpenReview ↗
Rating
2
Confidence
4
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes TopoDiff, a topology-aware diffusion framework for anomaly detection in continuous-time dynamic graphs. It models normal memory residual distributions using Chebyshev-based spectral topology projection and conditional diffusion.

Critical strengths
  1. Memory Residual Modeling: The paper introduces a memory residual-based approach. Instead of focusing on memory states as in conventional methods, it captures the changes in memory representations caused by interactions.

  2. Conditional Diffusion: The paper employs conditional diffusion to model normal memory residual distributions given historical and topological context.

Critical weaknesses
  1. The paper does not sufficiently justify why memory residuals are preferable to directly using pre- and post-interaction memory embeddings. It remains unclear whether simple embedding subtraction can effectively capture complex behavioral changes.

  2. The paper should more clearly explain the scope and limitations of its cross-domain generalization capability. In particular, what types of domain differences can TopoDiff handle, such as differences in graph structures, feature dimensions, and feature distributions? Additionally, how does the model maintain consistent representations across domains without target-domain fine-tuning?

  3. The experiments appear to focus only on node-level anomaly detection. Can the proposed method also be applied to edge-level and graph-level anomaly detection?

Questions for authors

See Critical Weaknesses

1 comment
AuthorsOpenReview ↗

Memory residuals, the measured scope of zero-shot transfer, and edge- and graph-level detection

We thank the reviewer.

For W1:

Why residuals rather than the raw pre- and post-interaction memories, and whether simple subtraction can capture complex behavioral change.

Answer.

The residual form is the right input and it discards nothing. The map from a memory pair to a prior and a residual is invertible, Eq. (5) conditions on both priors and Eq. (4) encodes the residuals together with their topology-filtered response. What the subtraction removes is the accumulated activity scale of the prior, which is domain-specific and points away from the label on all six datasets, while the nonlinear structure of a behavioral change is carried by the conditional diffusion rather than by the difference.

Evidence and revision.

Sec. 4.1 states the argument. Appendix A.7.1 with Table 10 and Figs. 8-9 gives the normal and anomalous energy per coordinate for the residual, the prior and the posterior, and the best of the seven simpler statistics scored there trails TopoDiff on every dataset. Table 10 replays the saved checkpoints with memory reset, which is why its TopoDiff column differs from the seed-averaged entries of Tables 1 and 5. Appendix A.7.2 with Table 11 retrains the alternatives end to end, and its concatenation column is exactly the pre- and post-interaction input the reviewer asks about, fed as a pair instead of a difference, compared against the reported model of Tables 1, 5 and 6:

DatasetConcatenationGaussian for diffusionTopoDiff
Wikipedia90.1889.8290.28
Reddit69.0670.5973.21
Mooc78.0377.3778.38
Bitcoin-Alpha78.4978.2278.87
Bitcoin-OTC76.1976.2577.09
Amazon60.0754.3960.33

Five of the six margins are below one point and none is within noise, since Tables 5 and 6 report the deviation of the TopoDiff arm per dataset and every concatenation gap exceeds its own, the tightest case being Wikipedia at 0.10 against ±0.02 and the largest Reddit at 4.15. The identity-inverse arm of the same table trails on all six as well.


For W2:

The scope and limitations of cross-domain generalization, which domain differences are handled, and how representations stay consistent without fine-tuning.

Answer.

Graph structure and feature distribution are absorbed by construction, feature dimension is absorbed by rebuilding only the edge projection, and the measured boundary is a sign inversion of the anomaly-to-normal residual-energy ratio between source and target.

Evidence and revision.

Appendix A.7.6 states this per axis, with Sec. 5.3 and the transfer protocol of Appendix A.6. Proof C.1 bounds the spectrum of p(L_t) in an interval that does not involve the subgraph and the memory is zero-padded to the target node count, which is why a 330,317-node Amazon model reaches 78.33 on Wikipedia and Bitcoin-OTC reaches 77.19 on Bitcoin-Alpha. The rebuilt projection is a shape-matched reinitialization that uses no target label, no gradient step and no target statistic, and Mooc to Bitcoin-OTC still reaches 69.43 against 67.51 for CTDG-SSM. Consistency without fine-tuning is measurable by clearing the inherited memory, the only inherited state populated from the target stream, which leaves Wikipedia to Bitcoin-Alpha at 73.76 and moves Mooc to Bitcoin-OTC to 62.77.

Transfer becomes direction-dependent where the anomaly-to-normal residual-energy ratio inverts between source and target. Amazon is the only such case at 0.58, and Bitcoin-Alpha to Amazon gives 45.92, the lowest entry of Table 17, against 75.33 in the other direction.


For W3:

Whether the method extends to edge-level and graph-level detection.

Answer.

Both settings are now evaluated. Edge-level gives TopoDiff the best AUROC on 4 of 6 and the best AUPRC on 5 of 6. Graph-level gives the best AUROC on 5 of 6 and the best AUPRC on 4 of 6.

Evidence and revision.

Sec. 5.2 points to both settings. Appendix A.7.7 with Table 18 reports the edge-level results and states the protocol, and Appendix A.7.8 with Table 19 reports the graph-level results and states the construction. Both metrics are taken together on Reddit, Mooc, Bitcoin-Alpha and Bitcoin-OTC at edge level and on Reddit, Mooc and Bitcoin-OTC at graph level. Two datasets break an otherwise clean sweep: CTDG-SSM leads both edge-level metrics on Wikipedia, 97.40 against 96.97, and MHisCL leads edge-level AUROC on Amazon, 68.21 against 61.44, where TopoDiff still takes AUPRC at 64.13 against 63.05.

New in the revision: Appendix A.7.1 to A.7.8 with Tables 10 to 19, Figs. 8-9, and clarifications in Sec. 4.1, 5.2 and 5.3.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.