- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
To address the challenge in dynamic graph learning of balancing short-term changes with long-term dependencies, as well as the common issue of overlooking interaction sequence, this paper proposes the DSRD method. Its core idea is to integrate the retention of historical information with message passing between nodes, dynamically adjusting the influence of historical context based on interaction characteristics while preserving chronological sequence. This enables a better understanding of how relationships evolve over time. Experiments on multiple real-world datasets demonstrate that DSRD generally outperforms most baseline methods in link prediction and node classification tasks, all while maintaining good computational efficiency.
Critical strengths
The paper jointly models temporal and structural dependencies in dynamic graphs by integrating adaptive temporal retention and high-order structural diffusion within a shared retentive state. Learnable decay kernels and gated state updates allow the model to balance short-term responsiveness and long-term retention. The experimental evaluation is also solid, covering link prediction on multiple real-world dynamic graph datasets under both transductive and inductive settings with three negative sampling strategies, where DSRD demonstrates consistently strong performance.
Critical weaknesses
Despite the extensive experimental evaluation, the additional benefits of the core design choices over existing methods remain insufficiently established. The ablation studies support the usefulness of individual components, but more targeted comparisons are needed to isolate the gains from learnable decay kernels and from coupling temporal retention with structural diffusion within a unified retentive state.
Questions for authors
How much does DSRD benefit from learning the decay parameters compared with using well-tuned fixed values?
Response to Reviewer FL5D
Thank you for the constructive review. It is encouraging that you consider the joint modeling of temporal retention and structural diffusion a strength and the experimental evaluation solid. Our point-by-point responses to the Questions (Q) follow. All changes in the revised paper are highlighted in blue.
RQ1: We appreciate this insightful question. To quantify the contribution of adaptive decay, we evaluated two controls that keep the architecture and decay functions unchanged. Fixed decay fixes γ(ℓ), λ, α and δ(ℓ), while fixed γ only fixes γ(ℓ) and learns the remaining decay terms. Constants are selected by validation AP via grid search. The all-fixed search includes different time scales across layers and heads. All results below are inductive AP under random negative sampling.
DSRD is higher on all datasets except UCI, where the fixed controls are better. Tuning all decay constants is clearly stronger than fixing γ alone on US Legis. (+10.90%). Careful tuning can therefore help, but its accuracy is bounded by the grid resolution and its cost grows with the number of decay parameters, as our all-fixed search already requires 15 training runs per dataset. DSRD learns these parameters end-to-end in a single training run and exceeds the tuned fixed decay by more than 9% on MOOC, Enron, US Legis. and UN Trade.
RQ2: We are grateful for this thoughtful suggestion. To test the benefit of coupling directly, we added a separate state control whose temporal recurrence never reads the structurally propagated state. A second state bank stores structural propagation, and the two output embeddings are averaged. Projection and feed-forward weights are shared. We also evaluated temporal-only recurrence without diffusion. Each architecture is tested with learned decay and with the same fixed constants selected in RQ1.
DSRD (full) outperforms the temporal-only and separate-state variants on all datasets except UCI. Compared with the separate-state variant, the gains are largest on long-span datasets (e.g., US Legis. +27.39%, UN Trade +23.54%, Enron +12.62%, MOOC +12.47%), while the one-month Wikipedia and Reddit differ by less than 2%. Under the same fixed decay, the shared-state model (Fixed decay in RQ1) also exceeds the separate-state and temporal-only controls, by up to +16.56% and +26.40% on UN Trade. Appendix C.9 shows that DSRD learns strong long-term retention on long-span datasets, so structural context helps most when it is retained in the same state over long horizons.
In addition, separate states double the persistent-state storage (144.19 → 288.38 MiB on Wikipedia) and require an additional query projection, state readout and feed-forward pass per layer. Overall, coupling temporal retention and structural diffusion within one shared state, as in DSRD, is both more accurate and more efficient than keeping them in separate states. We have added the analyses in RQ1 and RQ2 to Section 4.4 and Appendix C.12 of the revised paper.
We appreciate your helpful comments. Please do not hesitate to let us know if you have any questions.