- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper studies federated continual graph learning (FCGL), where clients train a shared GNN over sequential tasks without centralizing raw graphs. It identifies two failure modes, semantic overlap and structural forgetting, and proposes FedDiG. After each task, a post-hoc dual-gradient scoring of hidden dimensions (cross-entropy gradient versus adjacency-reconstruction probe gradient, Eq. 2 to 4) splits representations into a semantic channel and a structural channel. Each task trains a client-side generator and link predictor on the current local graph, and the server aggregates them, synthesizes per-task subgraphs calibrated by a high-frequency roughness score, and performs dual-channel distillation of a frozen teacher on the disjoint union of past synthetic graphs (Eq. 13 to 17). Experiments on seven datasets with sixteen baselines from four families report the highest mean average accuracy and lowest mean average forgetting, with ablations on the four loss terms, the mask ratio, and the channel split.
Critical strengths
- The empirical study is broad and well controlled. Table 1 covers seven datasets including heterophilic graphs, sixteen baselines from four families, and five seeds with standard deviations, all under a unified federated protocol, which is more careful than most FCGL papers.
- The ablations genuinely isolate design choices. Table S4 separates the topology loss from link-predictor training, Table 3 shows a random mask collapses to 54.3 AA on Cora while the semantic-gradient mask alone recovers only part of the gap, and the channel probes in Figure 4 plus the retention analysis in Figure 5 connect the design to old-task retention (72.5% old-class accuracy versus 11.4% for POWER).
Critical weaknesses
- The claimed disentanglement is only weakly supported. The channel split is a post-hoc top-r mask on two gradient scores with a fixed ratio r of 50%, and Figure 4 shows the split is far from clean, since HS keeps 70.58% class accuracy against 74.85% for the full representation while HR still retains 65.0% structure AP. It is therefore unclear how much of the gain comes from channel separation rather than from generative replay itself, especially since Fed-DSLR with real-node replay stays competitive in AA on several datasets in Table 1.
- The evaluation protocol simplifies both the federated and the continual aspects. Main results use only K = 3 clients with full participation, contiguous class blocks as tasks with leftover class IDs discarded, and inter-task edges excluded for all methods. Partial participation and client-scale sweeps are deferred to the appendix, so the method's behavior under more realistic federation regimes remains largely unverified in the main evidence.
Questions for authors
Refer to weaknesses.
Follow-up to Reviewer bUgm: How Much of the Gain Comes from the Channel Split?
Thank you again for your review. We have not yet heard back during the discussion, so we would like to share one additional controlled experiment that directly addresses your main question in W1: how much of the gain comes from channel separation rather than from generative replay itself.
In short: rows A1 and A3 below use identical generative replay, identical distillation losses and identical budgets; the only difference is whether the distillation losses read the split channels. This isolated change gives +7.1 AA / −13.8 AF on Cora and +1.8 AA / −10.6 AF on CiteSeer, so a substantial part of the gain is attributable to the split and not to replay alone.
Stage-wise and loss-wise isolation of the split (AA ↑ / AF ↓, %)
Every row uses generative replay with the same generator, replay budget, communication rounds, local epochs and distillation epochs; where the split is not used, the contrast and sim losses act on the full representation H. The split helps both when used only in the generator (A2) and only in distillation (A3), the two uses are complementary (A4), and even with CE alone the split lowers forgetting (B1 → B2).
On the split not being perfectly clean. We agree that H_S and H_R are not fully disentangled (70.6% class accuracy in H_S, 65.0% structure AP in H_R). The split is not intended as a hard disentanglement; its role is to route semantic and relational supervision to the dimensions most responsive to each. The A1 vs. A3 contrast shows that this routing yields a clear gain even though the channels overlap.
On W2. In our earlier response we added results with inter-task edges retained in both training and evaluation, longer task sequences (7-task Cora, 6-task CiteSeer), and random class orders; FedDiG achieves the highest AA and lowest AF in all of these settings.
We would sincerely appreciate it if you could take a look and share any remaining concerns, and we would be grateful if you could take these results into account in your final assessment.