- Rating
- 3(+1)
- Confidence
- 1
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies approximate node unlearning in GNNs while keeping the base GNN parameters fixed. The authors propose RTR, which learns node-interaction estimates through information-conserving reconstruction and uses RND to rectify the reconstructed shares during training. The estimated interactions are then subtracted from retained-node embeddings during inference. The method is evaluated across multiple datasets and GNN backbones in terms of efficiency and model ability.
Critical strengths
- By formulating node unlearning as embedding modification, the method avoids retraining the entire GNN. Experimental results show substantial reductions in running time while maintaining F1 scores close to those obtained by retraining from scratch. 2.The authors provide an error analysis of the RND rectification step. The ablation study in Figure 6 compares results with RND, providing empirical evidence that this step improves F1 scores.
Critical weaknesses
- In Section 4, the authors introduce a nonlinear residual but then leave it out of the theoretical analysis, assuming that the linear inverse constraint holds exactly. THowever, the node interactions are predicted by a network and may contain estimation errors, and the method is also applied to nonlinear GNNs. How does ignoring the nonlinear residual affect this conclusion?
- In Section 5, the frozen original GNN produces teacher embeddings on the pruned graph, and these embeddings are used to guide the training of the added module. How much of the performance improvement comes from the reconstruction process, and how much comes from this teacher guidance? 3.Besides the overall results, the paper could also analyze individual nodes. For the same retained node, the authors could compare its predictions before unlearning, after applying RTR, and after retraining from scratch. Showing both cases where RTR works well and cases where it performs less well would help explain the results.
Questions for authors
Please see the weakness,