- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates late-onset performance degradation in graph-augmented federated clinical prediction under non-IID data distributions. The authors propose FedGAug, which integrates a LoRA-adapted transformer, patient-level knowledge graph representations, and asynchronous federated aggregation, and evaluates Elastic Weight Consolidation (EWC) and Knowledge Distillation (KD) as stabilization strategies. They evaluate the approach on synthetic EHR data from Synthea, partitioned across three heterogeneous clients over 29 communication rounds, and report that the unregularized global model experiences a late AUROC collapse while the regularized variants maintain stable performance. The study contributes empirical observations on late-onset instability, differences between local and global model performance, and the behavior of regularization and monitoring metrics during federated training.
Critical strengths
- The paper investigates late-onset instability that would be missed by shorter federated training evaluations, highlighting the importance of monitoring model performance over extended communication rounds.
Critical weaknesses
- The experiments lack comparisons with established federated optimization methods and simpler stabilization strategies, making it difficult to establish whether the adopted regularization choices are necessary.
- The evaluation relies on a single synthetic clinical dataset with three clients and one non-IID partitioning configuration, leaving the robustness of the findings across data distributions and federated settings unverified.
Questions for authors
see weaknesses
2 comments
Thank you for the response. Since the additional results are not yet available, my concerns remain, and I will keep my rating.
We thank the reviewer for the constructive feedback. We are adding matched FedProx, FedCurv and SCAFFOLD runs and simpler stabilizers under the same protocol, and extending the study to more clients and different heterogeneity levels. We will share results as they become available.