- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes NEXUSFL, a federated learning client selection method that models interactions among clients using a tree-based surrogate to capture complementarity and redundancy. Experiments across 9 datasets and 12 settings demonstrate strong performance, while theoretical analysis provides insights into selection regret.
Critical strengths
-
Unlike methods that evaluate each client's contribution individually, NEXUSFL considers complementarity and redundancy among clients, enabling more effective client coalition selection. Both its motivation and methodology are well justified.
-
The paper evaluates NEXUSFL on nine datasets across twelve experimental settings. It achieves the highest trajectory-mean accuracy in nearly all settings, demonstrating strong empirical performance.
-
The paper is comprehensive, with a relatively complete theoretical analysis and extensive experimental evaluation.
Critical weaknesses
-
Appendix B shows that coalition utility evaluation accounts for 46% of the total time per round for CNN / CIFAR-10 and 85% for DistilBERT / FinGPT, substantially exceeding the proportion spent on client model training. Although Figure 6(b) shows that reducing the sampling budget can lower computational costs, it may also degrade model performance. Therefore, adaptively selecting an appropriate to balance computational efficiency and model performance remains a direction worth further investigation.
-
NEXUSFL relies on a surrogate tree model to predict the utility of different client combinations. However, Table 14 shows substantial variation in the surrogate’s cross-round predictive correlations across tasks. For FinGPT, the Spearman correlation coefficient is only 0.234. This suggests that the surrogate's predictive capability may depend on task characteristics, potentially affecting the effectiveness of client selection.
Questions for authors
See weaknesses.
Response to Reviewer dxb7
We thank the reviewer for their constructive feedback and for appreciating our interaction-aware motivation, theoretical analysis, and empirical performance.
W1: Coalition Evaluation Cost and Adaptive Budget. We agree that coalition evaluation is the dominant cost of the pipeline and that adaptively adjusting B is a valuable direction, which we also note in the Limitations and Future Work paragraph of Section 5. If the coalition utility game stabilized in later rounds, a natural way to reduce evaluation cost would be to decay B as training progresses. In Appendix F.5 (Table 16), however, the mean Jaccard overlap between consecutive selected sets remains low even in the final quarter of training (Q4: 0.17–0.28), showing that the selection policy continues to shift across rounds. Reducing B safely without degrading selection would therefore require reliable uncertainty estimates under drift (Kim & Choi, 2022) rather than a fixed decay schedule, and we leave this coupling to future work.
W2: Task Dependence of Cross-Round Surrogate Correlation.
We agree that cross-round correlation in Table 14 varies across tasks (0.234–0.809). Because next-round Spearman evaluates the previous round's surrogate on fresh current-round coalitions, it reflects both surrogate generalization and how rapidly coalition rankings shift after a global-model update.
However, lower cross-round correlation on tasks such as CIFAR-10 LT (0.442), Sent140 (0.339), and FinGPT (0.234) does not degrade selection performance. Across all six settings in Table 14,
NEXUSFLbeats every baseline in trajectory-mean accuracy (Tables 1 and 9, summarised below), and on FinGPT it avoids the sharp round-to-round accuracy drops seen in FedAvg, S-FedAvg, DivFL, and FilFL (Figure 8b).In
NEXUSFL, final selection of the 10 aggregated clients within the pool always evaluates B fresh coalitions on the current global model and refits the surrogate on the updated reservoir (reaching a mean Reservoir R² of 0.684 on FinGPT, as shown above). Final selection therefore adapts to the current round's global model even when cross-round rankings shift.We thank the reviewer again for these constructive suggestions, which help clarify the trade-offs and diagnostic properties of our method.