- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper introduces FedBSE, a federated segmentation framework that adapts to new hospitals by estimating a low-dimensional client state while keeping the shared model frozen. It then updates a Gaussian state distribution to help subsequent clients, achieving competitive segmentation accuracy with much lower onboarding costs on three medical imaging datasets.
Critical strengths
1 New hospitals can join without bringing existing clients back online or changing their predictors. Separating shared knowledge from client-specific coefficients makes this behavior explicit and preserves existing-client predictions by construction.
2 FedBSE achieves the highest average Dice among the main baselines on all three datasets, with reported local onboarding times of roughly 2–3 seconds. The comparisons with gradient-based coefficient adaptation, diagonal curvature, and full-model fine-tuning help explain where its efficiency comes from.
Critical weaknesses
1 The sequential experiments use only two arrivals per dataset under a preset order, without results across multiple seeds or arrival orders. These examples show that updating the prior can help, but do not establish that it remains reliable over longer sequences or when an unusual client arrives early.
2 The default state has 64 dimensions, but its initial covariance is estimated from only three or five clients, making covariance stabilization especially important. Also, the closed-form solution is exact only for the local quadratic approximation, and the consistency theorem assumes vanishing inference error and uncertainty. The paper does not show when these assumptions hold in practice.
Questions for authors
1 Could you please evaluate more arrival orders and random seeds, including sequences with strongly shifted clients? Does accumulation sometimes hurt later clients?
2 How sensitive are the results to covariance stabilization? With so few initial clients, how does a full covariance compare with diagonal or shrinkage estimates?
3How close is the single closed-form update to a well-converged solution in the same coefficient space, especially under large domain shifts? Could a few additional curvature-based updates improve accuracy at modest cost?
4 In Figure 6, the first PMR client scores 74.99 with the fixed state and 75.20 with the accumulated state, although the text says the two branches are identical for the first arrival. Could you clarify this discrepancy?
2 comments
Response to Q2&W2: Sensitivity to Covariance Estimation
Sensitivity to Covariance Estimation The observed gains are not contingent on choosing a full covariance estimator. With few initial clients and a 64-dimensional capability vector, estimation is potentially ill-conditioned. We therefore compared full, diagonal, and shrinkage covariance estimators over four Polyp leave-one-client-out splits:
| Covariance | Dice (%) | IoU (%) |
|---|---|---|
| Full | 79.77 | 72.46 |
| Diagonal | 79.83 | 72.51 |
| Shrinkage | 79.72 | 72.38 |
The maximum spread is just 0.11 pp Dice and 0.13 pp IoU, with diagonal covariance performing marginally better than full covariance. These findings suggest that FedBSE exhibits limited empirical sensitivity to the covariance estimation strategy in this setting, even with few initial clients. We have added the protocol and results to Appendix A.7. Response to Q3: Closed-Form Inference and Convergence
To assess the accuracy–efficiency trade-off, we compare the single-step closed-form inference with 2 and 5 additional curvature-based refinement steps, as well as well-converged coefficient optimization in the same capability space. The four-fold averaged results on Polyp are reported below.
| Method | Dice (%) | IoU (%) | Time (s) |
|---|---|---|---|
| One-step closed-form | 79.77 | 72.46 | 2.67 |
| +2 curvature updates | 80.31 | 73.03 | 28.22 |
| +5 curvature updates | 80.43 | 73.12 | 46.95 |
| Well-converged optimization | 80.45 | 73.13 | 148.42 |
The single-step closed-form inference achieves performance close to the well-converged solution, with differences of only 0.68 and 0.67 percentage points (pp) in Dice and IoU, respectively, while reducing computation time from 148.42 s to 2.67 s. Additional curvature refinement further narrows this gap. These results indicate that single-step inference provides a favorable accuracy–efficiency trade-off, while a few additional curvature updates can further improve accuracy with diminishing returns. We therefore retain single-step inference as the default for efficient client onboarding. We report the accuracy–cost curve in Appendix A.8. Response to Q4: Clarification of Figure 6(b)
We apologize for the unclear presentation in Figure 6(b). It did not show the first client clearly. The corrected figure now shows all three PMR arrivals after initial clients . The first, , is Dice in both branches. The fixed and accumulated bars belong to the second arrival, ; is third. The caption now names the initial group and order. This makes the paired identity check visible. We have revised the figure caption and axis labels to explicitly indicate the initial clients and the displayed arrival order.
Response to Reviewer 2k9Q
Thank you for your constructive comments and valuable suggestions.
Response to Q1&W1: Robustness to Client Arrival Orders
We paired fixed- and updated-prior branches at identical initial checkpoints, data, and arrival orders. Their first-arrival Dice is necessarily identical. Across two initial groups and all orders, the updated prior improves the later client in 4/4 Polyp comparisons and 20/24 PMR comparisons. The four PMR losses all concern C0 after initial group 3,4,5; the worst is −1.14 percentage points (pp). The hard PMR client C0 was tested in every arrival position, so the result is not selected from a single favorable order. Appendix A.6 now reports more order and arriving client. The evidence supports conditional forward transfer and reveals its client-composition boundary, rather than a universal gain.
Table1. Dice of second and third arrivals with accumulated versus fixed priors on Polyp dataset. Cᵢ denotes Site i+1.
Table2. Dice of second arrivals with accumulated versus fixed priors on PMR dataset. Cᵢ denotes Site i+1.