- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the unseen client model assignment problem in personalized FL, and proposes a geometry-preserving framework to achieve more reliable performance.
Critical strengths
- This paper focuses on the unseen client problem in PFL, and proposed a novel and useful framework to address this problem, especially on the alignment of latent representations.
- On the presentation, Figure 1 and 2 are both illustrative. The writing and format is well done.
- The supporting materials in appendix are also strong.
Critical weaknesses
-
I recognize both the validity of the problem and the novelty of the proposed mechanism. My main concern, however, is the overall significance of the contribution relative to recent literature. Fine-tuning-free personalization for unseen clients is a meaningful but already established problem setting, and FedGeo introduces a novel and arguably cleaner design within it. Nevertheless, the methodological advance appears relatively narrow: the proposed geometric structure specifically preserves the Euclidean geometry of client label priors (P(Y)), combined with bounded sensitivity of the parameter generator. Thus, while the mechanism is technically distinct, I am less certain about the magnitude of its conceptual advance over existing unseen-client personalization frameworks.
-
Given the concern above, the empirical positioning of the paper becomes particularly important. The paper discusses works such as HyperFedZero as closely related methods but does not include them as main experimental comparisons. Rather than evaluating FedGeo largely on its own, I suggest that the authors add these recent and/or closely aligned baselines to demonstrate the novelty and contributions more explicitly. Besides, I also strongly recommend including:
- On Bridging Generic and Personalized Federated Learning for Image Classification
- Federated Learning with Unlabeled Clients: Personalization Can Happen in Low Dimensions
In its current form, I find the method novel and technically sound, but I am not yet convinced that the paper demonstrates a sufficiently substantial advance over the existing literature on fine-tuning-free personalization for unseen clients.
Questions for authors
I will reconsider my rating given the weaknesses part can be addressed.
2 comments
I thank the author for the rebuttal materials, and they have mostly addressed my concerns. I updated my score.
Response to Reviewer EcYd
We thank the reviewer for recognizing the problem setting and the novelty of the mechanism. Each answer opens with a one-sentence summary and then follows the review. In the revised PDF, revisions for this review are in orange and revisions shared with other reviews are in purple.
W1. "I am less certain about the magnitude of its conceptual advance over existing unseen-client personalization frameworks."
FedGeo shows that, for unseen clients, preserving the geometry of P(Y) and bounding the generator's sensitivity is enough to outperform richer generators, and it is what makes the transfer certifiable.
Relative to existing frameworks. FedGeo is the only method that is image-free at a new client, has an output size independent of the backbone, and comes with a numerically evaluated guarantee for unseen clients:
On the focus on P(Y) geometry and bounded sensitivity. We see this focus as the contribution rather than a limitation: these two properties are exactly what the guarantee requires, and the controls below show that they are also what accuracy requires. Distance preservation and the spectral cap give ∥mi−mj∥2≤2∣A∣κ∥di−dj∥2, so an unseen client's risk is at most its nearest training client's risk plus a term linear in their prior distance (Theorem 4.4). With measured constants, this bound is non-vacuous near training priors (18 of 20 pairs under controlled label shift).
Design, not information, makes the difference. Every row below uses the same label prior; only the mapping differs (pathological CIFAR-100, unseen %):
Scalability. Because its output does not grow with the backbone, FedGeo trains with ResNet-18, where PeFLL runs out of memory, and leads the strongest remaining baseline there by 13.74 points on unseen clients. (Details: Related Work, Sec. 4.2, Table 2, App. I.10.)
W2. "I suggest that the authors add these recent and/or closely aligned baselines to demonstrate the novelty and contributions more explicitly."
All three methods are now included, and FedGeo outperforms each of them in every setting.
HyperFedZero and FedRoD (hyper) are now main baselines in Table 1, with the same LeNet-5, splits, 5,000 rounds, and three seeds as every other method (seen / unseen, %):
FLowDUP uses no labels at a new client, like HyperFedZero, so we compare both with our label-free variant FedGeo-EM, which estimates the prior with forward passes only (pathological, unseen %):
HyperFedZero is ported from its official code with the paper's hyperparameters; FedRoD (hyper) and FLowDUP have no released code and are re-implemented from their papers. (Details: Table 1, App. F.5, I.7.)
We hope these comparisons demonstrate the contribution more explicitly and would be happy to provide further details.
References
[1] Scott et al., PeFLL: Personalized Federated Learning by Learning to Learn, ICLR 2024.
[2] Zhou et al., Deploying Models to Non-Participating Clients in Federated Learning without Fine-Tuning: A Hypernetwork-Based Approach (HyperFedZero), ICLR 2026.
[3] Chen & Chao, On Bridging Generic and Personalized Federated Learning for Image Classification (FedRoD), ICLR 2022.
[4] Zakerinia et al., Federated Learning with Unlabeled Clients: Personalization Can Happen in Low Dimensions (FLowDUP), ICML 2026.