- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper focuses on the personalized federated learning and introduce federated smooth personalization via the layerwise implicit neural experts to mitigate the distribution shift. It introduce a lot of modules including a bounded rounter, sisteen nonnegative analytic weights, cold-start decomposition and conditional shared-parameter analysis.
Critical strengths
- Understanding the personalized federated learning from the geometric perspective is interesting.
- There is a comprehensive empirical evaluation for the paper.
Critical weaknesses
- Many words are too hard to understand. For example, only from the abstract, what is the bounded rounter, nonnegative analytic weights, supporting conditional shared-parameter analysis, source-identity disjoint evaluation etc. Similar for other parts of the paper, the readability of this paper is poor. Similar for the figures, it seems too complex to be understandable.
- The formulation of the personalized federated learning and the study self-defied compound heterogeneity is not clear. Is there any difference from the conventional PFL and the compound heterogeneity? Also it is ambiguous of what the P_i is defined here when you already have the D_i.
- Many words are very weird, for example “We do not claim cryptographic privacy for s_i xxx” in line 142. As a reader, one don’t even know what the cryptographic privacy means in this paper while the paper says it does not claim cryptographic privacy.
- In line 149, the paper mentions they have four design questions for PFL while this is not cleared before the section 4. In conventional PFL, there is no coordinate encoder (a convention FL just needs a learnable neuron network) and why it turns to be a design question in section 4.1 now? Similar for the other design questions.
- There are many modules introduced in this paper but there lack a motivation of how each module is brought in. Given the readability of the English, figure and math, it is very hard to understand the how each module works.
Questions for authors
- Could the authors please polish the readability of this paper to help improve the reader's overall experience as pointed by weakness 1-2. For the rebuttal, could you please provide the clairfication?
- Could the authors please explain why there are many weird statement and new jargon in the paper.
- Could the author please provide the motivation of those many modules introduced to the paper.
- Could the author please clarify their setting from conventional PFL.