- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper proposes FICO, a personalized federated learning framework that replaces parameter consensus with one-bit consensus on low-dimensional model projections. Each client keeps a full-precision local model, and clients agree only on a shared sign code of a sketched representation (Eq. 4 to 10), enforced through a margin-based quantization cell. A proximal ADMM scheme alternates local SGD on personalized subproblems with server-side code selection, which reduces to a coordinate-wise closed form after eliminating the auxiliary variables (Lemma 1, Eq. 17 to 19). Clients upload one sign bit per coordinate plus one amplitude scalar encoding their cost-difference preferences (Eq. 20 to 24), giving a per-round cost of K(2m + 32) bits. The theory bounds the average expected squared KKT residual of the continuous variables within the selected cells by an O(1/T) term plus a stochastic-gradient error term (Theorem 1), with vanishing residuals under summable error budgets (Theorem 2). Experiments on five image datasets with 20 clients under Dirichlet heterogeneity report competitive accuracy against eight baselines at roughly 0.2% of the per-round communication of FedADMM-InSa.
Critical strengths
- The formulation is clean and the algorithmic derivation is elegant. Reducing shared-code selection to a coordinate-wise binary problem with an exact closed-form minimizer (Eq. 19), and connecting the compressed messages to actual optimization-cost differences rather than plain sign voting as in pFed1BS, is a genuine conceptual step for low-bit federated coordination.
- The theory accounts for the parts that usually get waved away. Theorem 1 covers inexact SGD subproblem solves and compressed uplink messages, and the Hamming-penalized code update with the tie tolerance (Eq. 24) is both practical and folded into the analysis. The 99.8% per-round communication reduction against FedADMM-InSa with accuracy ahead of the closest low-bit competitor pFed1BS by 11.98 and 13.13 points on CIFAR-10 and CIFAR-100 at alpha 0.1 (Table 1) demonstrates a useful operating point.
Critical weaknesses
- The accuracy-communication trade-off is not yet mapped against full-precision baselines. At alpha 0.5, FICO trails FedAPM on most columns of Table 2, including a 16-point gap on CIFAR-100 (43.93 vs 60.12). FedAPM pays orders of magnitude more communication, so this does not contradict the paper's claim, but a cost-matched comparison (equal total bit budget over training, or FedAPM restricted to the same number of rounds) would make the trade-off curve concrete. This seems fixable with additional experiments rather than a fundamental flaw.
- The evaluation scope could be widened. Accuracy is reported as the maximum over rounds rather than the final or converged value, and all experiments use small vision models, while the communication argument matters most for larger models. Reporting final-round accuracy and one larger-scale task would strengthen the evidence, though neither issue undermines the analysis that is present.
Questions for authors
- The accuracy-communication trade-off is not yet mapped against full-precision baselines. At alpha 0.5, FICO trails FedAPM on most columns of Table 2, including a 16-point gap on CIFAR-100 (43.93 vs 60.12). FedAPM pays orders of magnitude more communication, so this does not contradict the paper's claim, but a cost-matched comparison (equal total bit budget over training, or FedAPM restricted to the same number of rounds) would make the trade-off curve concrete. This seems fixable with additional experiments rather than a fundamental flaw.
- The evaluation scope could be widened. Accuracy is reported as the maximum over rounds rather than the final or converged value, and all experiments use small vision models, while the communication argument matters most for larger models. Reporting final-round accuracy and one larger-scale task would strengthen the evidence, though neither issue undermines the analysis that is present.