TRUSS: Transmission-Reduced Unified-State Scaffolding under Non-Stationary Client Participation
Abstract
Heterogeneous client objectives and unequal, time-varying availability create coupled sources of error in federated optimization: local drift and participation bias. Correcting both while preserving the speedup from local computation and keeping communication and memory costs low is a central challenge. We introduce Transmission-Reduced Unified-State Scaffolding (TRUSS), which addresses both with a single persistent, model-sized memory per client. The difference between this memory and the current server model supplies the correction applied at every local step. Each active client therefore exchanges one model-sized vector in each direction per round, matching FedAvg's per-round communication, and the server stores only the global model. For smooth non-convex objectives under independent participation whose probabilities may vary across clients and rounds, we establish an stationarity bound, yielding linear speedup in the number of clients and local steps , with no bounded-gradient-heterogeneity assumption and no knowledge of client inclusion probabilities or importance weighting. Experiments demonstrate the effectiveness and communication efficiency of TRUSS.
est. 32% chance this paper gets accepted at ICLR 2027.
What do you think this paper will get?
All positions stay anonymous.