- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies federated learning with incompatible client label taxonomies, where labels may be permuted, merged, or split across clients. It proposes FedLENS, which learns a shared bank of anonymous latent entities from client micro-prototypes via semi-unbalanced optimal transport, while retaining client-specific mappings and residual classifiers. Experiments on four controlled benchmarks show that FedLENS improves over residual-only training and several existing baselines, with ablations evaluating the contributions of its main components.
Critical strengths
The paper addresses an important and relatively underexplored FL setting. Most federated learning methods implicitly assume that classifier coordinates have consistent semantic meanings across clients. FedLENS explicitly considers more challenging taxonomy mismatch, including label permutation, merging, and input-dependent splitting, which is a meaningful problem formulation for heterogeneous institutions and decentralized learning settings.
The combination of anonymous micro-prototypes, private label-to-entity mappings, adaptive latent capacities, and semi-unbalanced OT provides a concrete mechanism for cross-client coordination without explicitly sharing label identities. The paper also includes a relatively comprehensive set of ablations and evaluates the method across multiple controlled benchmarks, which helps demonstrate that the proposed framework can operate under the considered taxonomy mismatches.
Critical weaknesses
The necessity of the latent-entity pathway is not sufficiently established. Both the entity and residual pathways operate on the same shared representation, yet removing the entity path causes only a marginal performance drop, while removing the residual path leads to a substantial degradation. Since the residual pathway is also the default prediction path at deployment, it remains unclear what unique benefit the latent-entity negotiation provides beyond an auxiliary training signal.
The method relies on a strong assumption that semantic entities are recoverable from feature similarity. The entity bank is learned without semantic supervision, and prototype--entity matching is primarily based on feature similarity. Under substantial domain shift or heterogeneous taxonomies, feature similarity may not reliably indicate semantic identity. Thus, it is unclear whether the learned entities correspond to meaningful shared semantics or merely arbitrary clusters in the representation space.
The practical benefit of the additional optimization machinery is not sufficiently justified. FedLENS introduces prototype clustering, semi-unbalanced OT, iterative entity-bank updates, and multiple auxiliary losses and hyperparameters, while the improvements over strong baselines are relatively modest. The paper does not report training-time, convergence, or computational-cost comparisons, making it difficult to assess whether the additional complexity is warranted.
Questions for authors
What unique role does the latent-entity pathway play beyond the client-specific residual pathway? Since both pathways operate on the same shared representation and the default deployment uses the residual pathway , can the authors provide evidence that the latent-entity negotiation produces a qualitatively different or otherwise necessary form of cross-client representation transfer, rather than acting primarily as a weak auxiliary training signal?
How robust is the latent-entity negotiation to imperfect feature alignment and early-training matching errors? Since entity matching is based on prototype--entity feature similarity without semantic supervision, incorrect matches could potentially be propagated through subsequent rounds. Can the authors provide experiments or analysis showing robustness to noisy prototypes, different bank initializations, or deliberately perturbed early-round representations?
What is the empirical basis for the capacity rule ? Since the number of clients does not necessarily determine the number of shared latent entities, can the authors clarify the rationale for this scaling and report performance under substantially under- and over-provisioned capacities?