- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies federated complementary-label learning (FCLL), where clients possess information about which classes their samples do not belong to. This paper identifies fragmented complementary supervision across clients as a central challenge, particularly under heterogeneous data distributions. To solve this challenge, this paper proposes a FCLL framework: FedCUE. FedCUE first learns from observed complementary labels and then constructs local semantic clusters using features extracted from the global encoder. Then each client uploads statistics and the server aggregates these statistics to construct global complementary evidence, which is returned to clients for joint training with local supervision. The paper gives a convergence analysis for the time-varying objective. Experiments conducted on synthetic and manually annotated complementary label datasets with varying degrees of data heterogeneity.
Critical strengths
S1. FedCUE explores a significant machine learning scenario, identifying the extension of complementary evidence sharing beyond individual clients as a new research direction. FedCUE introduces a novel pipeline grounded in federated learning insights, enabling the exchange of complementary information across different clients without directly sharing individual privacy samples. S2. Experiment section evaluates FedCUE across various levels of data heterogeneity using multiple complementary labels datasets (synthetic and manually annotated) The study encompasses a range of experiments that provide valuable empirical evidence for understanding the framework and this new topic.
Critical weaknesses
W1. Ablation study results indicate that global evidence aggregation yields only marginal performance gains (close to 0.22 pp) in main settings and can even lead to performance degradation in some cases. As the evaluations were conducted using a single random seed, the stability of these incremental benefits remains unclear. Without this global component, FedCUE may require a more substantial methodological contribution, otherwise resembles a centralized CLL approach combined with standard FedAvg. consequently, the independent contribution of the method's core distinguishing component has not been fully substantiated. More importantly, the five baseline methods used for main benchmark experiment were not specifically designed for CLL but are normal federated learning methods, making it difficult to accurately assess how FedCUE compares to CLL-specific baselines. W2. FedCUE characterizes local clusters solely using feature centers, soft complementary distributions, and support sizes. While this approach is communication-efficient (since only upload statistics), such coarse-grained statistics may fail to fully preserve information. Although the paper examines the number of clusters and the matching radius in the context of k-means, it does not further analyze the information loss resulting from those statistics, nor does it compare the method against other clustering baselines. Consequently, it remains unclear whether the proposed statistics set is sufficient to capture the information needed for reliable cross-client complementary evidence transfer.
Questions for authors
Q1. Could the authors clarify the design differences between FedCUE’s "local evidence construction" and existing feature-based CLL methods? Given the similarities between them, could the authors include federated learning versions of these methods (e.g. combining existing CLL approaches with FedAvg) for comparison under comparable experimental settings? Such a comparison would help establish the additional contribution of the proposed “global evidence aggregation mechanism”. Q2. Could the authors please clarify the exact CNN architecture and the feature extraction layers corresponding to (including their output dimensions)? Do these settings remain consistent across different datasets and communication rounds? Additionally, please clarify whether the hyperparameters are fixed across all experiments or adjusted for different scenarios, and describe the process used for selecting these hyperparameters. Q3. The paper's introduction (Sec. 1) highlights FCLL collaboration among hospitals as a key application scenario. However, different hospitals may employ varying imaging equipment, acquisition protocols, or operational standards, leading to client-specific differences in feature distributions even for the same semantic categories. Since FedCUE relies heavily on feature-space clustering and cross-client cluster matching, this heterogeneity arising from variations in image style could directly affect the reliability of “global evidence aggregation mechanism”. Could the authors evaluate FedCUE in representative cross-domain settings, or provide further evidence explaining why its cluster matching and complementary evidence transfer mechanisms remain reliable under such conditions?
Response to Reviewer 8ZCu (Part 1)
Dear Reviewer 8ZCu,
Thank you for recognizing the value of our research problem and our evaluation on synthetic and human-annotated complementary-label datasets. To address your main concerns, we have added a CLL-specific federated comparison, a three-seed paired ablation, a shared exclusion-preference stress test, and direct diagnostics of reconstructed evidence.
W1 & Q1: Can Global Sharing Provide Additional Useful Exclusion Information?
We conduct a new shared exclusion-preference stress test to examine the role of global sharing when clients provide increasingly similar exclusion information. This experiment further clarifies the importance of evidence complementarity for effective collaboration.
On CIFAR-20 with β=0.1 and seed=2026, we assign one shared non-ground-truth exclusion class to each ground-truth class and progressively increase the proportion of annotations using that class. A strength of 0 preserves the original complementary labels, while 0.5 and 0.9 represent moderate and strong shared preferences, respectively.
Without an additional shared preference, Full improves over Local-only by 0.15 pp, supporting the value of cross-client evidence in supplementing local supervision. As the shared preference becomes stronger, accuracy decreases substantially for both methods, and global sharing no longer provides additional gains. This trend is consistent with our emphasis on evidence complementarity: effective collaboration depends on usable complementary supervision rather than simply increasing the amount of shared information. This stress test further characterizes collaborative performance under shared annotation preferences.
W2: Contribution and Stability of Global Evidence
We conduct a new three-seed paired ablation to quantify the average contribution of global evidence and its variation across random seeds, complementing the single-run results in the original submission.
We compare Full and Local-only while fixing data partitions, complementary labels, augmentation, batch, radii, and cluster numbers within each seed. Only global evidence is enabled or disabled:
Although gains vary across datasets, the macro-averaged gain remains positive, indicating that global evidence can provide additional performance benefits overall.
W3 & Q2: Federated Comparison with Existing CLL Methods
We additionally evaluate the suggested Local LabelAug + FedAvg to directly compare FedCUE with local complementary-label augmentation in federated settings.
LabelAug enhances supervision by propagating complementary labels among similar samples. Under heterogeneous FL, decentralized data and skewed client distributions restrict local-neighborhood coverage. Our adaptation constructs graphs and augments labels within each client, while the server performs standard FedAvg. FedCUE further supplements locally unavailable information through cross-client cluster-level statistics.
We report accuracy (%) at round 100 over three seeds (2026/2027/2028):
FedCUE outperforms Local LabelAug + FedAvg in both settings. This comparison supports the value of designing an evidence-learning mechanism specifically for federated settings: simply combining local label augmentation with parameter aggregation is insufficient to achieve the performance of FedCUE.
We will release the federated adaptation implementation, feature-access mechanism, and complete training configurations to facilitate verification of the comparison settings. These results apply to the specific client-local federated adaptation and should not be generalized to the performance of the original centralized LabelAug.