- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents FedPGRL for federated learning scenarios plagued by both long‑tailed class distributions and heterogeneous label noise. Built upon CLIP2FL, FedPGRL incorporates three prototype‑guided refinement modules. These modules include Prototypical Distance Selection (PDS), Prototypes Contrast Refinement (PCR), and Multi‑Prototypical Mask Refinement (MPMR). PDS leverages prototype distances alongside a Gaussian mixture model to distinguish clean samples from noisy ones. PCR generates prototype‑aware soft labels for potentially corrupted samples. MPMR further derives corrected representations to support class‑gradient training. The work also introduces Class Prototypical Regularization (CPR) while preserving the original CLIP‑driven knowledge regularization. Evaluations are carried out on CIFAR‑10‑LT, CIFAR‑100‑LT and Tiny‑ImageNet‑LT under simulated label noise and long‑tailed distribution settings.
Critical strengths
--Simultaneously addressing class imbalance and heterogeneous annotation noise is practically meaningful, and the experiments cover multiple imbalance and noise configurations.
--FedPGRL substantially improves over CLIP2FL under severe noise and imbalance on both CIFAR-10-LT and CIFAR-100-LT, and the component ablations indicate that PDS, PCR, and MPMR each contribute to performance.
Critical weaknesses
--The paper clearly defines an input sample x and its learned feature z=F_\theta(x), but subsequent prototype operations repeatedly use x directly in feature-space computations, including PDV calculation, cosine similarity with class prototypes, MPMR interpolation, and CPR regularization. For example, Eq. (7) combines x with a weighted sum of feature prototypes, which is dimensionally inconsistent if x denotes the raw image. Similar ambiguity appears in Eq. (9). These issues affect the correctness and reproducibility of the central PDS–PCR–MPMR–CPR pipeline, rather than being merely cosmetic notation problems.
--CPR is repeatedly described as encouraging intra-class compactness while explicitly pushing different classes apart, yet its loss is only an MSE attraction to the assigned class prototype, with no inter-class repulsion, margin, or contrastive term. In addition, the paper claims that FedPGRL requires “no explicit server-side classifier retraining,” while Section 2.5 explicitly introduces a classifier retraining stage. The manuscript also states that weighted gradient aggregation preserves privacy, despite providing no formal privacy mechanism or leakage analysis. These inconsistencies weaken the technical credibility of the method description.
--PDS is motivated as a way to avoid unreliable prototypes caused by noisy labels, but the cluster initialization and class alignment still rely on prototypes computed from those same noisy labels. The resulting process effectively uses noisy labels to construct noisy prototypes, uses them to align clusters, and then uses the aligned clusters to infer which labels are noisy. This is particularly concerning under severe long-tail conditions, where minority classes may contain very few samples and their prototypes can be highly unstable. The paper reports only final classification accuracy and does not directly evaluate clean/noisy detection quality, relabeling accuracy, or performance separately for head and tail classes.
--Although many combinations of imbalance factors and synthetic noise rates are considered, the experiments are still mainly conducted on CIFAR-10-LT, CIFAR-100-LT, and Tiny-ImageNet-LT with simulated imbalance and label corruption. This does not substantiate the manuscript’s claim of effectiveness under “real-world FL settings.” Moreover, for a long-tailed learning paper, overall accuracy is insufficient because it may be dominated by head classes; detailed Many/Medium/Few results are only provided for Tiny-ImageNet in the appendix. For a noisy-label method, the paper should also directly report noise-detection precision/recall, corrected-label accuracy, and tail-class relabeling quality.
--FedPGRL is explicitly built on CLIP2FL, and its main additions consist of prototype-distance filtering, GMM-based clean/noisy separation, prototype-based soft relabeling, hard pseudo-label conversion, prototype interpolation, and MSE prototype regularization. These are individually well-established techniques in noisy-label learning and prototype-based representation learning. The current ablation shows that the proposed components improve the CLIP2FL backbone, but does not demonstrate that the particular design is superior to simpler alternatives such as confidence-based relabeling, loss/GMM filtering, nearest-prototype relabeling, class-balanced loss, or standard supervised contrastive regularization.
--FedPGRL introduces multiple client-side operations, including feature extraction, K-means clustering, GMM fitting, prototype construction, PCR, MPMR, CPR, and class-gradient computation, together with server-side gradient matching, federated-feature optimization, and classifier retraining. However, the paper does not report client runtime, server runtime, memory overhead, communication per round, total communication, or scaling with the number of classes and clients. This is inconsistent with the manuscript’s claims regarding improved scalability and communication efficiency, especially since the authors themselves acknowledge that runtime and memory scaling remain future work.
--The paper includes several grammatical errors, awkward expressions, inconsistent terminology, and typographical mistakes. For example, “Prototypes Contrast Refinement” and “Prototypical Contrast Refinement” are used inconsistently; “EXPERIENCE RESULTS” should be “EXPERIMENTAL RESULTS”; “distibution” is misspelled; “the left part of 3” should be revised to “the left part of Fig. 3”; “AdaM algorithm” should be written as “Adam optimizer”; and “FedPRGL” appears instead of “FedPGRL” in the appendix. In addition, the figure formatting is inconsistent: the caption of Fig. 1 is placed above the figure, whereas the captions of the other figures are placed below their corresponding figures. The manuscript would benefit from a thorough proofreading and a careful check of formatting consistency throughout the paper.
Questions for authors
--How should the prototype-based operations in PDS, PCR, MPMR, and CPR be interpreted consistently?
--CPR is described as improving both intra-class compactness and inter-class separation, but the presented objective mainly minimizes the distance between samples and their assigned class prototypes. Could the authors explain where the explicit inter-class separation is enforced?
--Since PDS relies on noisy-label-derived class information to initialize or align clusters, how robust is the clean/noisy sample selection when label noise is severe, especially for tail classes with very few samples?