- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a new federated multi-label learning framework named PathwayFed, aiming to mitigate the dilution of client-specific contributions during aggregation under heterogeneous local data distributions and label co-occurrence patterns. Its core essence lies in training a multi-label prediction head on frozen CLIP features, then selectively incorporating client contributions based on specific parameters while attenuating updates that conflict in direction. This paper validates the effectiveness of the proposed model through experiments on three visual datasets with varying degrees of heterogeneity, alongside comparisons with seven baselines.
Critical strengths
a. The experimental section is quite comprehensive, covering varying degrees of heterogeneity, ablation study, routing weight shuffling, normalization control, and partial client participation.
b. The pathwayFed framework is well-structured. Clients Clients refine pathway-related representations through expansion and sparse representation, while the server combines parameter-level routing with conflict projection. Furthernore, the overall framework a comprehensive solution addressing the issue where aggregation dilutes the specialized expertise of heterogeneous clients.
Critical weaknesses
a. The advantages of PathwayFed under mild heterogeneity are limited in visual scenarios. The performance improvements on PASCAL VOC 2007 and MS-COCO 2014 under mild heterogeneity are limited, with results sometimes even falling below the strongest baselines on some metrics.
b. The justification of the key routing mechanism is insufficient. There remains an explanatory gap between the use of update magnitude as a proxy for knowledge contribution and the retention of useful client-specific knowledge emphasized in the paper.
Questions for authors
a. The captions for Table 1 and Table 8 indicate that the gains are calculated relative to the strongest existing method. However, some figures appear to be based on weaker baselines. Could the authors verify all the gain entries and clarify whether the corrected values affect the discussion of the results?
b. Regarding the primary experimental results in Table 1, the authors should consider specifying the conditions under which the advantage emerges or defining the scope of applicability.
c. The values in Table 3 (main text) and Table 12 (appendix) differ, even though both use the COCO (K=80) setting. Is there a difference in the configuration? Several other tables and figures exhibit similar issues.
d. Can the authors clarify the relationship between the activation-based pathway contribution in Eq. (7) and the update-based routing scores in Eqs. (10)–(12)? It would be best to provide a brief theoretical analysis of the entire PathwayFed model.