- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
-
The paper highlights an important challenge in HFL: conventional model sharing and feature alignment, which require consistent feature-layer dimensions, may not work well across heterogeneous client architectures.
-
To address this, the paper proposes FedSpec, a novel three-stage HFL algorithm that leverages SVD to enable knowledge sharing without requiring dimensional consistency.
-
Comprehensive experiments show that FedSpec achieves strong performance with improved communication efficiency.
Critical strengths
The paper proposes a simple yet effective approach to HFL that applies SVD to share knowledge across heterogeneous architectures. It resolves the dimensional-consistency limitation with minimal client-side modifications, making it practical and easy to adopt.
Critical weaknesses
-
The reviewer's main concern is technical novelty. Although the paper applies SVD to representations in HFL, SVD is widely used in both centralized and federated learning, e.g., for analyzing representation compactness (Choi et al., Statistical Characteristics of Deep Representations: An Empirical Investigation) and for SVD-based compression of model updates in FL (Wu et al., Communication-Efficient Federated Learning via Knowledge Distillation). While the paper applies SVD in a well-structured way, the contribution would be stronger with methodological novelty.
-
While the experiments are comprehensive, most baselines are not designed around communicating representations, so the comparison does not clearly show FedSpec’s advantage over its relevant competitors, such as FedTGP (Zhang et al.) and FedSA (Zhou et al.).
Questions for authors
Q1. Relaxing feature-dimension consistency is useful, but its practical impact seems limited. The paper also implies that explicit feature-space alignment is problematic. Please clarify these points.
Q2. Some statements are strong or qualitative without sufficient support (e.g., lines 311–313), and some of the described properties of the spectral structure appear to overlap (lines 245–252). Please clarify these points.
Q3. In Figure 4, performance appears largely insensitive to m. Could the authors explain this quantitatively, e.g., by reporting how much spectral energy the top-m components capture?
Q4. Performance on CIFAR-100 varies noticeably with m, λ, and w. Could the authors briefly suggest a practical way to tune these hyperparameters in realistic FL settings?
Thank you for recognizing the novelty of FedSpec, its simple yet effective design for heterogeneous federated learning, its ability to relax feature-dimension consistency with minimal client-side modifications, and its comprehensive empirical validation with strong performance and communication efficiency.
W1: We agree that SVD itself is a well-established mathematical tool; the novelty of FedSpec lies in introducing a new collaboration interface for heterogeneous models. Choi et al. mainly use rank-related statistical properties to analyze and regularize deep representations, while FedKD applies SVD for low-rank compression of communicated gradients. In contrast, FedSpec maps local feature spaces with different architectures and representation dimensions into fixed-length normalized spectral structures that can be directly aggregated at the server and then fed back as a global structural prior for local optimization. Based on this interface, FedSpec further integrates spectral abstraction, spectral aggregation, and spectral correction into a complete collaboration mechanism, enabling knowledge sharing across heterogeneous models without parameter compatibility or explicit feature alignment. We will further emphasize this methodological distinction in the revision.
W2: Thank you for pointing out FedTGP and FedSA as relevant competitors. FedTGP and FedSA establish heterogeneous collaboration through class-wise prototypes or semantic anchors, whereas FedSpec uses a class-agnostic spectral structure as the collaboration interface. We additionally compare them under all six settings in Table 1. For FedTGP, the accuracies are 50.84%/35.61%, 57.92%/36.54%, and 59.83%/40.17% on CIFAR-100/Tiny-ImageNet at 20%, 10%, and 5% participation, respectively; for FedSA, the corresponding results are 51.63%/35.96%, 58.91%/36.88%, and 61.12%/41.06%. FedSpec achieves 61.94%/43.10%, 63.70%/45.09%, and 64.56%/47.30%, outperforming FedTGP by 4.73%–11.10% and FedSA by 3.44%–10.31% across all six settings. These comparisons further demonstrate the advantage of spectral-structure-based collaboration over closely related prototype/semantic-based heterogeneous FL methods.
Q1: FedSpec requires neither explicit feature alignment nor consistent representation dimensions. For client i, SRS/GRA constructs Ri∈Rm×di, whose SVD gives Ui∈Rm×m, Σi∈Rm×m, and Vi∈Rdi×m. FedSpec only extracts and normalizes the m singular values in Σi into si∈Rm. Thus, different di are naturally mapped to the same m-dimensional spectral structure without dimension matching or feature-wise alignment.
Q2: For Lines 311–313, GRA averages representations within groups from the current epoch, so each group representation integrates information from multiple samples and is therefore less sensitive to sample-level fluctuations than direct sampling. We will replace “more accurate” with “more stable/robust” to avoid an overly strong statement. For Lines 245–252, the earlier three properties are general design requirements for an effective structural abstraction, while this part explains how the spectral structure in FedSpec specifically realizes these requirements; thus, it is a concrete instantiation rather than a repetition.
Q3: We believe the reviewer refers to Appendix Figure 5. In FedSpec, m is not a top-m truncation of a fixed spectrum; instead, it determines both the number of representative features used to construct Ri∈Rm×di and the granularity of the resulting spectral structure. To further quantify the robustness to m, we analyze the cumulative spectral energy E(q)=∑k=1qσk2/∑kσk2. On CIFAR-100, the top-10/30/50 components capture 88.9%/96.1%/98.2% of the spectral energy; on Tiny-ImageNet, the corresponding values are 68.7%/84.9%/91.8%, and the top-100 components capture 97.6%. These results show that the dominant structural information is concentrated in the leading spectral components, so increasing m further introduces only limited additional information, consistent with the relatively stable performance over a broad range of m in Appendix Figure 5.
Q4: In fact, m, λ, and K have only limited impact on FedSpec. On CIFAR-100, the narrow y-axis visually amplifies small performance variations; Tiny-ImageNet is more challenging and therefore shows slightly larger fluctuations, but the overall performance remains stable. In practice, m can be selected based on spectral energy and communication/computation budgets, λ can be coarsely searched within a small-to-moderate range, and K can prioritize the later local epochs. Therefore, FedSpec does not require fine-grained hyperparameter tuning.