- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes FedAura, a federated learning scheme for the model-heterogeneity setting in which clients run pre-trained backbones of different architectures and sizes (CNN and ViT families). Instead of aggregating model weights or logits, each client freezes its backbone and learns a pixel-level visual prompt in the input space; because the prompt's dimension depends only on image resolution and is decoupled from the backbone, the server can aggregate prompts across heterogeneous architectures with plain FedAvg. To stabilize aggregation, FedAura adds two InfoNCE-style regularizers during local training: a model-contrastive loss aligning the prompted representation to the unprompted backbone representation pulling the local prompt's representation toward that of the global prompt.
Critical strengths
-Framing cross-model adaptation as aggregating an architecture-agnostic, input-level artifact is a practical and under-explored direction. The design is simple, parameter-light, and conceptually extends federated prompting beyond the homogeneous/Transformer-only settings that bound prior work.
-Beyond the main table, this work also includes more ablation studies to better understand the method design and the contributions of each component.
Critical weaknesses
-The authors' own motivation study (Fig. 3) shows prompts are strongly model/data-dependent: applying a prompt trained on one client to another architecture drops accuracy from 0.788→0.625 (ViT-Small) and 0.594→0.486 (ResNet-18) on CIFAR-10, with further drops under Model+Data-Het. Given that the aggregated global prompt is re-applied to different backbones each round, the entire premise rests on the global prompt transferring well — yet the paper never compares FedAura against each client training its own prompt in isolation (with the same two losses, no aggregation). All ablations (Table 3) keep the federated aggregation loop, so the "cross-model knowledge sharing" contribution is not isolated. Without this baseline, the reported gains could in principle come from the regularizers alone rather than from federation.
-The paper's central architectural premise, combining a server-aggregated global prompt with client-local prompt optimization, is not novel: this global/local prompt cooperation paradigm is already established in PromptFL, pFedPrompt/PromptFed, and PLAN (all cited by FedAura itself), and most directly in the CVPR 2026 work Controllable Federated Prompt Learning at Test Time (Zhu et al., COTE), which dynamically balances global and local prompts alongside a frozen CLIP prompt. FedAura's prompt-contrastive loss is functionally the same drift-alignment/personalization regularization these methods use, so the only genuinely new element is the pixel-level, input-space prompt interface that decouples from backbone architecture.
-Table 1 reports HeteroFL at 53.31% (CIFAR-10, IID) — far below the accuracy HeteroFL reports in its own paper on the same data, suggesting under-tuning; FedEcover similarly collapses on Tiny-ImageNet. Meanwhile several strong heterogeneous-FL methods cited in the related work (FedDSE, FlexiFed, FedDecorr) are never compared. The "up to 18.40%" abstract claim is also not traceable to any single Table-1 entry (closest is +18.01% on CIFAR-10 β=1 vs. FedMD; e.g., Flower-102 β=1 vs. FedMD is +19.09%). With the strongest competitors absent and remaining baselines apparently under-tuned, the reported margins are not conclusive.
-Figure 1 is a schematic restatement of the model-heterogeneity definition with no added insight and could be dropped, while Figure 2, the only method figure, is a generic block diagram that never shows where the pixel prompt is injected, how the two contrastive losses act on the four representations, or the aggregation vs. local-head data flow.
Questions for authors
-Can the authors report a no-federation control: each client trains its own prompt locally with the same two losses but no aggregation? This is the single most important experiment for validating that the global prompt transfers knowledge across heterogeneous models (given your own Fig. 3 shows prompts are highly model-dependent).
-Why do HeteroFL and FedEcover perform far below their published results on the same datasets? Please report results with the authors' recommended hyperparameters, and add comparisons with the heterogeneous-FL baselines you cite but do not evaluate (e.g., FedDSE, FlexiFed).
-In Eq. 8, repels the prompted representation from the previous round's prompted representation of the same image. What is the motivation for using a temporally adjacent state as the negative, and did you ablate alternative negatives (e.g., other samples or the global-prompt representation as negative)?