- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces a federated prompt-learning framework that uses unknown-aware prompts and attribute-semantic injection to recognize known classes in unseen domains and identify unknown classes when clients have limited labeled data.
Critical strengths
The paper considers a timely novel problem: open-set domain generalization, and the performance is slightly higher than the benchmarks.
Critical weaknesses
The technical contributions of the paper are very limited; specifically, for the first contribution, the problem already exists, you discussed it, and highlighting it in a federated setting is not a contribution. Secondly, all of the components are adopted from the OSLoPrompt and slightly change the used term: X-attention from OSLoPrompt à ASI in the current paper, the use of LLM to generate the attribute for attention, the two prompt approaches one for classification and one for domain-specific (they change the terms to Shallow and Deep), and even the loss alignment between features. The only new things here compared to the OSLOPrompt paper are the residual prompt (more things to train), the class-diversity loss, and the federated learning setting, while the rest of the components of the system are adopted. However, they do not put references in the equations and in sections 4.2- 4.4, which makes reviewers and readers misunderstand that this is their proposal, I would mark this as a highly misleading paper and strongly oppose the acceptance of the paper.
Questions for authors
Please refer to my critical weaknesses.
2 comments
Response to author
Thank you for the response. However, I remain unconvinced by the claimed technical contributions, as most components are adopted from OSLoPrompt with limited modifications, and applying them to a federated setting does not sufficiently establish methodological novelty; therefore, I maintain my original score.
Reply to Reviewer daiM
Thank you for your time and the constructive feedback on our manuscript. We thank the reviewer for the direct critique.
Response to the question of contribution
We thank the reviewer for the direct critique and agree that "highlighting" the FODG problem is not itself a technical contribution. We note, however, that the reviewer lists the federated learning setting among the new elements relative to OSLoPrompt, so we respectfully disagree that federation contributes nothing—what we concede is the current wording, not the setting. Concretely, FODG imposes three constraints that do not co-occur in OSLoPrompt: heterogeneous and only partially overlapping label spaces across clients, a lightweight prompt as the only shareable object, and instance-level visual-semantic grounding that must remain local and non-aggregatable. These constraints jointly determine the method structure rather than wrapping a centralized method in FedAvg, and the revised contribution list will be built around them. If the reviewer has a specific prior work in mind that already formalizes FODG, we would be grateful for the reference and will cite it and clarify the difference; to our knowledge, a formulation combining heterogeneous partial label spaces with a prompt-only communication constraint has not been systematically established.
Clarificaiton for the components
We clarify that X-attention is not our innovation, and the revision will cite OSLoPrompt in Eqs.(1)-(10) and Sections 4.2-4.4. Our contribution is how these components are adapted under federation. Building on centralized ODG, we found that cross-attention (our ASI) is unsuitable for aggregation: with scarce, heterogeneous client data, aggregated cross-attention parameters cancel out and damage local grounding. This motivated the prompt-only protocol-ASI stays local, only prompts are aggregated-a design derived from the federated constraint, not an engineering simplification. Consequently, Lalign changes meaning: it aligns the globally aggregated prompt with locally diverged ASI modules, not two jointly optimized prompts. aunk is the negative mean of known attributes, requiring no synthesized open-set images and forming an active rejection boundary locally; Table 2 ablates it against four alternatives. Shallow/Deep prompts are adapted and will be explicitly marked, with the residual form in Eq.(2) as our addition. In short, federation changes which objects are aggregatable, and correspondingly the alignment semantics, the unknown anchor, and the regularization design.