- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies the problem of malicious clients undermining safety alignment during federated LLM finetuning. Motivated by the limitation of conventional defenses that rely on statistical or geometric outliers in client updates, the authors propose a safety-aware client filtering method that is intended to better handle heterogeneous client data. The method constructs a reference safety-degrading direction from the parameter difference between a safety-aligned model and a harmful-finetuned model, scores each client update using layer-wise cosine similarity with this direction, and applies a GMM-based filtering procedure. Experiments cover different poisoning ratios, levels of client heterogeneity, model architectures, and attack settings, and evaluate the resulting safety–utility tradeoff.
Critical strengths
- The problem is practically relevant. Client data heterogeneity in federated LLM finetuning can indeed make conventional robust aggregation methods less reliable. Detecting unsafe clients based on safety-relevant parameter changes is a reasonable and well-motivated direction.
- The experimental evaluation is fairly comprehensive. The paper considers different poisoning ratios, levels of client heterogeneity, and model architectures, and compares against multiple robust aggregation and safety-oriented baselines. Overall, the results provide useful empirical support for the proposed approach.
- The additional analyses help support the main hypothesis. The transferability study, computational cost analysis, and adaptive attack experiments are useful. In particular, the observation that removing the component aligned with the reference direction also weakens the safety-degrading effect of the malicious update is interesting.
Critical weaknesses
- The methodological novelty is somewhat limited. The proposed method mainly combines a pre-computed safety-degrading direction, cosine-similarity-based scoring, and GMM-based client filtering. These individual components are relatively standard, and the main contribution appears to be their application and combination in the federated LLM safety setting rather than a substantially new mechanism.
- The generality of a single reference direction remains unclear. Although the paper evaluates transfer across different harmful datasets, the experiments mainly focus on explicit harmful instruction finetuning. It is not clear whether a fixed reference direction would remain effective for safety degradation caused by stealthier poisoning strategies or other training behaviors.
- The two-component GMM introduces an additional assumption. The method assumes that the client risk scores can be separated into two components in each communication round. In practice, however, a round may contain no malicious clients or only a very small number of them. In such cases, forcing a two-component decomposition may incorrectly reject benign clients.
- The analysis of heterogeneity is not yet fully convincing. The paper argues that task variations orthogonal to the safety-degrading direction do not increase the risk score. However, cosine similarity is also affected by the magnitude of the client update through its denominator. A more careful analysis is needed to explain how heterogeneous update magnitudes affect client scoring and the separation between benign and malicious clients.
- The adaptive attack evaluation is still limited. The current adaptive attack mainly removes the projection of the malicious update onto the reference direction. While the experiments show that this weakens the attack itself, they do not rule out the possibility that an attacker could jointly optimize for safety degradation and evasion, potentially finding another harmful update direction with a low detection score.
Questions for authors
- Applicability of the GMM. If a communication round contains no malicious clients, or only one malicious client, can the two-component GMM still work reliably? It would be helpful to include corresponding experiments and report the false rejection rate of benign clients.
- Generality of the reference direction. Beyond explicit harmful instruction finetuning, can the proposed method detect safety degradation caused by stealthier poisoning or seemingly benign training data? Are the current transfer results across harmful datasets sufficient to support a more general conclusion?
- Has the paper considered an attacker that directly and jointly optimizes the safety-degradation objective and the detection-evasion objective, rather than only removing the projection of the existing update onto the reference direction? Would the defense remain effective in this case?
- When a benign client update has only a small projection onto the reference direction but a substantially larger orthogonal component, how are the cosine similarity score and client detection performance affected? The authors are encouraged to further clarify this point.
- Does the proposed method remain effective when the LoRA rank, target modules, or local optimization settings are changed? Is it necessary to reconstruct the reference safety-degrading direction for different finetuning configurations? Please provide further validation.