- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper studies false safety consensus in federated LLM agents. Multiple clients may agree on an unsafe decision because they share similar blind spots. Meanwhile, different clients may follow different local policies, making direct aggregation unreliable. To address these issues, the authors propose FedSafeBelief. It represents client safety knowledge as structured beliefs and keeps each belief tied to its local policy scope. The method aligns beliefs across clients, checks their policy scopes, searches for counterevidence, and verifies potential errors before making corrections. It also follows a fix-not-add rule, which only allows existing client beliefs to be corrected rather than adding new ones. The paper provides theoretical results on rule union, shared errors under consensus, and error reduction through verified correction. Experiments on controlled settings, harmful-request benchmarks, and heterogeneous policy settings show that FedSafeBelief improves belief precision and reduces unsafe decisions compared with several aggregation baselines.
Critical strengths
- This paper highlights that agreement among federated agents does not necessarily imply a safe or correct decision.
- FedSafeBelief considers both shared unsafe errors and differences in local policies, and the fix-not-add design helps preserve client-specific knowledge.
- This paper evaluates belief quality response-level safety, policy heterogeneity, robustness, ablations, and system cost, and shows consistent improvements over the considered baselines.
Critical weaknesses
- The method mainly combines scope checking, counterevidence generation and verification, and field-level correction. These components are reasonable, but the overall pipeline appears relatively straightforward.
- The method relies heavily on counterevidence generation and verification, but there is no strong baseline that applies the same verification process locally without cross-client information. This makes it difficult to isolate the benefit of the federated design.
- The main theorem essentially assumes successful error correction and then shows that the remaining error decreases. It does not establish why the proposed method can achieve such correction in practice, making the theoretical guarantee somewhat circular.
- Some results follow directly from their assumptions. For example, the error contraction result assumes a lower-bounded probability of correctly repairing an error. The analysis does not explain how this probability depends on the actual components of FedSafeBelief.
- Most baselines are simple aggregation strategies such as rule union, majority voting, confidence weighting, and scope filtering. Comparisons with stronger verification- or critic-based methods would better demonstrate the advantage of FedSafeBelief.
- Since verification is a key component of the method, it is unclear how incorrect or unreliable verification affects belief correction and whether such errors may introduce new safety risks.
Questions for authors
see weaknesses.