- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Deployed LLM systems utilize multiple safety guards, combining their outputs through statistical methods. Analysis shows a strong correlation among guards, leading to a collective failure rate of 12–13% on unsafe responses, compared to 0.03% when considered independently. This correlation disrupts naive fusion methods, inflating false-alarm rates beyond nominal levels, with practical rates exceeding 5% in six out of seven scenarios. Additionally, the model suggests that the effectiveness of combining guards is limited by their correlation, impacting potential detection gains. An adaptive cascade approach does not consistently outperform a simpler static subset of guards, which maintains nearly all detection capabilities at a controlled false-alarm rate of 5% with lower memory requirements.
Critical strengths
- The manuscript provides strong theoretical contributions.
- Also, the authors conduct an extensive and careful empirical evaluation.
- The paper shows that safety guards are strongly correlated, not independent evidence sources.
Critical weaknesses
- The findings may not generalize to newer guards, different architectures, or guards that are less correlated.
- The paper does not measure latency and prompt length.
Questions for authors
-
This is a strong and timely paper. Its main contribution is not a new fusion algorithm but a rigorous diagnosis of why common fusion practices fail, plus a practical finite-sample calibration method that restores false-alarm control under weak assumptions.
-
My only concern is the experimental dataset. A wider evaluation will enhance the reliability of the findings.