- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes PROOF, a profile-routing framework for balancing safety and utility in frozen LLMs. PROOF composes a fixed set of LoRA adapters into multiple safety profiles and trains an MLP controller to route each input to the most appropriate one. The central contribution is a tie-aware supervision objective: rather than assigning a single hard label, it spreads probability mass over all profiles that tie for the lowest observed cost.
Critical strengths
The paper is well structured, addresses a critical problem in LLM safety, the trade-off between over-refusal and harmful behavior. The distinction between prompt-only routing and candidate-conditioned selection is clearly explained, with inference costs measured for both settings. The experimental analysis is properly designed and analyzes both positive and negative results.
Critical weaknesses
The proposed soft-label like objective has limited novelty beyond existing soft-label methods.
The comparison against hard-label cross-entropy alone is insufficient to establish its effectiveness. Additional baselines are needed to determine the effectiveness of the proposed method.
As the method designed to pre-combine the profile, numbers of K files limits the combinations or flexibility of the profile. Why the author did not choose to let the MLP predict a continuous value as the mixing weight and flexiblely combining both LoRA for each request? In table 3, the advantage of the proposed method gradually fall behind the CE-based method, which increasingly raise my concern about the efficacy of the propose PROOF.
Questions for authors
Though AI usage is disclosed, current presentation is not clear or formal enough for ICLR paper. Specifically for Figure 1, at the bottom of the figure, there is "select from existing candidates ", the presentation is even not clear to identify "a" or "e".