- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes a visual language model security control framework based on intent risk calibration, aiming to address the issues that existing security methods tend to overly reject normal requests and have difficulty accurately identifying ambiguous risks. The core idea of the paper is to first have the frozen VLM generate the initial response, and then use the Reward Model to evaluate the output security. Clearly safe responses are directly retained, obviously dangerous responses are rewritten, while for the gray area responses with uncertain security, the hyperbolic space is used to hierarchically model the image, text, and combined text-image risks, and through MLP, the input risks and output rewards are fused to determine whether intervention is needed. For the responses that need to be modified, the method learns the safe direction through the hidden state differences between safe and unsafe samples, and combines the reward-guided Hidden-State Steering to achieve safe rewriting. Experiments show that this method significantly reduces the attack success rate while improving the usefulness of the responses.
Critical strengths
The main strength of this paper lies in the selective safety intervention mechanism based on gray-zone decision-making. Different from traditional global safety intervention methods, this approach prioritizes the assessment of the safety of the response based on the output rewards, and only introduces multimodal input risks for joint decision-making when the judgment is uncertain, thereby reducing unnecessary modifications to the safe response. Generally speaking, there is usually a trade-off between model safety and usefulness, but this method improves both indicators simultaneously through targeted intervention. Compared with global intervention strategies, the gray-zone decision-making mechanism achieves a lower attack success rate and higher response usefulness, demonstrating the effectiveness and practical application value of this design.
Critical weaknesses
One of the key innovations proposed in the paper is based on hyperbolic space and it is claimed that it can effectively represent complex hierarchical structures. However, the actual method only divides multimodal risks into four predefined levels and measures the risk by the distance from the sample to the safety reference point. This modeling approach essentially relies on one-dimensional radial risk ranking and does not explicitly utilize the representation ability of hyperbolic space for complex branching hierarchical relationships. Moreover, the authors also admit in the appendix that Euclidean space can also satisfy these risk ranking constraints. This makes me question the necessity of hyperbolic space. Additionally, if the proposed risk structure does not require the special geometric properties of hyperbolic space, then using a more complex hyperbolic representation would introduce unnecessary overhead.
Questions for authors
- This article assumes a fixed risk ranking order: SS < SU < US < UU. Can the basis for this specific ranking be explained? If you quote someone else's argument, you should include the citation.
- The uncertain responses are identified based on the distance between the reward score of the Reward Model and the preset threshold, and the responses that are judged to have high confidence and are considered safe are directly retained. Could you explain the calibration degree of these reward scores? In particular, how many actually unsafe responses were wrongly classified as having high confidence and thus bypassed the subsequent joint security assessment of input and output? Or, how was the threshold determined? Please provide an explanation.
- This paper combines the Reward Model, hyperbolic risk encoder, gray area decision module, and hidden state-guided secure rewriting. It is necessary to analyze how much of the final performance improvement comes from more accurate identification of unsafe responses, and how much comes from more effective secure rewriting? Abandonment experiments should be supplemented to clearly address this part, or they should be added in the appendix.
- The model selected for the experiment is relatively outdated. I understand the author's work schedule for the article, but I think at least a set of models for 2026 should be added, such as qwen-3.5.