- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces CMMSafe, a benchmark that complements existing multimodal safety evaluation for MLLMs by focusing on consequence-driven safety risks. It also proposes CASPO, a reinforcement learning algorithm designed to improve MLLM safety against such risks.
Critical strengths
- The paper clearly describes both the benchmark construction pipeline and the reinforcement learning algorithm, facilitating reproducibility and providing a useful foundation for future research.
- The paper presents extensive experiments across multiple benchmarks, including those most relevant to the proposed task, providing a comprehensive evaluation of the proposed method.
Critical weaknesses
-
Insufficient Evidence for the Preference Ceiling. The observed limitations of DPO may stem from a training–evaluation distribution mismatch, as BeaverTails-V primarily targets conventional multimodal safety rather than latent hazards under benign requests. Without a DPO baseline trained on the same consequence-driven data as CASPO, it is difficult to determine whether the improvements come from the proposed optimization method or the additional in-domain training data.
-
Limited Evidence of Cross-Benchmark Generalization. CASPO achieves its strongest gains on CMMSafe, while improvements on MSSBench are less consistent. Since the training set includes 1,583 consequence-driven samples constructed using the same pipeline as CMMSafe, the strong performance may partly reflect a closer match between training and evaluation distributions. An ablation excluding these samples would help establish whether the improvements generalize beyond the target benchmark.
-
Scalability and Generalization to Unseen Safety Categories. CMMSafe relies on manually designed examples and human-in-the-loop filtering, which may limit its scalability beyond the current six safety categories. Furthermore, CASPO's reliance on category-specific constitutions raises questions about its ability to generalize to unseen hazards. A leave-one-category-out evaluation would provide stronger evidence of cross-category generalization.
Questions for authors
The motivation and novelty of CMMSafe remain somewhat unclear to me. Existing benchmarks, particularly MSSBench, have already investigated safety risks arising from the interaction between benign user requests and visual contexts, including the potential consequences of actions. Could the authors clarify (1) the key differences between CMMSafe and MSSBench, and (2) how the proposed Consequence-Driven Safety differs from the consequence reasoning already studied in existing embodied safety benchmarks? In particular, what unique safety failure modes does CMMSafe capture that are not adequately covered by these prior benchmarks?
5 comments
Response to Reviewer S578 (2/2)
Q1–Q2. What differs from MSSBench and embodied consequence reasoning?
(1) Evaluation focus. MSSBench asks whether an intended activity is safe in its visual setting: for example, running advice beside a cliff. Its embodied tasks assess requested household operations. In CMMSafe, the request is benign, but the image and query make the risk clear. For example, a user asks for book recommendations while the image shows a crib beneath a loaded bookshelf. The model should warn about falling objects before suggesting books. This tests proactive safety awareness beyond judging whether a requested action is safe in a given situation.(MSSBench, Fig. 1 & CMMSafe, Fig. 3)
(2) Construction direction. MSSBench-Chat follows image → intended activity → unsafe context → image retrieval and query generation. CMMSafe follows harmful consequence → supporting visual scene and benign query → causal and quality filtering. We refine the query to sound like an ordinary request and filter out cases that depend on unstated actions or intentions. (MSSBench, Sec. 3.2 & CMMSafe, Fig. 2)
Revision Plan. We will clarify these two distinctions with examples in Sections 1–2 and Figure 1, and add the construction counts to Section 3.1. The matched-DPO and data-removal results will be added to Section 3.2.3, Figure 5, and Section 4.3; Appendices B.2–B.3 will give data, checkpoint, and evaluation details. Appendix A will expand the benchmark comparison and data-boundary information.
Dear Reviewer S578,
Thank you again for your feedback.
As the discussion period ends soon, we wanted to kindly check whether our response has addressed your concerns. We are happy to clarify anything further.
Best regards, The Authors
Response to Reviewer S578 (1/2)
We thank the reviewer for the careful review and the suggestions for strengthening the paper.
Summary. (i) The matched-data DPO experiment reproduces the smaller absolute gain on Qwen3-VL on CMMSafe (W1). (ii) After removing consequence examples from teacher SFT and actor RL, R0 remains 8.13% and 15.16% on the two backbones, with strong external transfer (W2). (iii) CASPO transfers to SIUO and MSSBench-Embodied, including visual settings distinct from its training data (W3). (iv) CMMSafe and MSSBench differ in what they test and how their examples are constructed (Q1–Q2).
W1. Could the preference-ceiling result come from distribution mismatch?
We use “preference ceiling” to describe the smaller gain from a fixed preference pool on the stronger baseline in these experiments. Below, both backbones are trained on the same 3,304 pairs from CASPO's prompt pool, including 1,574 consequence-driven pairs. Queries and preferred answers follow the CASPO data; rejected answers are filtered candidate responses.
DPO lowers R0 by 42.64 percentage points on Qwen2.5-VL-7B and 28.94 points on Qwen3-VL-4B.
W2. Could same-pipeline training examples explain the gains?
The gains largely remain without those examples in teacher SFT or actor RL. We removed consequence-driven examples from both paths and retrained the teacher; the outcome RM was held fixed.
The removal variants reduce R0 by 59.27 and 73.41 percentage points over their respective bases. They preserve most of the full method's improvement. The external results show transfer as well:
On Qwen3-VL-4B, SIUO safety/effectiveness is 80.95%/94.01% after removal, versus 89.82% / 92.81% for the full reference. The strong CMMSafe gains and external transfer therefore do not require retaining same-pipeline examples in teacher SFT or actor RL.
W3. Scalability and generalization to unseen hazards
The candidates are generated and filtered automatically; manual review checks wording, visual evidence, and causal plausibility. The curation counts are 6,052 generated pairs, 5,257 after automatic filtering, 480 after review and rewriting, and 455 after category-level resampling.
Training and CMMSafe test examples are disjoint, although their scenario distributions overlap. We did not construct training data to match SIUO or MSSBench, and the embodied images differ substantially from our training image. Qwen2.5-VL-7B reaches safety/effectiveness of 88.02%/92.81% on SIUO and 94.74%/85.53% on MSSBench-Embodied. The student carries this learned safety behavior into different visual settings using ordinary image–query inputs.