- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies implicit reasoning risks in multimodal models, where individually benign inputs can jointly lead to unsafe responses. The authors observe that Thinking with Images (TwI) is safer than Text-CoT and attribute this advantage to reduced “Semantic Slippage Escape.” They propose AnchorGuard, which adaptively projects hidden states toward a concept subspace during generation. Experiments cover four main safety benchmarks, multiple reasoning configurations, and three backbone models. The reported results show improved safety while largely preserving task utility.
Critical strengths
1.In Table 2, AnchorGuard outperforms the strongest defense baseline in each of the six reasoning configurations, improving aggregate safety rates by 3.9–6.6 percentage points. Task utility remains close to the undefended configurations, and results on additional backbones support its broader applicability.
- Random-subspace controls, component suppression, and comparisons involving random images and textual descriptions provide evidence about the relationship between task-relevant information and safety.
Critical weaknesses
-
The escape subspace is constructed from whether responses depart from concrete facts, but factual departure is not equivalent to hypothetical or euphemistic “semantic slippage.” The experiments support the value of concept-related information for safety, but do not sufficiently distinguish general grounding improvements from the proposed slippage mechanism. Consequently, the explanation for why TwI is safer remains incomplete.
-
The paper does not clearly explain how the six reasoning methods are implemented on the same backbone or which data split is used for hyperparameter selection in Figure 10. These omissions limit assessment of comparison fairness and reproducibility.
Questions for authors
-
What are the precise annotation criteria for escape/non-escape responses? What evidence distinguishes semantic slippage from ordinary factual errors, visual recognition errors, or differences in response style?
-
How are the textual descriptions in Table 12 generated? Can the results distinguish recovering previously missed visual information from suppressing semantic slippage during reasoning? Please also clarify the sample size and uncertainty of these results.
-
Which checkpoints, prompts, and tool procedures are used for the six reasoning configurations? Which data split is used for hyperparameter selection in Figure 10, and how is it kept separate from final evaluation?
Thank you for the clarifications
Thank you for your response. I still have a few questions. First, the new controls help distinguish semantic escape from other errors. However, they do not separate concept anchoring from general grounding improvements. Please make this distinction clear in the revised paper. Thank you for clarifying Q2. However, please answer the question about sample size and uncertainty clearly and precisely. Finally, the reproducibility details are still too general. These details should be easy to state clearly, but the current response does not do so. So, I believe my current rating appropriately reflects the paper’s contributions.