- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies a safety issue introduced by optical context compression in long-context multimodal agents. Existing context compression methods mainly evaluate whether models can preserve semantic understanding and downstream task performance after converting text into visual representations, but they rarely examine whether safety alignment is preserved during this representation shift. The authors identify the Refraction Gap, where identical safety-sensitive content that is refused in plain text can be fulfilled when delivered through optical representations. The paper proposes the Refraction evaluation framework, which compares raw text, optical payload rendering, and visual memory compression under controlled paired settings. Experiments on five multimodal models show that optical compression largely preserves semantic and utility performance while substantially increasing unsafe responses. The authors further introduce GapBridge, a lightweight text-based risk router that detects vulnerable inputs before optical conversion and selectively keeps them in textual form.
Critical strengths
-
The paper identifies a practical safety failure mode in multimodal agents. Unlike conventional jailbreaks requiring adversarial images, the Refraction Gap emerges from the agent’s own text-to-visual transformation process. This highlights an important limitation of current safety evaluations for optical context compression.
-
The paired evaluation framework provides strong evidence that capability preservation does not guarantee safety preservation. By controlling content and models while varying only the representation modality, the authors show that optical compression maintains semantic and task performance but significantly weakens safety alignment.
-
The proposed mitigation demonstrates practical applicability. GapBridge introduces a lightweight pre-conversion risk router that avoids costly model retraining and reduces exposure to the identified vulnerability by selectively keeping risky inputs in text form.
Critical weaknesses
-
The paper does not sufficiently establish the generality of the Refraction Gap beyond the specific evaluated compression pipelines. The main limitation is that the claimed phenomenon is validated only on two optical transformations (Glyph-based payload rendering and MemOCR-based memory compression) and five open-weight multimodal models. While the results are consistent within this setting, it remains unclear whether the Refraction Gap is a general property of representation changes or a consequence of specific rendering formats, model architectures, or safety training procedures. Broader validation across more diverse compression mechanisms would be necessary to support stronger claims.
-
The mechanism behind safety degradation remains largely speculative. The paper argues that visual representations fail to activate safety-related internal representations as effectively as text, but the experiments mainly demonstrate behavioral differences rather than explaining their cause. The discussion suggests possible post-training asymmetry between text safety tuning and visual understanding, but no mechanistic analysis, representation probing, or causal intervention is provided. Therefore, the work identifies an important phenomenon but provides limited insight into why the failure occurs.
-
The proposed GapBridge mitigation is not sufficiently evaluated as a complete defense. GapBridge only detects around two-thirds of vulnerable cases, meaning a substantial fraction of Refraction Gap instances remain undetected. Moreover, the detector is trained using a specific proxy formulation involving harmful intent and structural patterns, which may not capture diverse real-world failure modes. The paper demonstrates feasibility but does not yet establish that the proposed mitigation provides robust protection in realistic agent environments.
Questions for authors
-
How much of the observed Refraction Gap is caused by the visual representation itself versus specific rendering styles used by Glyph and MemOCR? The paper attributes the safety degradation to the modality transition from text to optical representations, but both evaluated operators introduce specific layout and formatting choices. Could the authors evaluate whether the same vulnerability persists across alternative rendering strategies with different layouts, resolutions, or visual encodings?
-
Can the authors provide more evidence about the internal cause of the safety alignment failure? The paper suggests that visual pathways may not effectively trigger refusal-related representations, but the current evidence is primarily behavioral. Have the authors investigated whether hidden representations, attention patterns, or safety-related activation features differ between raw text and optical conditions?
-
How does the Refraction Gap behave in more realistic long-horizon agent interactions? The current evaluation uses isolated prohibited requests under controlled paired settings. In practical agents, harmful information may emerge through multiple interaction turns and accumulated memory. Can the authors evaluate whether the same failure occurs when safety-sensitive information is gradually introduced and later accessed through compressed visual memory?