- Rating
- 3(+2)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes the Generative Visual Semantic Cipher Attack. GVSCA is a black-box jailbreak against multimodal large language models (MLLMs). The attack works by 1) encoding harmful instructions as objects within a model-generated scene and 2) providing semantic mappings needed to reconstruct the original instruction. The model reconstructs the harmful instructions, but the process avoids triggering the safety mechanism. The paper also includes evaluation against defences and comparisons with a textual-only counterpart.
Critical strengths
- The paper had a broad evaluation against 11 diverse MLLMs
- The paper evaluates different defenses against the proposed GVSCA attacks
- The paper is properly written and easy to follow
Critical weaknesses
The authors have addressed this concern in the revised manuscript. Therefore, I reassess the paper and increase my score to a Weak Accept.
Pre-rebuttal "Jailbreaking Vision-Language Models Through the Visual Modality" Azulay et al. ICML is an extremly closely related work that is neither cited nor compared against. The abstract of this paper states that "Generative Visual Semantic Cipher Attack (GVSCA) [is] a black-box framework that encodes instruction components as recognizable surrogate concepts within a single generated natural scene." Azulay et al.: 1) propose a visual cipher attack, and 2) explore the idea of "recognizable surrogate concepts" by replacing harmful concepts with benign ones and instructing the model to reconstruct the original meaning. This paper should be cited, and the differences should be properly discussed.
To be specific:
- Both works encode harmful instructions as visual ciphers. Azulay et al. use an image with 1) a sequence of visual symbols and 2) a decoding legend. GVSCA maps instruction components to objects in a generated scene.
- Both works use benign visual objects to represent harmful concepts.
- Both works provide instructions for decoding the visual input.
- Both works rely on the model reconstructing the harmful instruction. Azulay et al. ask the model to decode the visual cipher and execute the resulting instruction. GVSCA asks the model to identify objects, apply the mappings, and reconstruct the original instruction before responding.
- Both works exploit the same weakness. Verbatim: GVSCA: models can "reconstruct harmful instructions from distributed visual and textual cues while failing to reliably apply safety constraints to the recovered intent." Azulay et al. study "whether visual context can reconstruct the latent harmful intent, thereby isolating cross-modal safety failures rather than purely textual ones."
- Both works include ablation experiments comparing image attacks with text-only variants (which is in principle good, but the novelty of this submission cannot be claimed based on this ground).
The main difference seems to be that Azulay et al. use visual symbol sequences and object replacements, while GVSCA combines the visual objects into a single generated scene.
Questions for authors
To be clear, I am not claiming that the omission of Azulay et al. IMCL is intentional. However, the issue remains, and analysis of related work is one of the many responsibilities of researchers. Therefore:
- Could the authors please clarify why Azulay et al. is omitted?
- Could the authors clarify the novelty of the paper relative to Azulay et al.?
- Could the authors experimentally compare GVSCA against the visual cipher attack of Azulay et al.?
I am in no way adversarial against this work. I am open to revising my score to acceptance depending on the authors' responses. I believe that the issue could be addressed in the rebuttal; however, with such closely related work, all 3 questions above need to be addressed to influence my score.