- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The authors try to take a systematic look at attack transfer from surrogates and ensembles of surrogates to target models. The authors find some expected results (e.g., attacks that break more surrogates are more likely to break targets too), and some less obvious ones (e.g., diminishing gains after only ~4 ensembled models and only slight benefits from using hardened surrogates). The proposed transfer attack framework "CAST" relies on attacking an ensemble of four models and iteratively re-writing the attack prompt using TextGrad; the method shows improvements on open models and slight improvements on frontier models thought data there is weaker.
Critical strengths
- The authors find clear connections between how many surrogates are defeated by an attack and how likely the attack is to transfer. This finding is supported by clear evidence and has implications for attacks in practice (e.g., to estimate the likelihood of transfer for new prompts).
- The comparison study uses standard data and is quite thorough, with 34 models and nine baselines (though the most relevant attacks - transfer-focused ones like ArrAttack, or Diffusion-LLM-based attacks are missing). LLM Red Teaming historically suffered from fragmented evaluations and relying on stable, known baselines helps create trust in new results and makes them easier to reproduce.
Critical weaknesses
The key weakness of this paper is its unclear writing and presentation which makes it very difficult to understand what is being done/shown and to understand the motivations behind why it is being done. As an example, the theory section appears overcomplicated and out of place with the rest of the paper. It is not clear how the theory helps motivate or understand the findings/method, which are rather simple (nothing wrong with that, it just doesn't fit with the other section). The paper also uses a lot of different non-standard terms for similar concepts - for example candidate, configuration, policy, surrogate, source, ensemble, direction, group, ... which adds significant cognitive load to the reader.
Questions for authors
- Can you clarify how the theory connects to the empirical results or the proposed method?
- How do attacks designed for transfer, like ArrAttack or Diffusion-inpainting attacks compare to CAST?
- Have you run experiments with different ensembles than the Llama-2, Llama-3.1, gpt-oss-20b, Qwen2.7 set mentioned in 4.2?