- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the latent adversarial training and proposes Target-free Latent Safety Alignment to improve jailbreak robustness by increasing the behavioural diversity of latent adversaries. Unlike prior LAT methods that optimise individual interventions toward fixed harmful targets or refusal-ablation directions, the proposed method jointly learns multiple latent intervention directions and maximises the nuclear norm of their induced behaviour-shift matrix. The resulting adversaries are then used to align safety while preserving benign utility. Experiments across multiple jailbreak attacks show improved robustness with limited utility degradation
Critical strengths
-
The motivation and method are clear, and the visualization is helpful.
-
The authors provide sufficient evidence to support the effectiveness of their proposed method.
-
This paper is well-written, making it easy to follow.
Critical weaknesses
-
The claimed advantage over prior LAT in terms of behavioural diversity needs a stronger justification. The paper argues that prior LAT is behaviorally narrow because each optimisation step constructs a single intervention, whereas the proposed method jointly learns multiple directions. However, a single intervention per optimisation run does not necessarily imply a single-mode adversarial distribution: prior LAT could potentially generate diverse interventions through different prompts, initialisations, or repeated optimisation. A more controlled comparison under matched numbers of adversarial directions/samples would better establish whether the improvement comes from the proposed objective rather than simply generating more interventions.
-
The connection between the target-free objective and harmful behavioural diversity is insufficiently established. Maximising the nuclear norm encourages strong and diverse latent shifts, but does not explicitly ensure that these shifts correspond to harmful behaviours. Indeed, not all optimised interventions produce harmful outputs. Moreover, the reported modes, such as multilingual, role-play, coding, and direct compliance, are qualitative post-hoc interpretations rather than independently annotated behavioural categories. Stronger evidence is needed to show that latent diversity corresponds to meaningful diversity of real-world jailbreak behaviours.
-
The empirical evaluation could be broader. All evaluated models are small dense LLMs, leaving generalisation to larger (such as Qwen 3.5 27B) and structurally different models, particularly MoE architectures (such as gpt-oss-20b), unclear. Finally, evaluation on more realistic jailbreak datasets such as WildJailbreak and JailbreakBench, rather than primarily attack-generated variants of HarmBench, would provide stronger evidence of robustness under diverse real-world jailbreak distributions.
Questions for authors
Refer to weaknesses.