- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work addresses core limitations of current LLM safety defenses: coarse binary harmful/benign verdicts, lack of fine-grained attack technique identification, and pervasive forced classification of unknown attacks. For the first time, it formulates jailbreak detection as an open-set attack attribution task, following the paradigm of outputting fine-grained labels for known cases and escalating uncertain cases to human review. The authors construct a corresponding fine-grained attack pattern benchmark and propose the JailbreakProfiler two-stage framework. They verify the forced-classification flaw across 8 general-purpose LLMs, and the proposed solution achieves strong performance in accuracy, latency, and generalization.
Critical strengths
- Groundbreaking problem formulation. It directly targets the real pain point of current safety defenses, breaks away from the traditional binary harmful/benign framework, and for the first time elevates LLM jailbreak defense to an open-set fine-grained attack attribution task. The problem framing itself carries strong leading value for the field.
- Benchmark fills the research gap.It is the first fine-grained jailbreak benchmark categorized by attack mechanisms rather than harm content, with explicit in-distribution and unseen-wrapper splits, providing a standardized test bed for open-set attack attribution research. The motivation for the benchmark construction is well-justified, though its coverage and design logic are open to discussion (see below).
- Comprehensive and rigorous experiments. A complete chain of evidence is formed: multi-dimensional baselines verify the method’s advantages, ablation studies validate the architectural design, robustness tests confirm stability, and external dataset and drifting traffic experiments prove generalization and deployability. The core conclusions are highly credible.
Critical weaknesses
- Limited scope and depth of open-set verification.All out-of-distribution samples are "novel surface wrappers of known attack mechanisms", and do not go beyond the three known coarse families: cipher, structured, and natural language. Novel attack paradigms such as multimodal jailbreaks, tool-use induced attacks, and multi-turn progressive attacks are not covered. The open-set verification remains at the wrapper level, leaving a gap from real-world scenarios where novel attacks may break the entire taxonomy, which limits the generalization scope of the conclusions.
- Insufficient horizontal comparison. The few-shot LLM baseline only uses a 1-shot setting. Although the authors verify that forced classification is an inherent property of LLMs, adding comparisons with 5-shot and 10-shot settings would more rigorously rule out the impact of sample size. In addition, only one dedicated guardrail model is compared at the coarse level, without horizontal comparison with more mainstream jailbreak detection models on basic detection capability, making it hard to fully demonstrate the overall advantages of the proposed method over traditional defense solutions.
Questions for authors
1.Why did you choose to focus the open-set (OOD) samples in the benchmark on the form of "novel surface wrappers of known attack mechanisms", rather than including more novel attack paradigms that break through the existing 7 coarse-grained taxonomy? What are the main considerations behind this design choice? 2.What is the criterion for defining in-distribution (ID) and out-of-distribution (OOD) samples? Is the division solely based on whether the outer wrapper technique appears in the training set, or does it also take into account the overlap of the core attack intent? 3.Do the authors plan to supplement horizontal comparisons with more mainstream dedicated guardrail models (such as Llama Guard, JailGuard, WildGuard, etc.), as well as results of few-shot baselines with more examples (e.g., 5-shot, 10-shot), to more comprehensively benchmark the performance level of the proposed method?