- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper studies interactions among behavioral directions in LLMs, finding a shared causal axis between sycophancy and jailbreak compliance and exploiting this overlap to construct a white-box jailbreak.
Critical strengths
None
Critical weaknesses
-
Lack of a clear scientific contribution. The paper reads more like an experimental report for an undergraduate course assignment than a research paper. The abstract reports experimental observations and corresponding analyses, but does not present a research method, a clear core contribution, or a compelling insight. The introduction has the same issue: it mainly describes what experiments were conducted and what was observed, without clearly identifying a problem to solve or explaining the scientific advance. Essentially, the paper does something, observes something, and stops there. It does not adequately discuss whether these observations are valuable, whether they address an existing problem, or how that problem could be solved. Most importantly, the methodology section consists almost entirely of experimental procedures rather than an actual proposed method. Overall, the paper resembles an undergraduate course experiment report rather than a substantive research contribution.
-
Insufficient experimental evaluation. The experiments use only two small models, without evaluation on larger models or a broader range of datasets. The paper also lacks adequate comparisons with relevant methods and baselines. This limited evaluation does not provide sufficient evidence for the robustness, generalizability, or significance of the reported findings.
Questions for authors
refer to weakness