- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper proposes SafetyEdit to edit model checkpoints by implanting trigger-conditional jailbreak backdoors. It edits a single refusal-related MLP coordinate and propages the trigger signal across prompt positions via a KV-cache marking mechanism. In this way, SafetyEdit involves a attention value writer, and optionally followed by an MLP reader. SafetyEdit outperforms existing editing baselines on most metrics across four LLMs and several benchmarks, with limited degradation of untriggered capabilities.
Critical strengths
S1. The proposed editing approach is novel and interesting, which extends single-neuron refusal interventions to trigger-conditioned backdoors.
S2. The empirical results appear to be strong, with consistent gains over existing baselines based on complementary metrics.
S3. The mechanistic analyses seem informative. The position ablations and marker-knockout experiments help to explain why prompt-wide control outperforms those boundary- or generation-only interventions.
Critical weaknesses
W1. The writing and presentation are very confusing and hard to follow. Many key terms, such as "sparse control target", "KV-cache marking", and "attention value writers", are undefined, and the exposition is verbose. An intuitive overview with a concrete example, and formal loss definitions in the main text, would greatly improve the clarity and readability.
W2. It is unclear whether the added complexity of the writer-reader design is necessary. A controlled ablation isolating the sparse target, the writers, and the readers, as well as an editing-cost comparison, would clarify the contribution. In addition, how is the need for a reader determined? Is there a systematic criterion, like a hyperparameter threshold? And how sensitive are the results to this choice?
W3. Baseline comparison is inconsistent, since they retain different trigger conventions and placements. Comparisons under standardized triggers would better isolate the method's contribution. In particular, is there a reason why SteerEdit was only evaluated on the two Llama models?
W4. Several mechanistic experiments use only 32 to 48 prompts from those benchmark datasets. And there are no repeated evaluations based on different seeds. The generation configurations of those tested LLMs are also missing.
W5. How reliably does SafetyEdit distinguish the intended trigger from similar or naturally occurring text? It would be great to add more experiment results on diverse triggers, prompt lengths, and near-miss variations.
Questions for authors
See weaknesses.
I thank the authors for the additional results. However, my concerns regarding the experiment scale and the presentation clarity remain. I'll keep my current rating.