- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies safety guidance for text diffusion models and proposes SADDER, an extension of SAD. SAD steers token predictions away from unsafe-reference distributions, but applying this correction uniformly across eligible positions can degrade generation quality. SADDER uses intermediate activations to identify potentially risky token positions and selectively applies SAD’s probability-space correction to those positions. The paper also characterizes conditions under which the modified predictions correspond to position-wise safe denoisers. Experiments on masked and uniform-state diffusion models evaluate safety, generation quality, and generator evaluation counts in unsafe continuation and jailbreak settings. The results show improved benign-generation quality relative to full SAD.
Critical strengths
- The proposed method can be applied to pretrained models without additional training. This makes it a practical approach to inference-time safety guidance.
- The paper provides theoretical analysis that characterizes when the modified predictions correspond to position-wise safe denoisers. It clarifies the method’s properties and assumptions.
Critical weaknesses
- The contribution is incremental, and its generality remains limited. SADDER extends SAD by adding activation-based position selection, while its main correction mechanism relies on SAD. Although the position-selection strategy could potentially be applied to other safety-guidance methods, such combinations are not discussed. Consequently, the demonstrated contribution is limited to improving SAD, and its effectiveness as a more general safety-guidance principle remains unclear.
- The evaluation of generation quality is insufficient to substantiate a central claim of the paper. The claimed improvement in the safety–quality trade-off relies primarily on GPT-2-large perplexity and BERTScore. Perplexity measures predictability under an external language model and does not necessarily capture human-perceived fluency, coherence, or usefulness. Similarly, BERTScore measures similarity to reference continuations rather than overall response quality. Although the authors acknowledge these limitations, additional validation, such as human evaluation, is needed because preserving generation quality is a central contribution.Could the authors report actual runtime measurements and compare the methods under matched NFE budgets, with candidate counts and denoising steps adjusted appropriately for each method? NFE does not capture auxiliary computation, such as the unsafe-reference likelihood calculations inherited from SAD, and some baselines achieve better safety or quality with additional generator evaluations. These comparisons would help clarify SADDER’s practical efficiency advantages.
How sensitive is SADDER to the size, composition, and source of the unsafe reference set? Could the authors provide ablations on these factors to clarify the method’s robustness and applicability beyond the selected reference sets?
Questions for authors
- Could the authors report actual runtime measurements and compare the methods under matched NFE budgets, with candidate counts and denoising steps adjusted appropriately for each method? NFE does not capture auxiliary computation, such as the unsafe-reference likelihood calculations inherited from SAD, and some baselines achieve better safety or quality with additional generator evaluations. These comparisons would help clarify SADDER’s practical efficiency advantages.
- How sensitive is SADDER to the size, composition, and source of the unsafe reference set? Could the authors provide ablations on these factors to clarify the method’s robustness and applicability beyond the selected reference sets?
5 comments
We would like to thank you for taking the time to review our paper and for your valuable comments. As the discussion period is ending soon, we wanted to follow up and hope that our response has addressed the concerns raised in your review, including the runtime, matched-NFE, and reference set experiments you requested. Please let us know if anything remains unclear, as we would be happy to clarify. We sincerely appreciate your feedback and the opportunity to improve our work.
Thank you for the detailed response and additional experiments. These address some of my concerns. However, my main concern about the limited generality due to SADDER’s dependence on SAD remains. The additional experiments are interesting and strengthen the evidence for its value as an extension of SAD, but its contribution beyond SAD remains insufficiently established. I therefore maintain my score.
AI use disclosure: I apologize for omitting the AI-use documentation field. I used AI tools to polish the writing and check the accuracy of the content. I confirm that I read the paper myself and independently formed the assessment and final recommendation.
Response to Reviewer P5vx
Thank you for the review and the questions on cost and the reference set.
W1 (Contribution)
SADDER's contribution is to make safety corrections selectively: at every step, it decides from the model's own hidden states which positions to correct and leaves the others exactly as the model would write them. As shown in General response 2, on benign prompts, it leaves 10–59% of outputs identical to the unmodified model's (full SAD: at most 0.1%), and at equal benign fluency it is safer than full SAD on LLaDA and level or slightly safer on Dream.
The selection can be applied beyond masked models: the same gate runs on UDLMs (General response 1). We tried it inside best-of-N to pick the positions where candidates differ. To be precise, this selective best-of-N still samples N answers and has N judge calls, but the candidates share the same random draws everywhere except at the positions the gate flags. So the N answers differ mainly where the gate thinks the text is risky, and the search only tries alternatives there. The idea was to spend the search where it is risky and leave the rest of the text untouched. However, when testing for N=4, it did not help, being 1–9 points less safe than plain best-of-4, because search already leaves benign text mostly intact (benign fluency 1.59–1.67, unmodified 1.60–1.65). Our reading is that the gate pays off where the correction itself damages text, and Section 6 will present it as a position-selection step for such corrections.
W2 (Quality metrics)
We added an LLM fluency judge (Llama-3.1-8B, 0–2, checked against a 70B judge), a pairwise judge, Prometheus 2, and a blind human comparison of benign outputs by the author and an independent annotator (see General response 2). All of them prefer SADDER's benign text to full SAD's, and the independent annotator chose SADDER in 71% of the decided pairs. With the fluency judge, we compared both methods at equal benign quality, where SADDER is safer on LLaDA and level or slightly safer on Dream.
Q1 (Runtime and matched NFE)
Seconds per sample on one L40S, 32 tokens, 32 steps:
SAD's reference computation adds about 18% of the base model's generation time. The gate adds nothing measurable, since it reads a hidden state of the same forward pass. For equal NFE we shortened the search trajectories to 32 generator evaluations and judged the harmful-prompt outputs:
LLaDA, RTP prompts
LLaDA, BeaverTails prompts
Dream, RTP prompts
Dream, BeaverTails prompts
At equal cost, Best-of-N is safer but SADDER keeps text quality. The difference is clearest on benign prompts, where short search trajectories drop fluency to 1.02–1.35 against 1.46–1.63 for SADDER. We will revise the introduction's cost claim accordingly.
W3, Q2 (Reference set)
Size: on LLaDA/RTP (unmodified 39.2% unsafe), every size helps and both SAD and SADDER stay within about a point of each other.
Source: we swapped references and gate direction between datasets (RTP prompts, unsafe %; a separate run with its own unmodified baseline).
The gate direction transfers across datasets, but the unsafe references must match the prompts' domain, as in SAD, since its correction acts on the references' tokens.
Composition: with benign text or a uniform estimate in place of the unsafe references, the unsafe rate stays within 1 point of unmodified, so the gain comes from the unsafe content of the references.