- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
SafelySample is a decoding-time safety method that keeps the base model frozen and trains only a small safe soft prompt via a DPO-style objective with a benign KL regularizer, then at inference compares the safe-prompt next-token distribution against the model's own default distribution and interpolates their logits as z = α·z_s + (1−α)·z_0. Across eight instruction-tuned models and ten benchmarks it cuts average attack success rate by 28–45% on six models while keeping reasoning within five points of default decoding.
Critical strengths
None
Critical weaknesses
The core mechanism — freeze the base model, optimize a small soft prompt, run two forward passes, and combine the two logit vectors — is exactly Safety Alignment of Large Language Models via Contrasting Safe and Harmful Distributions ( Zhang et al., AAAI 2026; arXiv:2406.16743, 2024). The overlap is not merely conceptual: the paper's own ablation arms, S–U Contrast. (z = z₀ + α(z_s − z_u)) and S–U Extrap. (z = αz_s − (1−α)z_u), reproduce ACD's decoding rule essentially verbatim, including a separately trained unsafe soft prompt as the contrastive reference.
This is decisive for my assessment: the paper's claimed insight — "the default model suffices as the contrastive reference" — cannot be evaluated as a departure from anything without the prior work in view. As written, the contribution reduces to running ACD's contrast with the default model instead of the unsafe prompt, a hyperparameter-level change rather than a conceptual one. The derivation in Eq. (7) does not rescue this: it is a standard KL-regularized reward-maximization problem with a textbook exponential-tilting solution, and the closed form z = αz_s + (1−α)z_0 is plain logit interpolation already established in the proxy-tuning / weak-to-strong fusion literature. It rationalizes a rule that was almost certainly chosen first.
Questions for authors
Same as weakness.