- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ASCENT, a fine-tuning method for improving both model safety and downstream task performance. ASCENT derives a low-rank safety calibration update from the safety gradient and selectively suppresses task updates that negatively affect safety. The safety-related subspace is periodically recalibrated during fine-tuning.
Critical strengths
1.ASCENT preserves safety-compatible components and selectively suppresses safety-degrading ones, providing a more fine-grained approach to balancing safety and downstream utility. 2.The experiments cover four LLMs of different architectures and scales and four downstream tasks, with additional evaluations on safety benchmarks and jailbreak attacks, providing strong empirical support for the method.
Critical weaknesses
1.ASCENT introduces additional safety optimization during downstream fine-tuning, while baselines such as SafeLoRA and GuardSpace mainly focus on safety preservation. The paper lacks a comparison with conventional safety alignment fine-tuning under comparable safety supervision. It remains unclear whether ASCENT offers advantages over standard safety alignment fine-tuning. 2. Safety evaluation mainly relies on ASR, without examining whether the safety improvements lead to increased over-refusal on benign requests.
Questions for authors
- Table 1 shows substantial ASR reductions compared with Original. Does ASCENT increase over-refusal on benign requests?
- How does ASCENT perform on domain-specific instruction-following tasks, such as legal or medical tasks?
- Could the authors report additional safety metrics beyond ASR to provide a more comprehensive evaluation?
6 comments
Thank you for your response. I have two follow-up questions:
-
Could you clarify how the "conventional Task FT + Safety SFT" baseline is implemented? LISA [1] mitigates safety degradation during downstream fine-tuning by alternating between safety-alignment data and downstream task data and introducing a proximal regularization term to constrain parameter shifts. I suggest including LISA as an additional baseline for comparison.
-
You evaluated ASCENT on 250 benign prompts randomly sampled from OR-Bench and showed that its over-refusal rate remains close to that of the original model. Could you also evaluate the fine-tuned model on general-purpose benchmarks such as MMLU? I would like to know whether ASCENT leads to any noticeable performance drop compared to the original model.
[1] Lazy Safety Alignment for Large Language Models Against Harmful Fine-Tuning.
Thank you for your response. I have two follow-up questions:
-
Could you clarify how the "conventional Task FT + Safety SFT" baseline is implemented? LISA [1] mitigates safety degradation during downstream fine-tuning by alternating between safety-alignment data and downstream task data and introducing a proximal regularization term to constrain parameter shifts. I suggest including LISA as an additional baseline for comparison.
-
You evaluated ASCENT on 250 benign prompts randomly sampled from OR-Bench and showed that its over-refusal rate remains close to that of the original model. Could you also evaluate the fine-tuned model on general-purpose benchmarks such as MMLU? I would like to know whether ASCENT leads to any noticeable performance drop compared to the original model.
[1] Lazy Safety Alignment for Large Language Models Against Harmful Fine-Tuning.
Response to Reviewer TD9p
We thank Reviewer TD9p for the valuable comments. Below are our responses to the questions.
1. Comparison with Conventional Safety Fine-Tuning
ASCENT aims to improve safety and downstream utility jointly. In addition to the safety-supervision-matched controls in Appendix F, we add a conventional Task FT + Safety SFT baseline using the same datasets and downstream training settings as ASCENT.
Across both tasks and all four models, Safety SFT reduces ASR but lowers accuracy relative to Task FT. ASCENT achieves substantially higher accuracy at comparable ASR, supporting the benefit of controlling interference between safety and task updates. The table reports accuracy / ASR (%). We will include this comparison in the revised paper.
2. Safety Evaluation and Over-Refusal
We compare the original models with ASCENT after AG News fine-tuning. Beyond ASR, we report Harmful Score (HS), the mean StrongREJECT score for responses to the same 200 JBB adversarial prompts. We also evaluate over-refusal rates (ORR) on 250 safe XSTest prompts and 250 randomly sampled benign OR-Bench prompts, using the same evaluation sets across models.
ASCENT reduces ASR and HS while keeping over-refusal rates close to those of the original models.
3. Medical Domain Evaluation
We evaluate ASCENT and the baselines on MedQA using 2,000 training examples and 500 test questions sampled from the official splits. The other fine-tuning settings remain unchanged from the main experiments, and ASR is evaluated on JailbreakBench. Across all four models, ASCENT achieves the highest MedQA accuracy and the lowest ASR among the compared methods. These results extend the safety–utility improvements observed in the main experiments to medical-domain fine-tuning.
We hope our responses and revisions to the manuscript could address your concerns. We would be happy to answer any further questions.