- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This work investigates the ability to preserve safety alignment while performing benign performance fine-tuning. Considering that freezing individual safety-related attention heads might leave adaptation paths for other heads and the MLP in the same layer, while directly freezing consecutive layers might limit too many task capabilities, HeaCaLF uses activation patching to measure the contribution of each head to rejection behavior, aggregates head-level scores to layers, and selects several non-consecutive layers to freeze as a whole.
Critical strengths
This design problem is valid. Identifying the heads involved in the safety behavior does not mean that simply freezing these heads guarantees safety after fine-tuning. Table 1 shows the safety gains across multiple models. For example, Llama-2's average HS decreased from 48.75 with SFT to 25.91, and its average task accuracy improved from 63.71 to 63.40. Table 3 compares random selection, SPPFT, and HeaCaLF with the same number of frozen layers; when k=3, the MMLU HS is 31.20, superior to SPPFT's 40.35. This demonstrates useful selection strategy control.
The authors also honestly acknowledge that utility is not always maintained: for example, Mistral's GSM8K accuracy decreased from 41.40 to 29.27. Therefore, the results should be understood as a safety-utility tradeoff, not lossless protection.
Critical weaknesses
W1: The core measurement protocol is inconsistent across different sections.
Section 3.4 states that QwQ receives the original instruction and generated text, outputting two non-negative scores; Appendix D, however, states that the target model's logits are input into QwQ. These are different processes, directly affecting how SCS is reproduced.
W2: The metrics in Figure 3(a) do not match the formula.
The figure caption indicates SCS, but the colored bar reads "Logit change," with a range of approximately .
W3: The data scale is inconsistent between the main text and the appendix.
The main text states that 1,400 BeaverTails samples are used, while Appendix B lists 1,177; the appendix also lists 983 AdvBench harmful instructions, which do not correspond to the standard's 520 behaviors.
W4: Appendix D references Equations 10 and 12, but the formula numbering in this paper only goes up to 8; Equation 8 actually corresponds to the layer selection, not the activation intervention mentioned there.
Questions for authors
See weaknesses and below
Q1: Does the actual implementation of SCS score the generated text or process logits? Please provide the complete judge prompt, numerical analysis, and code path.
Q2: Please unify the counting across all datasets, provide the specific division between the localization set and the evaluation set, and correct the formula numbers in the appendix.
Q3: After correcting the protocol, can you provide multiple sub-outcomes, localization costs, and stable comparisons under equal frozen budgets?