- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Sparse Weight Interpolation (SWI) to restore safety after downstream fine-tuning. SWI learns a continuous row-level mask that interpolates between an aligned base model and its fine-tuned counterpart. The optimization combines a safety loss, a utility-preservation loss, and sparsity regularization. The paper reports substantial safety recovery using a small number of demonstrations while largely preserving the evaluated downstream performance, with experiments covering multiple model families, tasks, and fine-tuning settings.
Critical strengths
-
The paper addresses a meaningful problem: restoring safety after otherwise benign task adaptation. The proposed method is straightforward, and the learned mask can be merged into the model weights without additional inference overhead.
-
The experimental coverage is broad, including multiple model families, both LoRA and full-parameter fine-tuning, and evaluations across different safety datasets. The ablations on the optimization objective, mask granularity, and structural prior help examine the design choices.
Critical weaknesses
-
The reported safety metrics appear inconsistent with their definitions. Section 5.1 states that harmfulness scores range from 1 to 5 and that responses scoring above 3 count as successful attacks. If HS is the mean of the same integer ratings used to calculate ASR, an ASR of 6.2% implies a mean HS of at least (0.062$\times$4+0.938$\times$1=1.186). However, Table 1 reports HS = 1.06 for SWI on AGNews. A similar inconsistency occurs for the base model, with HS = 1.04 and ASR = 4.2%. These discrepancies cannot be explained by rounding. If different scoring or aggregation procedures were used, this should be made explicit. Otherwise, clarifying how HS and ASR are computed is essential before the main safety results can be assessed reliably.
-
The empirical contribution relative to closely related mask-based safety recovery methods is not sufficiently established. Although the paper discusses SOMF and highlights differences in optimization objectives and data requirements, it does not provide a direct experimental comparison. If possible, a comparison with SOMF under comparable settings would further strengthen the empirical justification for the proposed method. More importantly, a simple interpolation baseline with a sweep over the mixing coefficient would also help establish the benefit of learning a sparse row-level mask beyond partially reverting fine-tuning.
Questions for authors
-
Could the authors clarify whether HS and ASR in Table 1 are computed from the same responses and ratings? Please explain the numerical inconsistencies above and provide the exact aggregation procedure.
-
I found that the implementation details differ between the paper and the supplied code. The paper specifies GPT-4o, an attack-success threshold of HS > 3, and 500 safety-test examples, whereas the supplied evaluation script uses GPT-4o-mini, HS ≥ 3, and a default subset of 50 examples. Moreover, Eq. (3) describes a loss on refusal sequences, while the supplied implementation computes the safety loss only over the first four response tokens. The scripts may represent a different configuration, but their relationship to the reported experiments needs clarification. Which evaluation and training configurations produced the reported results?
-
Could the authors clarify the scope of safety restoration in light of Table 15? While standard SWI reduces the average jailbreak ASR from 90.50% to 73.50%, it remains substantially higher than that of the aligned base model. Although this limitation is acknowledged in the appendix, a clearer distinction between restoring safety on standard harmful prompts and recovering adversarial robustness would strengthen the main paper.