- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper investigates whether fixing a small number of key coordinates in LoRA can avoid complex safety subspace projections when benign fine-tuning leads to safety degradation. Because existing research has identified safety-related neurons, layers, and subspaces, it hasn't yet tested how this structure is distributed within the adapter itself. The hypothesis is that if energy is concentrated in a few coordinates, it may be possible to construct a frozen mask that can be reused for different downstream tasks once.
Critical strengths
Figures 1 and 3 provide specific measurement results. In the three models, the top 10% of coordinates carry approximately 93%, 96%, and 90% of the defined safety membership, respectively. Figure 3 further distinguishes between coordinate concentration and spectral orientation concentration, illustrating that "concentration in a few parameters" does not necessarily equate to "concentration in a few directions."
The control experiments in Table 2 are more valuable than simply comparing the main table. The authors compare the same budget random freezing, reverse selection, and reduced LoRA rank. For example, on Llama-3.1-8B, the ASR of the random mask is 20.4%, while that of the oriented mask is 6.0%, indicating that the improvement does not entirely stem from reducing the number of trainable parameters.
Critical weaknesses
W1
The 10% freezing percentage is inconsistent with the actual method. The abstract states that one-tenth of the coordinates are fixed; however, Section 3 and Algorithm 1 freeze 90% of the coordinates when p=10, leaving only 10% for training. In Table 8, under the same light configuration, the ASR is 15.0% when freezing 10% (p=90) and 1.8% when freezing 90% (p=10). Therefore, the current behavioral results support the conclusion that "large-scale targeted freezing is effective," but do not yet support the conclusion that "fixing only the safe decile is sufficient."
W2
The correlation coefficient between importance score and membership in Figure 2 is 0.55–0.67, which does not necessarily mean selecting the same coordinates. HOWEVER, simple gradient/Fisher sorting, and its mask highly overlap, with some conditions yielding the same results. Fisher may even perform better with continued learning.
W3
Table 3 shows an average task performance drop of approximately 7–9 percentage points; some models also require reestimating curvature at each task boundary, taking about an hour. This limits the deployment narrative of "build once, user only needs to attach a mask".
Questions for authors
Q1
If only the first 10% of the safety coordinates defined in Figure 1 are frozen, what are the differences in safety and task capability? Why are different freezing ratios used for the summary and the algorithm?
Q2
Can the main table be rewritten using the formal behavior classifier, and the Pareto curves for safety and task utility reported?