- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper investigates how much of a behavioral weight edit is needed to preserve its effect, using social-bias reduction as a testbed. It constructs contrastive corpora through likelihood-based self-diagnosis, learns a rank-16 LoRA-based update, and applies its negation after binarization and magnitude-based sparsification. Seven experimental conditions perturb the support, signs, and placement of the resulting edit. On the initial scale grid, magnitude-selected coordinates substantially outperform randomly selected coordinates carrying their own learned signs. This advantage remains significant after extending the grid, but becomes statistically inconclusive under an adaptive rule that selects the scale using held-out capability constraints. The paper also compares the edit with other debiasing interventions and reports negative results concerning abstention and density prediction.
Critical strengths
- The paper asks a focused and worthwhile question: how much of a behavioral weight edit is actually needed after training, and whether the useful signal lies in magnitudes, signs, coordinate selection, or layer placement.
- Useful experimental controls. The distinction between evaluating learned signs at randomly selected coordinates and permuting signs on the selected support is informative. The partition null provides an additional check beyond random perturbations.
- Transparent reporting of limitations and negative results. The authors report the failed abstention gate, failed density predictor, instability in capability measurements, and recovery of the random-support condition at larger scales. These qualifications improve the scientific value of the study.
Critical weaknesses
- The method is insufficiently specified. Section 3 does not explain how is constructed: whether it results from separate fine-tunes followed by subtraction, a single contrastive objective, or another procedure. Essential details are missing or insufficiently explicit, including the training objective, treatment of identical pairs, optimization hyperparameters, elicitation prompts, and the definition of the per-tensor scale . Skew and removal should also be formally defined, including how opposite-direction skew is handled. Finally, the relationship between the “edit” in Section 5.7 and C-ref should be clarified. These details are necessary to understand and reproduce the object being analysed.
- Novelty is insufficiently established, and the closest comparisons are missing. Task-vector redundancy and magnitude-based trimming are established by DARE[1] and TIES[2], while BitDelta[3] studies sign-based compression. Most directly, ComPEFT[4] already combines magnitude-based support selection with signs and a shared, tuned scale, yet it is not cited or evaluated. The authors should explain what distinguishes their operator and compare these procedures on the same ΔW under comparable conditions. In particular, C-a is not original DARE: it retains only signs and uses C-ref’s scales, whereas DARE preserves and rescales the original update values. The “DARE-divergent” interpretation therefore lacks a direct comparison. The paper should identify more clearly what its analysis contributes beyond these precedents.
- The structural conclusion depends on scale selection. Magnitude-selected support outperforms random support on the frozen grid, where C-a reaches the maximum scale in 27 of 30 runs. The advantage remains significant after grid extension, but becomes statistically inconclusive under the adaptive rule. Although the authors acknowledge this, the results warrant caution about claims concerning where information “lives”: they show that magnitude selection is effective at smaller scales, but do not establish an exclusive sparse location for the behavior. A smaller α also does not automatically imply lower collateral. Moreover, the necessity conditions (sign permutation, layer and projection shuffles) were evaluated only on the frozen grid. Since the random-support condition recovers most of the effect when its scale is allowed to grow, it remains unclear whether these perturbed edits would also partially recover at larger scales. The authors should either evaluate them under or restrict the necessity claims to the deployment grid.
- The selection of is not clearly explained. The paper states that it selects the achieving the largest bias reduction among the four configurations satisfying the collateral budget, but does not clearly explain which data are used for this choice. Is α selected on a separate validation set, or on the same examples used to report the final results? The authors should explicitly describe the selection procedure and the separation between validation and test data for each experiment. If the same examples are used for both selection and final evaluation, the reported performance may be optimistic. The separate procedure used to choose the adaptive scale should also be clearly distinguished.
- Presentation obscures the experimental design. The manuscript presents extensive results before adequately explaining the method and experimental conditions. Terms such as “in-envelope,” “registered estimand,” and “closure test” are insufficiently explained when introduced, while changing experimental panels make the results difficult to follow. The seven conditions should be operationally defined in the main text, rather than largely deferred to Appendix B. A consolidated table of models, axes, cells, seeds, selection procedures, and metrics would help. The abstract should communicate the central finding and its qualifications more directly, and the main paper should be self-contained: too much of the essential information is deferred to the appendix.
- Generalization beyond debiasing remains untested. The experiments concern social-bias edits on attention projections, primarily evaluated through likelihood-based probes. The claim that the decomposition “travels beyond debiasing” should distinguish the applicability of the experimental procedure from generalization of its findings. Testing another behavioral edit would strengthen this claim. Limited coverage in several panels also calls for caution with family-specific structural conclusions, and improvements on intrinsic probes do not by themselves establish improvements in generated behavior.
References:
- [1] Le Yu, Bowen Yu, Haiyang Yu, Fei Huang, and Yongbin Li. Language models are super mario: Absorbing abilities from homologous models as a free lunch. In Proceedings of the 41st International Conference on Machine Learning (ICML 2024), 2024. arXiv:2311.03099.
- [2] Prateek Yadav, Derek Tam, Leshem Choshen, Colin Raffel, and Mohit Bansal. TIES-Merging: Resolving interference when merging models. In Advances in Neural Information Processing Systems 36 (NeurIPS 2023), 2023. arXiv:2306.01708.
- [3] James Liu, Guangxuan Xiao, Kai Li, Jason D. Lee, Song Han, Tri Dao, and Tianle Cai. BitDelta: Your fine-tune may only be worth one bit. In Advances in Neural Information Processing Systems 37 (NeurIPS 2024), 2024. arXiv:2402.10193.
- [4] Yadav P, Choshen L, Raffel C, Bansal M. ComPEFT: compression for communicating parameter efficient updates via sparsification and quantization. 2023, arXiv preprint arXiv: 2311.13171
Questions for authors
- How exactly is constructed? Please provide the objective, training procedure, treatment of identical pairs, and an explicit definition of .
- What are the precise definitions of skew and removal for each benchmark? How is overshooting into opposite-direction skew handled?
- Are the bias probes used to select α also used to report performance? Can the main results be reported with all configuration selection performed on independent validation data?
- How does the compression operator differ from ComPEFT, and how does it compare with ComPEFT, original DARE, and magnitude trimming on the same under comparable tuning and collateral constraints?
- Can you report removal–collateral curves and update norms for magnitude-selected and random supports? What advantage remains beyond requiring a smaller scalar ?
- How should the adaptive deployment claim be interpreted given its 57–60% evaluation-budget pass rate at ≤9B?
- Which structural findings are expected to extend beyond social-bias edits, and what evidence supports that expectation?