- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper adds WaXup to an existing interpreter training framework, using weight averaging of finetuned experts for data augmentation and a weighted average of SFT losses on the two endpoint targets for training. The authors evaluate the interpreter’s topic and task descriptions on the hidden-behavior benchmark and the NLP tasks benchmark, respectively, and test its performance under different distribution shifts.
Critical strengths
The experiments cover two benchmarks and various distribution shifts, including changes in LoRA rank, learning rate, and the number of training epochs.
Critical weaknesses
- The novelty of this paper is limited. Both weight-space MixUp and the interpreter come from previous work. The main contribution is to apply this augmentation to interpreter training and use a weighted average of the SFT losses on the two endpoint targets to handle natural-language descriptions.
- WaXup changes the expert weights, the SFT objective, and the training cost. However, it is mainly compared with an augmentation-free baseline and Gaussian noise injection. The effects of these changes have not been evaluated separately.
Questions for authors
Beyond Gaussian noise injection, how does WaXup compare with simply scaling the weight differences while keeping the original target?
2 comments
Add of scaling ablation
We thank the reviewer again for suggesting this ablation. As announced, we ran it on both the NLP tasks benchmark and AuditBench, and added it to the paper (Section 3.2.2 and Appendix B.1). At each training step, we rescale each expert's weight difference by a random factor , shared across layers, while keeping the original target unchanged. This range keeps each expert's behavior intact without degrading the model.
- The results match our expectations. Random scaling leaves the training loss almost unchanged compared to the baseline (Appendix B.1, Figure 12a): since the scaled models keep the same behaviors and targets, the introspector still memorizes the training set.
- NLP tasks benchmark (Gemma 3 1B). Random scaling slightly improves over the baseline (4.68 / 4.80 / 4.79 vs. 4.63 / 4.64 / 4.63 for test ranks 1 / 16 / 64), but remains below WaXup (4.82 / 4.87 / 4.89), and cannot by itself explain its improvement.
- AuditBench. Random scaling prevents the late-training degradation of the baseline, but plateaus around the baseline's peak (15% verbalization rate) with high variance across runs. In contrast, WaXup keeps improving throughout training and reaches 19.5% with 75% of merged models, i.e. about +4.5 pp above random scaling at the end of training (Figure 12b).
Overall, this confirms that the gains of WaXup come from the new behaviors introduced by merging, and not from perturbing the expert weights alone. We believe this ablation, suggested by the reviewer, has strengthened the paper, and we would be grateful if the reviewer would consider updating their score in light of these results.
Answer to reviewer N87H
We thank the reviewer for their time and questions, in particular the suggested ablation, which we are now running. We address each point below.
W1. "The novelty of this paper is limited." We refer the reviewer to P2 in our global answer. Regarding their specific points:
W2. "The effects of changes in [the expert weights, the SFT objective, and the training cost] have not been evaluated separately." We first note that, as in mixup, mixing the inputs naturally requires mixing the targets: the change to the expert weights and the change to the objective form a single design choice. We nevertheless clarify the effect of each component below.
Q. "Beyond Gaussian noise injection, how does WaXup compare with simply scaling the weight differences while keeping the original target?" We thank the reviewer for this suggestion, which we find very relevant. We are currently running this ablation (scaling α·ΔW with varying α, while keeping original target unchanged) and will post the results before the end of the discussion period. Our expectation is that scaled models keep the same behaviors, and hence the same set of targets. The introspector can therefore memorize the training targets more easily, and we expect the overfitting observed for the baseline (training loss approaching zero, early peak in test accuracy) to persist. If confirmed, this would show that the gains of WaXup come from the diversity of behaviors introduced by merging, not from weight perturbation alone.
We hope these clarifications, together with the new AuditBench results and the ongoing scaling ablation, address the reviewer's concerns. Should they find them convincing, we would appreciate it if they would consider revisiting their assessment. We remain available for any further questions during the discussion period.