- Rating
- 2(−1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This work examines adding a fixed post-training weight delta after continued pretraining. It measures instruction-following gains, language modeling penalties, and changes in corrected prompts along a Qwen3.5-9B Tibetan trajectory. Scaling, selective transfer, and a matched-cost control are complemented by a Llama-3.1-8B Basque comparison. Similar aggregate gains can conceal different behavioral effects, and selective transfer shows no clear advantage over matched-cost scaling.
Critical strengths
- Controlled comparisons: Measures each update’s gains and costs against the checkpoint receiving it, and compares selective transfer with full-vector scaling at matched language-modeling cost. This helps distinguish benefits of parameter selection from simply applying a smaller update.
- Prompt-level analysis reveals changes hidden by aggregate scores.
- Relevant baselines, including comparisons among base, post-trained, continually pretrained, and delta-merged models.
Critical weaknesses
- The paper lacks a CPT→fresh post-training baseline, leaving unclear how delta reuse compares with directly post-training the adapted model.
- Limited task coverage: English behavioral evaluation concentrates on IFEval and IFBench, without dedicated coding or mathematical-reasoning benchmarks. Although Tibetan tasks include mathematics, broader capability preservation remains insufficiently explored.
- Target-language instruction results are inconclusive and frequently reaching the generation limit.
- Scaling: Only 8B–9B models are tested, leaving scale dependence unknown.
- Reproducibility and robustness: Some training details are unavailable or inconsistent. Confidence intervals capture evaluation-sample uncertainty but do not establish robustness across independent training runs
Questions for authors
- Do the trajectory and matched-cost findings replicate across model families?
- Do the Tibetan instruction-following conclusions change when stopping behavior is checked and generation limits are increased?
3 comments
Response to Authors
Thank you for the detailed response and additional experiments. The coding and math evaluations address the concern of limited evaluations. The receiver-dependence findings remain informative.
However, two important concerns remain:
- Missing CPT→fresh post-training baseline: The paper does not establish how delta reuse compares with directly post-training the adapted model, which is the standard approach. This baseline is important for assessing the practical quality–cost trade-off and supporting pipeline-selection conclusions.
- Generality remains limited - the 2B experiment doesn't reproduce the gains. The trajectory analysis and calibrated matched-cost findings remain specific to Qwen; their replication across families is not established.
The above limitations leave the broader practical conclusions insufficiently supported. Therefore, I change me score to a weak acceptance to a weak reject.
Thank you for clarifying the two concerns behind your revised assessment. We have now completed three additional experiments that directly address these concerns: fresh post-CPT SFT, a directly calibrated matched-cost comparison on Llama, and an independent 2B training run. The new evidence substantially strengthens both the practical and cross-model conclusions.
1. Direct comparison with fresh post-CPT SFT.
We evaluated both approaches starting from the identical Qwen3.5-9B Tibetan CPT checkpoint. Fresh SFT updated all parameters for one epoch on 50,000 instruction examples, including Tibetan, Chinese, and English data (1,671 steps; 57.48M processed tokens). Delta reuse applied the existing Post−Base update without additional training.
| Condition | IFEval ↑ | IFBench ↑ | Tibetan BPB ↓ |
|---|---|---|---|
| CPT alone | 61.18% | 22.00% | 0.37761 |
| CPT → fresh SFT | 66.73% | 21.00% | 0.39240 |
| CPT + full delta | 74.31% | 27.00% | 0.38858 |
Delta reuse outperforms fresh SFT on both instruction benchmarks: +7.58 pp on IFEval (paired 95% CI [2.96, 12.01]) and +6.00 pp on IFBench [0.33, 11.33]. It also achieves better Tibetan BPB (0.38858 versus 0.39240).
This directly addresses the missing-baseline concern and establishes a concrete quality–cost advantage: given an available donor Post model, delta reuse achieves stronger instruction following and better Tibetan language-modeling fit than fresh post-CPT SFT, without an additional 57.48M-token training run.
2. Matched-cost findings now extend to Llama.
We have replaced the earlier Llama interpolation with a directly evaluated, calibrated full-delta control. At the Llama-3.1-8B/Basque CPT endpoint, we calibrated the full-delta coefficient (α = 0.3496) against the lower-half MLP update using separate Basque text, then froze it before evaluation.
| Lower − calibrated scaling | Qwen-9B / Tibetan | Llama-8B / Basque |
|---|---|---|
| IFEval, pp [95% CI] | +2.03 [−1.48, 5.37] | +11.65 [7.39, 15.90] |
| IFBench, pp [95% CI] | +1.00 [−2.67, 4.67] | +1.00 [−2.33, 4.67] |
This directly addresses the concern that the matched-cost analysis had not been tested beyond Qwen. The Llama experiment reveals a significant IFEval benefit from lower-half selective transfer over full-vector scaling at closely matched language-modeling cost, whereas the corresponding Qwen comparison shows no clear advantage.
The finding is stronger than the earlier interpolation: parameter placement can yield additional instruction-following benefits beyond simply reducing the update magnitude, and the relative benefit differs across adaptation settings. Together with the receiver-dependent prompt corrections already observed in Llama, this extends key behavioral and matched-cost analyses beyond the original Qwen experiments.
3. Positive instruction transfer also occurs at 2B.
We completed an independent Qwen3.5-2B Tibetan CPT run at 500M tokens. In this run, full delta reuse improves IFEval by +2.22 pp [0.06, 4.38] and IFBench by +1.33 pp [0.15, 2.51], with both paired 95% confidence intervals excluding zero.
This provides new positive evidence at the smaller model scale, addressing the earlier impression that the 2B setting does not benefit from delta reuse. Although the gains are smaller than those observed at 8–9B and differ from the first 2B run, the independent experiment demonstrates that instruction transfer is not confined to the larger models.
Overall, the new experiments address both principal concerns motivating the score reduction. We now provide (i) the requested direct fresh-SFT baseline, demonstrating an instruction-quality and training-cost advantage for reuse; (ii) a calibrated matched-cost comparison in a second model family, revealing a significant selective-transfer benefit; and (iii) positive instruction-transfer evidence at 2B. These findings reinforce the paper's central contribution: the effectiveness of a reused post-training update depends not only on its average instruction gain but also on its receiving model, parameter placement, and language-adaptation cost.
We hope these additional results address the concerns underlying your revised assessment and warrant reconsideration of the score.
Matched pipeline comparisons, coding gains, and independent training strengthen the evidence
Thank you for the positive assessment and the concrete questions. We added a matched-configuration pipeline comparison, independent training runs, coding and math evaluations, and longer Tibetan generation. The new results clarify both when reuse works and how to choose an adaptation pipeline.
W1. Full reuse retains IFBench gains under matched training. Revised Table 4 compares three Qwen3.5-9B 500M endpoints trained with one configuration and seed, evaluated in one runtime. Brackets denote 95% paired bootstrap intervals.
Full reuse has similar IFEval scores to Post→CPT (−1.5 pp [−4.4, 1.5]) and higher IFBench scores (+5.3 pp [1.7, 9.3]). Seed 42 Full also exceeds the same Post→CPT reference (+7.3 pp [3.3, 11.3]). Adding Δ costs .011 BPB, lowers 1 MiLiC direction and improves 2; Post→CPT has no significant MiLiC differences from Base→CPT. Together with the α=.75 dose result, this shows why choosing a pipeline from IFEval alone can miss a loss on IFBench (Sec. 6; App. C.3). This comparison tests adaptation order; we did not train a fresh post-CPT SFT baseline.
W2. Reuse also improves coding. At the original 500M receiver, HumanEval+ accuracy rises from 77.4% at CPT to 83.5% with Δ, the observed Post score: +6.1 pp [1.2, 11.6]. Changes on GSM8K and MBPP+ are +0.6 pp [−0.7, 1.9] and +1.1 pp [−2.4, 4.2]. These evaluations extend the evidence beyond instruction constraints (Sec. 7; App. C.7).
W5. Matched configurations and independent seeds address robustness. The original Base→CPT and Post→CPT used different training configurations. We trained the new Base→CPT runs with the Post→CPT configuration. Revised Table 4 replaces the submitted pipeline table; the cross-configuration results are labeled in App. C.4. Sec. 3.3 and App. A.1 document both recipes. The original run had no warmup; the 200-step field was not applied.
The two new seeds yield 500M BPB costs of .0110 and .0111, with all 12 instruction-gain intervals above zero. On fixed common-failure prompts, checkpoint differences in correction status exceed seed differences by 11.8 pp [6.6, 17.5] on IFEval and 6.8 pp [3.9, 9.7] on IFBench (App. C.1). This directly supports receiver dependence beyond the observed training variation. Code, configurations and Tibetan prompt sets are included in the supplement.
W3 / Q2. Longer Tibetan generation and paired testing clarify the transfer gap. We checked stopping and regenerated the original 500M endpoints at 8,192 tokens. Of 1,062 outputs capped at 3,072, 1,034 remain capped; no strict score changes by more than 1.3 pp. On matched English–Tibetan prompt pairs, the English Full−CPT gain exceeds the Tibetan gain by 11.9 pp [3.7, 20.1] on IFEval and 16.5 pp [2.5, 30.4] on IFBench. English uses 1,536 tokens. Both intervals exclude zero despite the larger Tibetan budget. Thus, English gains cannot substitute for target-language evaluation (Sec. 4.2; App. C.6).
Q1. Replication and matched-cost interpretation. Four Qwen trajectories and an external Llama CPT endpoint now show positive instruction gains. Llama's cost is 0.72× its Post−Base cost, and its corrected prompts change with the receiver (Sec. 4.3). The calibrated Lower comparison is specific to the original Qwen endpoint. In Llama×Basque, Lower is 8.5 pp IFEval above an interpolation between α=.25 and α=.5 at its BPB. Those doses are not a calibrated control. We therefore retain the general requirement for a matched-cost comparison, while keeping the null location result specific to the tested endpoint (Sec. 7; App. C.5).
W4. Model scale. The main evidence covers Qwen3.5-9B and Llama-3.1-8B. A 2B extension did not reproduce the robust instruction gain after CPT; Sec. 7 states the 8–9B scope and App. C.8 reports the extension.