- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the post-training logit difference between a small instruction-tuned model and its base counterpart, applying this difference to a target model during decoding. The authors explicitly position the work as an empirical investigation of an existing decoding rule rather than a new algorithm. The study examines effectiveness, token-level sparsity, and portability across model families and tokenizers. It reports substantial improvements on mathematical reasoning, alignment, and truthfulness benchmarks
Critical strengths
-
The empirical improvements are substantial and receive meaningful validation. The same-family mathematical gains persist on the complete GSM8K and MATH-500 test sets, where the grafted target also exceeds the smaller donor. Cross-family experiments with both Qwen and an architecturally different LFM2 donor provide useful evidence that the effect extends beyond a single donor family.
-
The analysis goes beyond aggregate benchmark improvements. The token-masking experiments include random controls matched by frequency and delta magnitude, providing evidence that reasoning-related vocabulary carries useful guidance. The error-conditioned evaluation also identifies cases where both the donor and unguided target fail but the grafted target succeeds. These analyses strengthen the evidence for complementary behavior rather than simply reproducing the donor’s final answers.
Critical weaknesses
-
The incremental contribution over proxy-tuning is overstated. Although the authors acknowledge that the decoding rule is established, proxy-tuning already analyzes reasoning and stylistic tokens in Section 6.1, and reports top-token change rates and stronger effects at early positions in Appendix C.2. Table 1 therefore understates the prior paper’s coverage. Could the authors revise this comparison and identify which findings provide substantively new understanding? In particular, does the entropy concentration reveal something specific to post-training deltas after accounting for the target’s confidence margin and perturbation magnitude, or would similarly sized generic logit interventions exhibit the same pattern?
-
The cross-tokenizer bridge needs stronger calibration and validation. Appendix J updates only mapped tokens and leaves the remaining guidance at zero. A constant shift in donor logits leaves donor predictions unchanged, but under this partial mapping it can change the preference between mapped and unmapped target tokens. This introduces a normalization dependence beyond the clipping issue acknowledged in Appendix H. Could the authors compare raw-logit and normalized log-probability deltas, and explain how donor prefixes remain synchronized when token boundaries differ? Since cross-tokenizer portability is a central new contribution, confirming the main cross-family gains on complete test sets with a fixed guidance strength would also strengthen the evidence beyond the current 200-example sweeps.
Overall, the results demonstrate useful transfer, and the full-test mathematical improvements are convincing. However, the paper’s contribution is narrower than the current comparison suggests, while the principal new portability claim needs clearer implementation details and robustness checks. A corrected account of prior work and stronger validation of tokenizer bridging could move my assessment toward acceptance.
Questions for authors
See weaknesses.
Rebuttal srEg
Response to Reviewer srEg
We thank the reviewer. The general response covers the shared points, and we answer the rest here.
Table 1 understates proxy tuning (W1).We agree and revised it (
G2). Table 1 has been updated.Is the entropy concentration specific to post-training deltas (W1)?For the location, no. Grafting a noise delta of the same size changes tokens at the same high-entropy positions. For the gain, yes. This noise delta grafting lowers accuracy, while the post-training delta keeps the gains (
G3). We revised the paper to claim only the second.Validating the bridge (W2).See
G1andG5. We included ablation on doing grafting in log-prob space vs logit space. Both perform similarly. We also provide clarification in the appendix on how the donors stay synchronized.Full test sets for cross-family results (W2).We will report the cross-family results on the full GSM8K and MATH-500 test sets at a fixed α in the camera-ready version. In the interim, two findings back up the reported figures: (1) The full-test run within the same family validates the 200-problem sweep, (2) Choosing α on train-set preserves the cross-family improvement (
G6).