This paper studies the problem of whether post-training degrades arithmetic performance on addition, subtraction, several multiplication tasks (multiplying by one digit, two digits, or the same number of digits as the first argument), and exact division (without remainder). The paper attempts to separate the effects of two different aspects: First, whether the checkpoint is the pre-trained "base" checkpoint or if it is a post-trained release checkpoint (e.g., after SFT). Second, the "route", which I understand to be the prompt formatting (e.g., do we simply give the model a sequence to complete, or should we include things like change of turn tokens, tokens for delimiting thoughts, etc.).
The authors discover that for some pairs of pre- and post-trained checkpoints, using a completion-style prompt recovers some accuracy in arithmetic tasks that the chat-based prompts lose (under constrained decoding where the model sampling is limited to the set of tokens consistent with a grammar describing the output format). In some cases, removing the constrained decoding improves accuracy for the chat-formatted prompts again. There are a number of additional supporting experiments (including changing the prompt format, and experiments around "base-content transfer" where the post-trained model's activations are modified at runtime to try to recover pre-trained performance).
Response to Reviewer Hr8s
Thank you very much for the review and for the encouraging comments on the evaluation design. You are right that the paper was hard to follow, and we apologise for the difficulty. We rewrote the Introduction in plain words: it now introduces only the terms needed to state the question and the main result (the two input formats, the evaluation setup, the three comparisons of checkpoint, input format, and both combined, and what we call a reversal), followed by a motivating example, and every other term is defined in the section where it is first needed. Please also see the general response for the new audit without constrained decoding.