- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors propose a new metric, Answer Prompt Dependence (Answer PD), which measures how the probability of a particular model answer changes between pre-training and post-training. The authors examine several relatively small models (1.7B–7B parameters) on two datasets. They analyze the results for OLMo 2 7B in greater detail because checkpoints from different stages of training are available for this model. The main conclusion of the paper is that the proposed Answer PD metric differs across models and, in some cases, may even change its sign.
Critical strengths
None.
Critical weaknesses
- It is unclear what specific problem this work helps solve and what practical knowledge can be gained from it. The paper does not explicitly discuss the potential impact of the research. For a reader who is not closely familiar with the topic, it is not obvious how the findings should be interpreted or how they could be applied in future research without additional explanation. This is further exacerbated by the complete absence of any discussion of future work. Moreover, the paper lacks scientific novelty and merely applies already known approaches to a small number of models. These experiments do not support any broad conclusions, and the impact of this work remains unclear.
- The quality of the manuscript itself is very poor. It is extremely difficult to read, lacks a clear structure, and the main point of many paragraphs is unclear, making it very difficult to develop an understanding of what the paper is about, even after careful reading. The low quality of the paper is particularly evident in its figures and tables, which are even more difficult to understand than the text and appear very poorly prepared. The manuscript appears to require substantial restructuring and careful proofreading before its contributions can be properly evaluated.
Questions for authors
- Apart from the questions arising from the weaknesses listed above, which the authors are unlikely to be able to address during the rebuttal period, there is also a question regarding the applicability of the proposed approach. Have the authors conducted any additional experiments on other models? In particular, it would be interesting to know whether the proposed approach is applicable to models with reasoning capabilities.
7 comments
I have read the authors' response and examined the revised manuscript. Unfortunately, neither has addressed my main concerns. It remains unclear what meaningful conclusions can be drawn from the reported results, how they should be interpreted, or what practical scientific value the proposed metric provides. The additional experiments do not resolve these issues.
The presentation also remains very poor. In particular, the figures are still difficult to interpret and appear to be AI-generated, with insufficient attention to clarity and readability. Overall, I do not believe the manuscript has reached a level of clarity and scientific maturity that would allow for a meaningful evaluation of its contribution.
I therefore maintain my original assessment and rating.
Response (1/2): What We Measure and What the Results Tell Us
Thank you for reading our previous response and the revised manuscript. We understand that your main concern is what can actually be learned from our experiments. We would like to explain the method and the meaning of our findings more directly.
Our study asks whether post-training changes how a model responds to factual information when assigning probability to an answer. More specifically, when we replace one factual statement with another that expresses the same relation but has a different correct answer, does the model's probability for the original answer change differently before and after post-training?
Consider a simple example. The capital of France is Paris, while the capital of Japan is Tokyo. We construct two prompts: “The capital of France is ...” and “The capital of Japan is ...”. Instead of asking the model to generate two different answers, we keep the preceding answer text and the target answer “Paris” fixed. We then calculate the log probability assigned to “Paris” under each prompt.
The difference between these two log probabilities is what Answer PD measures. It tells us how much more or less the original factual prompt supports “Paris” than the matched substitute does. We perform exactly the same comparison for the Base and post-trained versions of a model.
How should we interpret a change in Answer PD? If Answer PD increases after post-training, the relative probability support for the original answer shifts in favor of the original factual prompt. If it decreases, the relative support shifts toward the substituted prompt. Thus, the comparison tells us how the model's response to a factual substitution changes between its two versions. It does not, by itself, tell us whether the model has become more accurate.
Our experiments reveal that these changes are not uniform. On CounterFact, Answer PD decreases by 1.81 nats for Qwen3-1.7B. This means that, after post-training, the original factual prompt provides less relative log-probability support for the fixed answer than it did in the Base version. In contrast, Answer PD increases by 2.30, 0.75, and 3.78 nats for Mistral, SmolLM2, and OLMo 2, respectively. For these evaluated model versions, the relative support shifts in the opposite direction. The same four directions are observed on ParaRel.
The OLMo 2 results provide a further insight. Because several intermediate model versions are available, we can examine where the measured change appears along the released sequence. Answer PD increases from Base to SFT, from SFT to DPO, and from DPO to Instruct. The largest increase occurs between Base and SFT, accounting for approximately two-thirds of the total increase on CounterFact. This identifies the model-version comparison in which the largest difference appears, without establishing that SFT itself caused it.
The central finding is therefore not simply that some scores increase while others decrease. It is that, under the same evaluation protocol, different post-trained model versions can show opposite changes in how a factual substitution affects their probability for the same answer. We therefore cannot assume that post-training uniformly increases or decreases this measured dependence on factual prompts.
This matters because two model versions may produce the same final answer while responding differently, in their conditional token probabilities, when the factual prompt changes. Answer PD makes that difference observable. Our findings are limited to the evaluated models and protocols; they do not imply changes in overall factual accuracy or establish causal effects of individual training stages.
Response: Research Contribution, Model Applicability, and Presentation
We thank the reviewer for the comments on the motivation, contribution, and presentation of our paper. We understand the concern that the original submission did not sufficiently explain why measuring Answer PD is useful. Our main question is whether post-trained checkpoints differ in how strongly a stated fact supports a particular answer token, when the preceding answer context is held fixed. This is different from asking whether a model can produce the correct answer, and we have revised the introduction and methodological explanation to make this distinction clearer.
The main contribution of this work is to provide a controlled way to examine how factual-prompt dependence changes across released post-training checkpoints, together with empirical evidence that these changes are not uniform across the evaluated models.
Our method compares two prompts that express the same factual relation but refer to different subjects and answers. By holding the gold response prefix and target token fixed, we measure how much the stated fact changes the model's conditional support for that token. This separates the factual substitution being tested from differences in generated responses or answer wording.
The distinction matters because conventional answer-level accuracy can identify whether a model answers correctly, but cannot directly show how strongly the stated fact supports a particular answer token. Our experiments use this controlled comparison to reveal differences between checkpoints that would otherwise be difficult to characterize from response-level results alone.
We view this as an empirical measurement contribution. It does not establish the internal mechanism behind the observed differences or the causal effect of individual training stages, but it provides a more specific basis for studying how factual-prompt dependence varies across checkpoints.
The experiments illustrate why this distinction matters. Under the same plain-text scoring protocol, Answer PD decreases by 1.81 nats for the evaluated Qwen3-1.7B Base-to-Post pair, but increases by 2.30, 0.75, and 3.78 nats for Mistral, SmolLM2, and OLMo 2, respectively, on CounterFact. The same directions are observed on ParaRel. For OLMo 2, the additional released checkpoints show that the largest adjacent increase occurs between Base and SFT, accounting for approximately 68% of the total Base-to-Instruct increase on CounterFact.
These results show that post-trained checkpoints do not exhibit a uniform change in factual-prompt dependence under the tested protocol. We do not interpret the OLMo 2 trajectory as evidence that SFT or any subsequent training stage caused the observed changes, since the released checkpoints do not provide controlled causal comparisons.
Regarding the applicability of the method, our main study already includes four model families. Following the review, we also conducted additional experiments with Qwen3-4B under the original plain-text protocol (W0) and a native-chat protocol (W3). On CounterFact, the Base-to-Post Answer PD changes for Qwen3-4B are +2.042 under W0 and +4.218 under W3. Both are positive, unlike the negative W0 change observed for Qwen3-1.7B.
These additional results indicate that the direction of change depends on the specific checkpoint pair and input protocol, and should not be generalized across all Qwen3 model sizes.
The scoring method can in principle be applied to autoregressive language models for which token-level conditional probabilities are accessible. However, we have not systematically evaluated reasoning-mode behavior or larger reasoning models. Our current results therefore do not establish whether the same patterns hold during multi-step reasoning or free generation. We consider this an important limitation of the present study.
We also appreciate the reviewer's comments on the presentation and readability of the paper. In response, we have revised all figures throughout the main text and appendix, with particular attention to layout, labeling, and the clarity of the information presented. Figures 1 and 2 now provide a clearer explanation of the overall evaluation framework and the fixed-prefix scoring procedure. We have also improved the presentation of the experimental results to make the comparisons across models and checkpoints easier to follow.
In addition to these revisions, we have added two new analyses to the appendix: a robustness evaluation across different prompt wrappers (Figure B10, p. 23) and a comparison of factual and wording sensitivity on the same subset of examples across four model families (Figure B11, p. 24).
We thank the reviewer again for the careful assessment and constructive criticism. Your comments helped us identify parts of the original manuscript that needed clearer explanations and presentation. We hope these revisions make the research question, methodology, and findings easier to understand and evaluate.