- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies the separation between learning a factual association and learning how to retrieve that fact under different request forms. Through two-stage training with identical target-fact training but different earlier request-form exposure, the authors show that models can learn the same facts yet differ sharply in retrieval through held-out forms. They further identify a “context state” at the answer position as a link between earlier request-form training and later fact retrieval, and support this with context-state similarity analyses, patching, steering, and training-time state shifting across several models and factual relations.
Critical strengths
-
The two-stage design cleanly isolates earlier request-form exposure from target-fact training. Because the second-stage target-fact training is identical across conditions, the observed retrieval differences are easy to attribute to the earlier stage. This is the paper’s strongest conceptual contribution.
-
The paper validates the separation across several models, relations, and evaluation forms. The combination of correlational context-state analyses with intervention-style experiments strengthens the initial empirical claim beyond a single setting.
Critical weaknesses
-
The experiments use fictional country capital pairs, template based request forms, a fixed 2,000 candidate pool, and relatively small or open models. It remains unclear whether the conclusions transfer to natural text factual learning, larger models, or real fine tuning pipelines.
-
The paper shows that retrieval depends on the final words of the request, that the restoring direction overlaps with punctuation or suffix directions, and that transfer survives incorrect answers and different relations. This leaves open whether the context state encodes a general retrieval mode or mainly the request form and its wording. The residual support in Qwen also suggests additional components are not accounted for.
Questions for authors
-
Can you test this on natural text facts or on at least one larger model? If not, can you clearly state how far the claims are meant to apply?
-
Section 3.4 already shows that retrieval depends on the last few words of the request. Given that, can you show whether the context state direction still predicts retrieval when the last few words are held the same but the request type differs? This would help distinguish a format level state from a word level state.
-
Does the restoring direction remain effective when it is collinear with punctuation or suffix directions? In Qwen2.5-1.5B, removing it still leaves accuracy at 0.944. What explains this residual support? Are there settings where the direction fails or reverses?
-
Table 3 shows that transfer survives incorrect answers and different relations. To what extent does the context state mainly encode the request form/retrieval mode rather than the fact-answer binding? Could you add a stricter condition using the same five request-form templates but completely unrelated or randomly shuffled facts/answers, token-matched to the correct-unrelated condition, and test whether the same transfer and context-state similarity still appear?
3 comments
Response to Reviewer pdRf
Q4. Separating request-form learning from fact–answer bindings.
We appreciate the reviewer's suggestion to separate request-form learning from factual associations. Using the same five request forms and matched Stage 1 token budgets, we compared correct but unrelated fact–answer bindings, consistently incorrect bindings obtained by permuting answers across facts, and independently randomized answers on each training occurrence. All conditions received identical subsequent target-fact training.
Crucially, even with consistently incorrect bindings, context states for the trained declarative and unseen list forms remain strongly aligned (centered cosine 0.901), comparable to correct bindings (0.893). This alignment accompanies nearly identical retrieval accuracy on entirely new Stage 2 facts (0.990 vs. 0.994; Pythia-410M, three seeds) (Table 3). By contrast, independently randomized answers yield weaker state alignment (0.597) and retrieval (0.163), versus 0.383 and 0.000 under statement-only training.
Together with our causal interventions, these results provide evidence that prior request-form experience develops reusable internal conditions for retrieving new facts, rather than merely encoding previously learned factual associations.
Thank you for your response. It has resolved my concerns. I maintain the current score.
Response to Reviewer pdRf
W1 / Q1. Generalization to larger models and realistic factual learning.
We appreciate the reviewer's suggestion to test larger models and more realistic factual learning. In Qwen3.5-9B-Base, both training conditions learn the target facts almost perfectly (0.993 vs. 1.000), yet retrieval differs on unseen short key–value requests (0.052 vs. 0.604) and colon-ended declarations (0.687 vs. 0.998) (Appendix H, Table 7), across three seeds.
We also evaluated Qwen3.5-9B on CounterFact using 1,000 counterfactual edits involving real-world entities per seed across three seeds. Both conditions acquire the edited facts comparably well (editing-efficacy difference −0.001). Yet across six held-out non-declarative request forms, edited-answer preference accuracy improves from 0.600 to 0.885 (+0.285, positive in all three seeds) (Appendix H, Table 8), while greedy-generation accuracy improves by +0.365. In contrast, CounterFact's original declarative paraphrases show negligible improvement in edited-answer preference (+0.003).
These results extend the separation between factual acquisition and retrieval to a recent 9B model and real-entity counterfactual editing. The training inputs and evaluated request forms remain structured; we do not claim generalization to learning facts from unrestricted natural prose.
W2 / Q2. Evidence for a format-level retrieval mechanism.
We appreciate the reviewer's suggestion to distinguish broader request-form effects from the influence of the final tokens. We conducted a controlled experiment on Qwen3.5-9B, holding the final tokens (“capital of X:”) identical while varying the preceding context across eight request types, including questions, dialogue, instructions, lists, and quotations.
Despite identical endings, statement-only retrieval accuracy varies substantially across request types (0.000–0.780). Earlier diverse-form training raises mean accuracy from 0.408 to 0.948 (Appendix J); on the note, header, list item, and quotation wrappers, none of which begins with a prompt from earlier training, the mean rises from 0.640 to 0.998.
These results establish that the request ending, while influential, does not fully determine factual retrieval. Broader request structure and prior form experience also matter, even when the final tokens are held fixed. Together with our causal context-state interventions, this supports an account in which retrieval depends on the answer-position context state shaped by both local wording and broader request structure, rather than on the final tokens alone.
Q3. Residual support and bidirectional control of retrieval.
We appreciate the reviewer's question of whether retrieval restoration survives removing punctuation-related directions.
In Qwen2.5-1.5B, removing the original punctuation direction u from the restoring vector preserves substantial restoration (0.951, compared with 0.995 using the full vector, eight seeds). Thus, the causal effect is not confined to this single punctuation direction. Further analysis shows that Qwen's remaining effect is distributed across additional context-state directions: removing an eight-dimensional subspace derived from answer-free prompts with different endings reduces restoration to 0.395, comparable to a norm-matched random control (0.450) (Appendix N). These results distinguish the restoring effect from u alone, while showing that the additional directions overlap with a broader ending-related subspace.
The reverse intervention exhibits a clear form-dependent asymmetry. Subtracting the restoring vector abolishes retrieval on held-out list requests (0.603 → 0.000) and colon-ended declarations (0.482 → 0.000), but only partially suppresses the directly trained declarative form (0.999 → 0.559) (Appendix L). This is consistent with direct Stage 2 training making retrieval in the trained format more robust to perturbation, while retrieval through held-out forms depends more strongly on the transferable context-state component.