- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper studies prompts in which a model applies a rule to a few facts and answers directly, as guardrails, classifiers, and judges do. In a synthetic task with three facts and one rule sentence that moves among them, the authors enumerate all eight truth assignments to obtain complete answer tables and define the influence of each fact on the answer. Across 18 open models, the influence of the named fact falls from 76 to 34 (medians) when the rule moves from just before it to just after it, while the influence of the facts read after the rule rises, and the models still answer separate questions about the rule and the fact mostly correctly. Re-reading the fact after the rule restores its use, and hidden-state transplants move the answer more when written into the fact's tokens than into the rule's tokens, which the authors interpret as the rule's outcome being formed at each fact's tokens during reading and read from there by the answer.
Critical strengths
- The behavioral design isolates rule placement, since only one sentence moves between layouts, six formatting factors are counterbalanced, complete eight-row answer tables are recorded, and the full placement grid argues against distance to the answer as the cause (Fig. 2b). The step appears in 18 of 18 models and in both vocabularies, which supports the placement effect independently of the mechanistic account.
- The paper separates knowing a fact from using it, as the models answer the attribute and match questions while the action fails (Fig. 3). A copy of the fact restores its use only when read after the rule, not before it and not when another fact is copied (22 to 80 versus 23 and 21, Fig. 4a), which locates the failure between the fact and the answer.
Critical weaknesses
- The observed drop in influence may also be due to an instruction-following fault under an unusual prompt structure. In standard pretraining and instruction-tuning distributions, rules almost always precede the data they govern. Placing a rule after the fact does not follow this prior, and the authors do not fully disentangle whether the failure is driven by distribution mismatch. In fact, Llama-3.3-70B and smaller models are less robust than closed models like GPT and are easy to break, but experiments on stronger, more robust frontier models are missing.
- Experiments use short prompts with only three facts and one rule (Sec. 2), so it is unclear whether a fact placed before its rule is still ignored in longer prompts with more facts.
- Main prompts come from a single template , so the results may not hold for other prompt wordings and tasks.
Questions for authors
- Does the step persist when the number of facts grows or when unrelated text of several hundred tokens separates the rule from the named fact? A result of this kind would address the first weakness. (clarification or short experiment)
- Could the behavioral test be run on one or two closed models through sampled answers, to show whether the placement law holds there?