- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper studies whether a transformer can use interventional evidence when the context also contains observational records with the opposite sign. The authors build synthetic causal models where the observational association is negative and the interventional effect is positive. Then they train 25.7M parameter transformers from scratch on symbolic record. This paper formalizes what each record type identifies and shows that an ideal reader under a positive-effect prior never reverses sign in Proposition 1. On 50 held-out worlds, the probe-only model has 41 hits and 4 reversals, compared with 18 and 19 for the mixed-context model. At a fixed checkpoint, increasing observational records from one to four reduces hits from 31/37 to 17/37 and raises reversals from 1 to 11.
Critical strengths
-
The question is clear and important.
-
The fixed-checkpoint design separates the effect of training from the effect of context at inference time (see Eq. 2, Table 4).
-
Proposition 1 gives a simple test: under a sign-restricted prior, any reversal caused by added context indicates suboptimal evidence use.
Critical weaknesses
-
The theoretical contribution is limited. Proposition 1 follows directly from the conditional expectation of a positive quantity, and Eq. (3) is a weighted average.
-
The pooling model in Eq. (3) is not tested quantitatively. It gives a reversal threshold that depends on , but is never estimated. The closest check is in Appendix E, where the association between suppression and observational-correlation magnitude is not significant in the 50-world follow-up (p = 0.14). Table 4 reports only three dose levels, and record count changes with context length. The content experiment fixes the count but does not separate the two.
Questions for authors
-
Could the authors fit Eq. (3) to the dose data and report the estimated ? This would show whether the pooling model fits the trained model quantitatively.
-
Could the authors report more dose levels with context length held fixed, for example by padding shorter contexts? This would separate record count from context length.