- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies 18 pretrained language models from six families to examine whether poor task performance reflects missing internal representations or failure to use representations that are already present. It argues that smaller models often contain useful relational structure but fail to translate it reliably into answers.
Critical strengths
- The topic is interesting and timely, and the paper evaluates a relatively broad set of models rather than relying on one model family.
- The attempt to combine representation analysis with causal interventions is also potentially valuable.
Critical weaknesses
-
The methodological presentation is overly complicated and difficult to follow. The paper combines several quite different analyses—ordinal probing, forced-choice recall, representation erasure, cross-model hidden-state transfer, attention blocking, lexical-prior analysis, “stubbornness”, and symmetrised scoring—within one narrative. As a result, the central scientific message becomes hard to see from the breadth of analyses.
-
The study does not convincingly identify what factors make one language model perform better than another. The paper repeatedly relates behaviour to model size, but model family, architecture, training procedure, and parameter count are also important. This substantially limits the broader conclusions regarding why some models make better use of their internal representations.
Questions for authors
-
Can the authors provide a clearer causal framework showing how the different analyses, e.g., probing, erasure, transfer, attention intervention, lexical priors, and symmetrisation, fit together and which experiments provide the primary evidence for the claimed representation gap?
-
Given that model size, architecture, family, and training are highly relevant to this topic, what evidence supports attributing the observed performance differences specifically to better “use” of representations?
Thank you for the review.
Each analysis answers a question raised by the one before it.
Steps 1 to 3 are the primary evidence for the gap. Steps 4 and 5 explain and correct it. Step 6 tests its scope.
Two results support it.
We cannot say which training factor produces better use, because data, recipe and architecture cannot be varied independently across public checkpoints.