- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper examine how grammatical exposure affects the organization of information in LLM concept representations. It combines comparisons of independently trained Goldfish models across five languages and four data budgets with controlled English pre-training and continuation experiments using 125M-parameter models.
The paper finds that small classifiers can recover definiteness labels, such as the distinction between “a dog” and “the dog,” and a coarse numeral-classifier grouping in both English and Mandarin, despite differences in which distinctions their grammar requires speakers to mark.
In the experiments, removing “a/an/the” lowers classification performance using the full representation but improves it using its top four principal components, compared with matched random deletion. During further training on article-deleted text, an earlier classifier becomes less effective, while refitting the measurement pipeline gives approximately unchanged performance relative to the starting checkpoint.
Critical strengths
- Experiments are well-designed. The article-deletion condition is compared with deletion of other non-article functional words, matched in deletion count and sentence-initial count. Architecture and tokenizer are fixed. The processed-token budgets for the two deletion conditions differ by at most 0.02%. Common-fork continuation restores the same training state before branching.
- The authors include checks for shortcuts in the measurements and report unsuccessful behavioral experiments and other inconclusive analyses. This helps distinguish the supported findings from questions that remain open.
Critical weaknesses
- The paper advertises a five-language investigation, but the main-text evidence focuses on English–Mandarin comparisons and English-only interventions. The results of other languages are mainly only in the appendix and receive little interpretation in the main text. Replication on another language or grammatical feature would strengthen the broader interpretation in terms of linguistic experience.
- Predicting a word-related label is not the same as demonstrating a general concept. For example, the Mandarin evaluation uses explicit expressions such as "this dog" versus "a dog," rather than directly testing whether a bare word like "dog" refers to something already identifiable from context. The classifier cannot see the upcoming target, which is a useful safeguard, but familiar sentence patterns can still help predict its label. I would like a clearer separation between successful label prediction and the broader claims about conceptual knowledge.
Questions for authors
- If I understand this correctly, this paper is trying to claim that even though Mandarin grammar does not require an English-style article system, a mandarin model’s internal states can predict the definite/indefinite labels used in this experiment?
- Is there evidence that the controlled findings extend beyond English "a/an/the," or that they predict a difference in a task the model can successfully learn?