- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper investigates the representations of phonemes in RNNs and in the human brain, in particular regarding their position and identity. The authors test the Onion hypothesis, which posits that, in RNNs, the direction of the state encodes token identity and its magnitude encodes token position. They test this hypothesis, alongside other alternatives: their proposed Spiral Hypothesis, which suggests that position is encoded jointly by a decaying magnitude and a systematic state rotation, and subspace baselines. They first test phoneme representations in an RNN trained to repeat English words sampled according to their natural frequency. They show that the norm of the encoding decreases with position, in accordance with the Onion hypothesis. They show that, at a class-level (consonants and vowels), phoneme identity is encoded in direction. However, unlike Onion predictions, they show that identity direction varies with position. Through causal interventions, they show that the Spiral hypothesis achieves higher predictions, in particular for late positions. Last, using intracranial recordings of the STG, they show that phoneme position is encoded in response magnitude, and that the phoneme directions are more aligned within than across class.
Critical strengths
- The paper develops a concrete and testable hypothesis of phoneme-position binding, motivated by previous literature where they identified a limitation and thus refined it.
- The authors used different methods, causal interventions, comparison with baselines, and investigated RNNs and human brains. Their findings strongly support the Spiral hypothesis in RNNs.
Critical weaknesses
- While confounds such as surprisal are taken into account, other low-level features of the phonemes (e.g., duration) are not tested. The comparisons are also restricted to a coarse-level (vowels vs consonants) and not at the individual phoneme level.
- The intracranial findings support the magnitude results common to the Onion and the Spiral hypotheses but cannot distinguish them based on identity direction. This distinction is thus not tested in the brain.
Questions for authors
How do you interpret the slight upward bump in Figure 4B? Are particularly long words subject to exceptional phonotactics?
We thank the reviewer for the positive assessment of our hypotheses and methods.
Response to Critical Weakness 1:
Low-level confounds. We agree that this is an important control; Reviewer 1 raised a related concern. If position is encoded in response magnitude, its effect should survive when low-level features are controlled for. We therefore regressed ‖Δ‖ on position together with surprisal, lexical stress, phoneme duration, sound level and the spectral change between consecutive phonemes, with standard errors clustered by word (full table in our response to Reviewer 1). Position remains significant (p = 1.7×10⁻⁶). Duration and sound level have the largest effects: later phonemes tend to be longer and quieter, which accounts for part, but not all, of the decrease with position. In the revised manuscript, Section 3.3 now reports this regression, with the full analysis in a new Appendix A.4.
Individual phonemes. We thank the reviewer for this suggestion, which led to a new result. We added finer-grained comparisons among consonants, which have enough tokens per phoneme. Pairs of the same consonant are more aligned than pairs of different consonants (AUC = 0.52, p < 0.001). Among different consonants, pairs that share their manner of articulation are more aligned than pairs that do not (AUC = 0.54, p = 0.01; permutation test shuffling manner labels across phonemes), whereas place of articulation shows no effect (AUC = 0.49, p = 0.42). The direction of the neural response therefore carries information below the consonant–vowel level, mainly about manner. Figures and results will be added to appendix.
Figures R6 and R7 show cosine similarity by manner and by place of articulation.
Response to Critical Weakness 2:
Rotation in the brain. We agree, and we state this explicitly in Section 3.3 and in the Limitations. We note, however, that this concerns one component of a broader study. The core contribution of the paper is a mechanistic account of phoneme–position binding in neural models, established through causal interventions and baseline comparisons, which the reviewer finds strongly supports the Spiral hypothesis. The intracranial analysis then tests the prediction that the Onion and Spiral hypotheses share, a decrease of response magnitude with position, and confirms it in human STG, robustly to surprisal and acoustic controls. The rotational component is a new prediction that follows from our model results. Testing it requires many repetitions of the same phonemes at several within-word positions, which no existing dataset provides. We make it explicit so that future intracranial experiments can be designed to test it, and we see this as a contribution of the work rather than a gap.
Response to Question for authors:
Question on Figure 4B. The increase from position 6 to 7 is small (from 5.18 to 5.31) and well within the standard error. Position 7 contains only 8 tokens from five word types.