- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper documents an underreported stylistic effect of post-training, which is models generally use fewer first-person forms (“I,” “we”), while changes in second-person forms (“you”) depend strongly on prompt format and training pipeline. Its main contribution is a systematic comparison of 16 models of different training-stage and prompt styles for this pronoun usage metric. They also did controlled preference-training interventions to test how preference data usage of pronouns contributed to the trained model. These experiments show that pronoun usage is steerable and that preference-data biases explain part, but not all, of the decrease. The underlying mechanism not explained.
Critical strengths
- The authors did quite comprehensive experiments on 16 models across different training stages and 3 prompting formats.
Critical weaknesses
- I think this is an interesting fact to observe but I don't see much value in reporting this observation. Is usage of first or second pronouns related to some deeper alignment issue? Even if it changes over post-training, does it matter for model's capability at any domains? As a reader I find it hard for me to connect this finding to any significance of this field.
Questions for authors
- See weakness 1: I would appreciate authors to provide me the missing motivation and how this finding connect to the development of this field.