- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper investigates whether linear probes and SAEs identify low-level linguistic information encoded in human language across several languages. They train probes and SAE on XGLM-564M and find that they can each recover a reasonable fraction of the 40 linguistic variables they test for. They also test whether ablating or steering with these features/probes influences the model's generation in a meaningful way.
Critical strengths
None
Critical weaknesses
The paper is poorly written, confusing, and difficult to understand, including using undefined phrases/terms or strange AI-coded language. It is not quite clear what the actual contributions of this paper are or how they relate to prior work and the related work is quite sparse in general, which could also be improved. Additionally, many experiment details are unclear or lack justification, such as using an arbitrary letter ranking system without defining how the rubric was applied, or steering/ablation methodology, among others. Many details are left to the appendix, but this does not help the readability. I would recommend rejection based on the lack of clarity of the submission.
Questions for authors
Can you clarify the rubric/process by which you assigned letter-grades to SAE features, and what the various letter grades mean?