- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper is considering the problem of gender-bias localisation (whatever the authors mean by that as it is not defined in abstract nor in the intro) and compare different (all existing and no novelty regarding this point) interpretability methods on the StereoSets dataset. Five such methods are compared in the paper. Overall I find this paper very poorly written with rather complex and vague sentences. The authors do mention that they used Claude to make the paper "clear" but I am afraid this seems to have made it pretty unclear and difficult for even an expert such as myself who has been working in this topic for over a decade to understand the value of this work
Critical strengths
A comparison of five (all existing) localisation methods on a single dataset.
Critical weaknesses
- The paper does not provide a clear definition of "localisation of gender-bias". Do you mean across countries, cultures or languages? Or just finding which part of a neural net bias neurones are located? I guessed the latter from the context but that point should have been made clear at the beginning of the paper.
- The writing is rather sloppy/informal at times and then there are pretty complex sentences with many clauses that are difficult to even understand to even a native English expert.
For example, look at the following sentences.
- "Recent advancements in mechanistic interpretability (MI) have provided methods that allow people to identify the components underlying desired behavior and then edit them." -→ "people"?
- "To understand the differences in the use of these methods for the gender bias localization task, we benchmarked them against an ablation ground truth on a gender StereoSet1 variant." → "ablation ground truth" means what? "these methods", "them" refers to what?
- "The results are that direct attribution does not recover causal importance for gender bias: its error is 88–110% of ∑︁ |AP|, no better than a constant-zero predictor, and it recovers four or five of patching’s ten most important components with the sign right little better than chance." ... that is a pretty dense and complex sentence. Even after reading for three times I still could not understand what you want to say.
- The experimental results are reported on a single dataset (StereoSets) which is a templated dataset. It is not clear whether the results would generalise to other datasets.
Questions for authors
- Sterosets is a templated dataset and does not reflect true social bias variations. Why did you use this dataset? What other datasets can you report results on? We cannot make reliable conclusions on a single dataset.
- The paper considers only binary gender. why?
- how did you decide on those five methods to compare?