- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies safety controls (“refusal) and the impact of individual experts. It builds upon previous work that identifies experts important to refusal and shows that force-activating such experts changes behavior (increasing refusal, sometimes too much) while removing such experts has minimal impact. They show this is similar in the multilingual context, even if removal actually has more impact.
Critical strengths
- Motivation behind studying this problem (interpretability of safety, especially in multilingual context)
- Builds a large dataset that could be useful if released. With this dataset, the paper presents large-scale empirical results on multilingual “refusal” on safety benchmarks
Critical weaknesses
- Paper is impossible to parse; writing is brutally jargonized and wording is consistently poor. Examples from just the abstract: “behavioral control” “unmodified inference” “need not reveal a shared refusal mechanism” “manipulable sparse routing” “routing contrasts” “layer-matched controls” “forcing” “removal sensitivity” “refusal-control interface” “localized mechanism”.
- No code or data released, so first contribution of “an evaluation set” is non-existent. L150-152 claims that humans reviewed 3,300 translations three-times over and there are zero details about how such language-experts were sourced or compensated. This gives no confidence that any of this happened.
- No novel findings about MoEs: in sparse, redundant MoEs expert-removal rarely does much. Given MoE redundancy, expert removal and expert force-activation clearly have different impact (expert sufficiency vs. necessity). Many prior papers have revealed that collecting routing statistics capture something behaviorally meaningful (like those cited L38-39).
- Multilingual angle did not present anything notable
Questions for authors
- What is “layer-matched” controls ? Why would you apply steering at different layers across languages in the first place ?
- Did you end up using Jailbreak and RedTeam data ? I’d recommend ignoring if you do not know where/how they were created.