- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper examines obtaining higher quality activation steering vectors from a data perspective, focusing on language and persona steering. Compared across multiple methods of steering vector extraction, the authors find that demonstrating this feature other than instructing and data quality can give better vectors. Overall, they highlight the importance of data design when obtaining steering vectors.
Critical strengths
The question is interesting and important. The paper focuses on the data quality perspective and the design of demonstration versus instruction is quite interesting.
Critical weaknesses
- The assumption of better steering vectors need smaller alpha (steering strength) needs evidence.
- The task setup is mainly language and persona, which can consist of multiple subspaces. Maybe the story would be stronger if the subject is a cleaner feature. Considering the evaluation is mainly a yes/no question, I feel like conclusion like "a single well-constructed demonstration" is sufficient is a bit thin.
- Missing figure and section references in multiple places (currently shows ??).
Questions for authors
I have concern over semantic information conveyed in the paired prompts. For example, in figure2, for demonstration, the pair shows full sentences in their respective language. However, for instruction, only the word "English" or "German" differs. Thus it feels like both what the task is demanding and semantic richness differ in demonstration versus instruction, thus confounding the setup.