- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper tests whether users expressing values during conversation can influence language model's subsequent choices. The authors find that the effects vary depending on the value dimension, conversation design, and evaluation method. This was tested with scripted conversation with forced-choice dillemas and value questionnaires. Also conducted activation steering experiments to find whether directly modifying value-related activations change the models' choices.
Critical strengths
None
Critical weaknesses
-
The key idea this paper suggests seems to be already studied in sycophancy with just a different settings. Plus this circumstance feels like a bit artificial.
-
The paper tested three models which seems like a very small numbers for this kind of experiments. Nevertheless, even the limited models were not tested in the full experiment.
Questions for authors
Please answer for critical weaknesses.