- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper comprehensively studies the complex balance needed to generate medically cautious and relevant responses while avoiding unnecessarily alarmist language. It explicitly distinguishes between appropriate emergency referral and unsupported catastrophizing, and examines the problem under six different language settings and with numerous LLM families. Native-speaker judgements and clinician assessments are incorporated into the evaluation. Key contributions include a new benchmark with 1000 paired two-turn scenarios in six languages and the Context-Aware Layered Mediation (CALM) framework for addressing the overarching problem through separation of context assessment, response drafting, and safety review; an additional contribution to support this is the development of a semantic alarmism score evaluated under a variety of settings.
Critical strengths
This paper tackles a really interesting problem that is quite relevant to contemporary life---like it or not, people are using LLMs to answer their medical questions, and the way that the LLMs respond can be unnecessarily anxiety-inducing, as demonstrated by the examples in the paper. Having approaches to address this and mitigate the extent to which the LLM introduces more anxiety to the situation is likely to be very helpful in real-world settings.
The paper also evaluates the proposed framework under six different languages, which importantly suggests that it may apply well across a wide variety of language settings. The related work section is thorough and nicely situates the work in the broader research landscape, and the experiments are very comprehensive.
Critical weaknesses
This paper is (in my opinion!) mostly ready to accept, with a few fixable weaknesses. One is that it isn't particularly clear why it is so important that the cross-lingual differences are treated as behavioral variation rather than culturally contextualized. It's clearly important to the authors because it's mentioned numerous times, so conveying the justification more effectively to the readers could ensure that the point comes across clearly to them too.
Most of the other weaknesses relate to the description of the source data and annotation process. It isn't really clear from the main text if the annotated data is human-AI conversations or human-human conversations (perhaps a mix of both, with the Reddit data being human-human conversations, unless these are limited to conversations between Reddit users and Reddit bots?). More annotator details would also be helpful (e.g., background level, compensation if any, etc.). The multilingual construction process also receives limited attention in the paper, despite being pretty central to the overall evaluation and resulting claims. Specifically, what did the rewriting process look like, what constraints were the writers given, what type of background did the rewriters have, and what did the validation for this process look like?
STAI-S6 and GAD-7 should also be described, at least briefly, because it's likely that there may be quite a few ICLR readers who are unfamiliar with these measures. Recruitment details for the human study would also be useful; it's quite impressive that 60 native speakers per language were recruited but it'd be useful to have some more details about who the speakers were (e.g., university students? Or was this done on a crowdsourcing platform?). Finally, the paper mentions that data was annotated using overlapping assignments to permit calculation of inter-rater agreement, but inter-rater agreement doesn't seem to be reported anywhere.
Questions for authors
This doesn't really materially affect my assessment, but Appendix B (Table 9) lists keywords identified as high-anxiety markers in the evaluated languages. Although I'm not fluent in all six, I noticed that they mostly appear to overlap a lot across languages. How were these keywords determined, and how are they used in the framework?