acceptodds
Under review as a conference paper at ICLR 2027

Keep CALM: Mitigating Anxiety-Inducing Language in Multilingual Agents

Abstract

Conversational agents routinely handle health-related and emotionally sensitive queries, yet standard safety protocols can produce medically cautious responses with unnecessarily alarmist language. We study this failure mode across six languages and seven Large Language Models using paired two-turn scenarios that separate clinical content from emotional escalation. We define anxiety-inducing language as threat, urgency, or worst-case framing whose intensity is disproportionate to the clinically justified risk, and evaluate it through three complementary sources: native-speaker judgments, clinician assessments of clinical appropriateness and urgency, and automatic lexical and semantic measures validated against these judgments. This design explicitly distinguishes appropriate emergency referral from unsupported catastrophising and treats cross-lingual differences as behavioural variation, without attributing them to cultural causes. We then introduce (Context-Aware Layered Mediation), a training-free three-stage framework that separates emotional assessment, response drafting, and safety review. Across multiple backbone models, reduces human-rated alarmism and state-anxiety change while preserving clinical correctness and emergency-referral sensitivity. Our validation further shows that lexical metrics provide an interpretable but incomplete signal, whereas semantic scoring aligns more closely with human and clinician judgments. These findings indicate that emotional restraint and clinical caution can be jointly optimised in multilingual health interactions.

Primary area:
alignment, fairness, safety, privacy, and societal considerations
Keywords:
multilingual llms, safety protection

Reviews

Among:
Shape:
1234this paper, Top 30%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.67 over 3 reviews, above 70% of the others.
Reviewer_sQbbOpenReview ↗
Rating
3
Confidence
3
Informativeness
3
Presentation
3
Soundness
2
Read review
Paper summary

This paper comprehensively studies the complex balance needed to generate medically cautious and relevant responses while avoiding unnecessarily alarmist language. It explicitly distinguishes between appropriate emergency referral and unsupported catastrophizing, and examines the problem under six different language settings and with numerous LLM families. Native-speaker judgements and clinician assessments are incorporated into the evaluation. Key contributions include a new benchmark with 1000 paired two-turn scenarios in six languages and the Context-Aware Layered Mediation (CALM) framework for addressing the overarching problem through separation of context assessment, response drafting, and safety review; an additional contribution to support this is the development of a semantic alarmism score evaluated under a variety of settings.

Critical strengths

This paper tackles a really interesting problem that is quite relevant to contemporary life---like it or not, people are using LLMs to answer their medical questions, and the way that the LLMs respond can be unnecessarily anxiety-inducing, as demonstrated by the examples in the paper. Having approaches to address this and mitigate the extent to which the LLM introduces more anxiety to the situation is likely to be very helpful in real-world settings.

The paper also evaluates the proposed framework under six different languages, which importantly suggests that it may apply well across a wide variety of language settings. The related work section is thorough and nicely situates the work in the broader research landscape, and the experiments are very comprehensive.

Critical weaknesses

This paper is (in my opinion!) mostly ready to accept, with a few fixable weaknesses. One is that it isn't particularly clear why it is so important that the cross-lingual differences are treated as behavioral variation rather than culturally contextualized. It's clearly important to the authors because it's mentioned numerous times, so conveying the justification more effectively to the readers could ensure that the point comes across clearly to them too.

Most of the other weaknesses relate to the description of the source data and annotation process. It isn't really clear from the main text if the annotated data is human-AI conversations or human-human conversations (perhaps a mix of both, with the Reddit data being human-human conversations, unless these are limited to conversations between Reddit users and Reddit bots?). More annotator details would also be helpful (e.g., background level, compensation if any, etc.). The multilingual construction process also receives limited attention in the paper, despite being pretty central to the overall evaluation and resulting claims. Specifically, what did the rewriting process look like, what constraints were the writers given, what type of background did the rewriters have, and what did the validation for this process look like?

STAI-S6 and GAD-7 should also be described, at least briefly, because it's likely that there may be quite a few ICLR readers who are unfamiliar with these measures. Recruitment details for the human study would also be useful; it's quite impressive that 60 native speakers per language were recruited but it'd be useful to have some more details about who the speakers were (e.g., university students? Or was this done on a crowdsourcing platform?). Finally, the paper mentions that data was annotated using overlapping assignments to permit calculation of inter-rater agreement, but inter-rater agreement doesn't seem to be reported anywhere.

Questions for authors

This doesn't really materially affect my assessment, but Appendix B (Table 9) lists keywords identified as high-anxiety markers in the evaluated languages. Although I'm not fluent in all six, I noticed that they mostly appear to overlap a lot across languages. How were these keywords determined, and how are they used in the framework?

Reviewer_3n6UOpenReview ↗
Rating
2
Confidence
4
Informativeness
2
Presentation
2
Soundness
1
Read review
Paper summary

This paper investigates whether language models respond to users’ anxiety with unnecessarily alarming language, distinguishing communication alarmism from clinically appropriate urgency. It introduces a benchmark of 1,000 scenarios across six languages, with neutral and emotionally escalated continuations intended to preserve the same clinical facts. The paper evaluates seven model families and proposes CALM, a training-free pipeline separating context assessment, response drafting, and safety review.

The reported validation involves 360 native speakers, 18 clinical experts, lexical measures, and a learned semantic alarmism score. Across four backbones, the authors report reductions in clinician-rated alarmism and response-related state-anxiety increases, alongside approximately stable emergency-referral recall. However, inconsistencies between the main text and appendices, including an explicit reference to simulated results, prevent me from treating these findings as established.

Critical strengths

The paper identifies a meaningful distinction between clinical caution and unnecessary alarmism. A response can recommend appropriate care while introducing unsupported diagnoses or disproportionate threat framing. Evaluating these dimensions separately could improve health-related language-model assessment, particularly where keyword-based measures would penalise necessary emergency language.

The proposed evaluation combines complementary perspectives. Native-speaker judgments, clinician assessments, and immediate state-anxiety measurements could establish whether an apparent improvement in tone is perceptible to readers and compatible with appropriate clinical action. The inclusion of red-flag scenarios and native-expression controls is particularly valuable in principle. These strengths concern the evaluation design; their empirical support depends on resolving the reporting problems.

Critical weaknesses

The supplied implementation and analyses do not establish the claimed preservation of clinical safety. Section 5 describes an assessor that evaluates clinical urgency and a reviewer explicitly prohibited from weakening emergency instructions. Appendix D, described as containing the complete templates, instead focuses on emotional-state identification, reassurance, professional detachment, and removal of emotional contagion. The English template contains neither the stated structured urgency assessment nor explicit checks for false reassurance and emergency preservation. It is therefore unclear whether the evaluated intervention implements the method described.

Approximately unchanged point estimates of emergency-referral recall do not establish non-degradation without uncertainty estimates and a justified margin for an acceptable difference. Moreover, Appendix E.2 presents CALM’s assurances about the effectiveness and testing of an unspecified vaccine as a successful response, although the displayed prompt identifies neither the disease nor the vaccine. As presented, this example illustrates the unresolved possibility that calmer language can introduce unsupported reassurance. This directly affects the paper’s central claim of reducing alarmism while preserving clinical correctness.

Questions for authors

Which results, if any, are simulated? Please reconcile the caption of Table 20 with the corresponding main-text results and identify which tables derive entirely from completed human and clinician assessments. If the caption is an editorial remnant, please explain its origin and provide sufficient anonymised analysis outputs and sample counts to verify the reported findings.

Were the Appendix D templates actually used in the reported experiments? If additional instructions implemented urgency assessment, false-reassurance detection, and emergency preservation, please provide them, together with the information passed between stages. Please also clarify whether Appendix E includes the complete conversation context needed to evaluate its examples.

What are the denominators and confidence intervals for the baseline–CALM differences in emergency-referral recall, false reassurance, and clinical correctness? Do these results exclude a clinically meaningful deterioration, rather than merely showing similar point estimates?

What is the direct matched comparison between neutral and emotionally escalated second turns? Equation 2 compares the first and second responses, which does not itself isolate emotional framing from other conversational changes. Please explain how the neutral branch enters the main analysis and reconcile the factual-equivalence requirement with the persistence and medication-related wording in Appendix C.

Please specify the semantic scorer’s architecture, annotation counts, train/development/test allocation, input context, and AUROC target. For the human study, please also provide the allocation of the 2,160 exposures across models and conditions, STAI-S6 scoring procedure, and handling of presentation order and possible carryover.

Reviewer_PxVaOpenReview ↗
Rating
3
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

This paper addresses an important problem of medical QA where responses need to be correct and also not unnecessarily induce anxiety. They test this setting across 6 different languages. The specifically task is two turn interactions where "anxiety inducing" is threat, urgency, or worst-case framing that exceeds what clinical evidence supports. They present a multilingual benchmark, human and clinician validation, automatic metrics (lexical and semantic). Finally, they present CALM, a training-free three-stage framework, that reduces alarmism while preserving clinical correctness and show quantitative improvement.

Critical strengths

The problem formulation is clear.

I'm impressed with the human evaluations and multiple languages the most of this paper.

The two turn design is strong and interesting.

CALM is well motivated. The process makes sense.

Critical weaknesses
  1. The paper states scenarios come from ChatDoctor-HealthCareMagic-100k and a Reddit mental-health corpus. De-identification is claimed, but no details on source filtering, date ranges, or how scenarios were selected for balance between physical/psychological contexts. The 1,000 scenarios across 6 languages (≈167 per language) seems small for claims about cross-lingual behavioral variation. How were scenarios selected for the red-flag subset (180 cases)? By which clinicians?

  2. Missing details on human evaluation: Human study design (Section 3.4). 360 participants (60/language) rated 6 randomised vignette-response pairs under a balanced incomplete-block design (2,160 exposures). The STAI-S6 administered before and after each response is strong, but:

  • Were participants screened for health anxiety or relevant lived experience? The GAD-7 as baseline covariate is mentioned but results treated as "exploratory."
  • The paper doesn't report participant demographics beyond language. Regional, socioeconomic, or clinical background could affect sensitivity to health communication.
  • With only 6 exposures per participant, learning effects or fatigue are possible.
  • I am happy with the 18 clinicians (3/language) rated subsets, but it doesn't seem clear. Three per language seems very thin for cross-lingual claims. How were clinicians selected (specialty, years of practice, language proficiency)? Inter-rater agreement (ICC=.82-.88) is strong, but with only ~3 raters/language, estimates of agreement are imprecise.
  1. The lexical metrics (CLI, AAR, DSR) are have well-known limitations.

  2. CALM adds inference cost (three API calls per response instead of one). The paper doesn't quantify this cost or discuss latency implications for health-chat applications where speed matters.

  3. Missing Comparisons:

  • How does CALM compare to explicit system prompts about calm communication (beyond the single calmness-prompt ablation)?
  • No comparison to fine-tuned health-chat models (e.g., Med-PaLM, HuatuoGPT). The paper says CALM is "training-free," which is a feature, but strong fine-tuned health models may outperform CALM on both alarmism and correctness.
  • No comparison to existing safety interventions (refusal policies, escalation protocols, toxicity filters).
Questions for authors
  • How was SAS trained?
  • What do failures look like? Are there scenarios where CALM over-corrects toward insufficient urgency? The paper says false reassurance stays at ~3.6% (Table 6), but are there case studies where CALM suppressed appropriate escalation?
  • How confident are you that CALM generalizes to languages with very different grammatical structures or health-communication norms?

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.