- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper investigates internal components involved in empathic response generation and their relationship to distress representation. It identifies Supportive Empathic Response (SER) neurons using a difference-in-differences contrast between matched supportive and neutral responses in distress and non-distress contexts. The selected FFN populations are frozen before held-out and downstream evaluation. Across four model families, independent empathy and support-strategy datasets, a factorial response experiment, and activation interventions provide evidence that SER contributes to affective empathic expression. Suppression and amplification produce consistent directional changes in expressed-empathy scores and support-strategy composition, with generally smaller changes in broader capabilities.
Critical strengths
- A coherent chain from localization to independent validation: The DiD construction addresses input-side distress sensitivity and generic supportive language. Freezing the selected populations before held-out testing and evaluation on EPITOME and ESConv provides evidence beyond the discovery contrast itself.
- Consistent bidirectional intervention evidence: Suppression and amplification change expressed empathy and support-strategy composition in consistent directions across four model families. Matched neuron controls and broader capability evaluations strengthen the case that SER contributes to response generation, rather than merely correlating with supportive text.
Critical weaknesses
- Semantic validation of the generated conditions remains limited: The authors provide construction prompts, surface-form constraints, and rule-based checks, and acknowledge construct-validity limitations. However, Appendix C.4 reports exporting 100 response quadruplets for human inspection without reporting annotation outcomes. Independent checks of whether responses satisfy the intended conditions would strengthen the empathy-versus-support interpretation, especially given differences in how reassurance is grouped across experiments. This limits precise functional attribution, although independent-dataset results provide complementary evidence.
- The understanding–expression dissociation is supported indirectly: Distress-related controls and broader emotion benchmarks provide useful selectivity evidence, and the authors appropriately claim only partial dissociation. Nevertheless, the experiments do not directly establish preserved understanding of the same users’ distress under SER suppression. The causal evidence is stronger for modulation of expressed empathy than for preserved distress understanding; this distinction should remain explicit.
Questions for authors
- Was the human inspection described in Appendix C.4 completed? If so, what proportion of responses satisfied the intended factors, and how was this assessed? How should readers reconcile the treatment of reassurance across the discovery, factorial, and ESConv analyses?
- Is there existing evidence that distress understanding remains intact under SER suppression on the same contexts where expression changes? If not, could the discussion distinguish the indirect evidence for partial dissociation from the directly demonstrated effect on expression?
3 comments
- Distress understanding when expression changes
We agree that a change in empathic expression does not by itself establish that distress understanding remains intact. The original full-prefill intervention acts during both prompt processing and response generation, so it cannot alone demonstrate unchanged prompt-side recognition.
To address this issue, we added a strict decode-only experiment on the same 1,200 source-disjoint EmpatheticDialogues inputs. The prompt is processed without SER scaling and its KV cache is retained; SER scaling is installed only immediately before response-token generation. Consequently, the binary distress-recognition and four-choice emotion-recognition readouts use exactly the unmodified prompt computation. Under both SER=0 and SER=2, both recognition readouts match baseline on every input, yielding 1,200/1,200 exact matches for each readout.
At the same time, expressed empathy changes in the expected bidirectional direction. The ER changes at SER=0 and SER=2 are as follows:
| Model | ER Change (SER=0) | ER Change (SER=2) |
|---|---|---|
| Qwen | -0.1595 | +0.1030 |
| OLMo | -0.0654 | +0.0489 |
| Mistral | -0.0868 | +0.0465 |
| ChatGLM | -0.1144 | +0.1070 |
All ER changes are based on 5,000 paired bootstrap replicates, and all corresponding 95% bootstrap intervals for ER exclude zero. This experiment directly demonstrates that SER can causally alter empathic expression while the prompt-side recognition computation is held fixed.
We note that decode-only isolates a generation-side expression effect but does not establish unchanged latent distress representations under full-prefill ablation. Full-prefill recognition equivalence is model- and dose-dependent: all models meet the criterion at SER=0.5; at SER=0, Qwen, OLMo, and ChatGLM do so, whereas Mistral does not. We therefore claim partial functional dissociation with interdependence, rather than complete representational independence.
We thank the reviewer again for the constructive feedback, which prompted these clarifications. In the revision, we will report the averaged human-audit results, distinguish the operational uses of reassurance across the three experiments, cite the corresponding appendix tables, and state the recognition--expression conclusion with the qualification above. We hope these clarifications address the reviewer’s concerns.
Thank you for the detailed response and the additional validation and experiments. These largely address my concerns, and I maintain my rating of 3: Weak acceptance.
Response to Reviewer NvZP
We sincerely thank the reviewer for the careful reading and for raising two important concerns: the semantic validity of the factorial controls and the distinction between changing empathic expression and preserving distress understanding. We address both points below and have narrowed our claims accordingly.
The human inspection described in Appendix C.4 was completed on the original seed-42 factorial sample, which contains 100 response quadruplets and 400 individual replies. Four independent annotations were collected for the same 400 replies. To keep the presentation concise, we report the averages across these four annotations:
The reply-level conformity rate measures whether an individual response contains the intended empathy/support factors. Whole-quadruplet conformity is stricter and requires all four responses in a quadruplet to satisfy their intended factors. The difference between these two measures is expected: a quadruplet fails the stricter criterion if any one of its four responses contains an unintended factor.
Although these four conditions are not completely semantically pure, they generally retain the original content and language quality. The averages above are computed from four independent annotations of the same 400 replies. They are not rates over 1,600 independent responses and do not represent an adjudicated consensus.
The different treatment of reassurance reflects the operational purpose of each experiment. The discovery contrast uses a broad supportive--neutral distinction that includes emotional acknowledgment, validation, reassurance, and interpersonal support. We retain the label “support” for the factorial conditions to remain consistent with the original protocol. Operationally, however, this factor represents additional supportive content, including reassurance and guidance, whereas the empathy factor denotes explicit empathic acknowledgment. ESConv retains its native strategy labels, under which Affirmation/Reassurance is grouped with affective support. These are distinct operational contrasts rather than a single universal taxonomy. We will clarify this distinction in the main text and Appendix C.4.