- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies empathetic response generation and argues that prior methods improve user-state understanding but do not specify how affective and cognitive support should be composed in a response. Its main contributions are:
-
A continuous formulation of context-adaptive support coordination, explicitly modeling the response-level affective–cognitive support composition via a weight w ∈ (0,1).
-
The ACC-ERG framework, comprising two frozen specialized experts (an affective expert trained on EmpatheticDialogues and a two-stage cognitive expert trained on KardiaBench), a Proportion Gate that predicts the support weight, and a Fusion Bridge that fuses the two expert representations under that weight for response generation.
-
The ACC-ERG dataset (4,998 instances derived from EmpatheticDialogues and KardiaBench), with GPT-4o-mini-assisted, human-reviewed annotations of the support weight, support intensity, and speech act, plus weight-aligned reference responses.
-
Experimental evidence that ACC-ERG improves BLEU/Distinct over strong baselines on both ACC-ERG and EmpatheticDialogues, predicts support weights well (MAE 0.108, Spearman 0.780), and that intervening on the weight controllably shifts the affective vs. cognitive emphasis of generated responses.
Critical strengths
-
This paper proposes manually annotated affective and cognitive weights, providing room for further optimization in subsequent work.
-
A framework for explicitly modeling these weights is proposed.
Critical weaknesses
- The experimental comparisons in this paper involve certain unfair experimental settings, which require further clarification and discussion.
- Regarding the manual annotation, the inter-annotator agreement and the related evaluation criteria were not reported.
Questions for authors
-
When training the cognitive expert and the affective expert, the full datasets—larger than the core dataset ACC-ERG proposed in this paper—were used (the 36,629 complete ED samples mentioned in Appendix C.1, and the 19,533 dialogues mentioned in Yuan et al., 2026). However, when comparing with the baselines, only the core dataset ACC-ERG was used rather than directly using the two merged original datasets, which results in different amounts of data being exposed to the baselines.
-
Generally speaking, gold emotion labels are unavailable at test time. During the training of the affective and cognitive experts, the inputs both incorporate the emotional state; however, at inference time, such emotion labels are inaccessible. Theoretically, this gives rise to a severe discrepancy between training and inference, yet this issue is not addressed or explained in this paper.
-
The method proposed in this paper aims to explicitly model the affective and cognitive aspects; however, it does not provide a targeted evaluation of the generation results after ablating either of the two components (e.g., whether ablating the affective expert genuinely impairs the affective capability, especially the human evaluation).
-
The pre-annotation employed GPT-4o-mini, a model more capable than GPT-3.5-turbo which was released in 2022. This raises a natural question: if compared directly against GPT-4o-mini, would the proposed method still retain an advantage, particularly under one-shot or few-shot settings?
-
During the annotation of the dataset proposed in this paper, human annotators provided corrections; however, the paper reports neither agreement-related metrics nor a reasonably feasible scoring rubric(there are no per-level anchor definitions or worked examples), which undermines the reproducibility of this work.
8 comments
Response to Q3
Q3: The paper lacks targeted human evaluation to verify whether removing each expert affects its corresponding support capability.
A3: We thank the reviewer for this suggestion. To address this concern, we conducted an additional human evaluation of the expert ablations.
(1) Human evaluation setup.
We selected 200 test samples and recruited five independent evaluators to conduct pairwise comparisons between the full ACC-ERG model and variants without the affective or cognitive expert. The generated responses were evaluated on three aspects: Affective Support (Aff.), Cognitive Support (Cog.), and Appropriateness (App.). We report the win, tie, and loss rates of the full model against each ablated variant.
(2) Results and analysis.
As shown in Table A3, compared with the model without the affective expert, ACC-ERG achieves a 62.5% win rate in affective support, compared with 45.2% in cognitive support. Conversely, when the cognitive expert is removed, the full model achieves a 64.3% win rate in cognitive support, compared with 44.1% in affective support.
The full model also achieves appropriateness win rates of 59.6% and 60.8% against the variants without the affective and cognitive experts, respectively.
These results indicate that removing the affective expert has a greater impact on affective support, while removing the cognitive expert has a greater impact on cognitive support. This pattern is consistent with the intended functional specialization of the two experts and shows that both contribute to response appropriateness.
Table A3: Human evaluation of expert ablations. Win/Tie/Lose indicate the preference rates of the full ACC-ERG model over the corresponding ablated variant.
| Comparison | Aspect | Win (%) | Tie (%) | Lose (%) |
|---|---|---|---|---|
| vs. w/o Affective Expert | Aff. | 62.5 | 24.2 | 13.3 |
| Cog. | 45.2 | 38.3 | 16.5 | |
| App. | 59.6 | 26.5 | 13.9 | |
| vs. w/o Cognitive Expert | Aff. | 44.1 | 40.0 | 15.9 |
| Cog. | 64.3 | 21.6 | 14.1 | |
| App. | 60.8 | 24.2 | 15.0 |
We will include these human evaluation results and the corresponding analysis in the revised manuscript to provide more direct evidence of the experts' differentiated contributions.
Response to Q2
Q2: The use of gold emotion labels during expert training may introduce a discrepancy between training and inference, and the paper does not clarify how emotions are inferred at test time.
A2: We thank the reviewer for raising this concern. We agree that gold emotion labels are generally unavailable in real-world empathetic response generation. We therefore clarify how emotional information is modeled and used at different stages of ACC-ERG.
(1) Emotion understanding at test time.
At test time, ACC-ERG does not use a separate emotion classifier or require gold emotion labels. As described in Section 3 and illustrated in Figure 2, the model directly takes the situation, dialogue history, and current user utterance as input. The affective and cognitive experts encode the dialogue context and extract emotion-related representations using the parameters learned through pretraining and fine-tuning. These representations are then used for support-priority prediction and empathetic response generation.
Thus, ACC-ERG models emotional information implicitly through contextual representations, rather than relying on externally provided emotion labels at test time.
(2) Distinction between emotion understanding and support coordination.
We would like to emphasize that our primary goal is not to explicitly predict emotion categories, but to coordinate affective and cognitive support in generated responses based on the user's emotional state and situation.
During expert training, emotion labels are used as additional contextual information to help the experts learn relationships between emotional states, situations, intentions, and potential causes. Specifically, the affective expert focuses on emotion understanding and affective support, while the cognitive expert focuses on situational understanding, reasoning about potential causes, and cognitive support.
During response generation, the Proportion Gate predicts the relative priority of affective and cognitive support from the dialogue context, and the Fusion Bridge coordinates the two expert representations accordingly. The central objective is to adapt the support emphasis to the user's current needs, rather than treating emotion classification as a prerequisite for response generation.
Response to Q1
Dear Reviewer fBmD,
We greatly appreciate your hard work during the review process. Thank you very much for your valuable questions. We will address your concerns one by one to clarify any confusion.
Q1: The use of additional training data for the two experts creates an unfair comparison with baselines trained only on the ACC-ERG dataset.
A1: We thank the reviewer for pointing out the difference in training data exposure between ACC-ERG and the baselines. In the original setting, the two experts were trained on the full EmpatheticDialogues and KardiaBench datasets, while some baselines were trained only on ACC-ERG. To address this concern, we conducted a new experiment with controlled training data.
(1) Data-controlled training setup.
We introduced ACC-ERG (Data-Controlled), in which all training stages are restricted to the ACC-ERG training split, without using extra datasets for additional expert training. To preserve functional specialization, the affective and cognitive experts are trained separately on samples with clear affective-support and cognitive-support tendencies, respectively. The Proportion Gate and Fusion Bridge are then trained using the same ACC-ERG training split. This setting removes the additional exposure to the original datasets and provides a more comparable evaluation against baselines trained on ACC-ERG.
(2) Experimental results.
As shown in Table A1, ACC-ERG (Data-Controlled) achieves BLEU-1/2/3/4 scores of 47.51/33.80/26.45/21.38, remaining better than the main baselines reported in the original submission. Although some generation metrics and support-priority correlations decrease slightly, the data-controlled variant maintains strong overall performance. These results suggest that additional experts training data are beneficial but do not fully account for the performance gains of ACC-ERG.
Table A1: Performance comparison with baselines.
We will include the data-controlled experiment in the revised manuscript and clearly distinguish the training settings of the original ACC-ERG and ACC-ERG (Data-Controlled). We will also report their performance under both settings to make the comparisons and the contribution of additional training data more transparent.