- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper considers the evolving of support priorities in empathetic conversation, and focuses on the issue form rubric evolution. For this purpose, this paper proposes CARE, a context-adaptive rubric evolution benchmark. CARE trains a context-conditioned rubric generator by adjusting both the weights of these three empathy dimensions (cognitive, affective, and proactive empathy) and their fine-grained evaluation criteria. Moreover, CARE serves as an adaptive reward interface for online empathetic support conversation based on reinforcement learning. This paper proves the advantages of CARE integrated with both RLVER (CARE-R) and MICA (CARE-M) across three LLMs.
Critical strengths
- The CARE benchmark proposed in this paper encompasses the construction of the Principle of Evolving Support Priorities dataset, as well as the training and application of the context-adaptive rubric generator. It took into account the three dimensions of cognition, affectivity, and proactivity, as well as the application of reinforcement learning technology.
- This paper conducted numerous experiments, not only confirming the advantages of CARE, but also conducting various analyses and presenting meaningful results.
Critical weaknesses
- Although this paper has innovative techniques in solving problems, overall, considering the dynamic changes of emotional support strategies is not a completely novel research topic.
- This paper can be further improved in terms of its organizational structure and content presentation (See Questions For Authors).
Questions for authors
- Line 096, what are CARE(R) and CARE(M)? Looking at the content of this article, before this line, only line 094 had "RLVER-based CARE(R)". So what about CARE(M)? In particular, the CARE(R) and CARE(M) are used to providing explanations for Figures 1(b), it is even more perplexing. After reading the entire text, it was discovered that this explanation was not provided until lines 311-312. Obviously, such a structure is not conducive to reading.
- For Formula 1, it is necessary to provide a further explanation on how Rt corresponds to the three-dimensional evaluation criterion, especially why only its weight is changed. Although there are example prompts in the appendix, it is still necessary to clarify the principle here. This includes the evaluation methods for each dimension, the selection of priorities, etc., which will also facilitate the understanding of the subsequent Formula 3, Formula 4, and Section 3.3 content.
- In the experimental results presented in Table 1, the results of RLVER seem to be inferior to those of MICA. And CARE(R) is based on RLVER, while CARE(M) is based on MICA. Then why is CARE((R)) superior to CARE(M)?
- The content from line 261 to 302 is intended by the authors to highlight the main contributions of this paper. However, in fact, some of the content here is repetitive with that in the subsequent pages, and it is unnecessary. Moreover, generally speaking, the experimental part should start by introducing the experimental setup (i.e. Section 4.1 in this paper).
Rebuttal by Authors — Reviewer x1RU
We appreciate the reviewer's positive assessment of CARE's evolving support-priority formulation and its strong experimental validation. We clarify the methodology and address your suggestions below.
[Q1] Although this paper has innovative techniques in solving problems, overall, considering the dynamic changes of emotional support strategies is not a completely novel research topic.
[A1] Existing methods on dynamic support strategies adapt the strategy of the policy, while the reward criteria used to optimize them remain predefined:
In contrast, CARE generates both the weights over the three empathy dimensions and the fine-grained evaluation criteria at each turn, so that the reward specification itself evolves with the dialogue state. New controls test this distinction: we either fix a learned, context-dependent rubric for the whole dialogue, or keep per-turn regeneration but permute the dimension weights across contexts (SentientBench, DeepSeek-V4-Pro judge; §4.3, Table 3):
Most of the improvement is lost once the reward specification stops following the dialogue state.
Revisions: The fixed-rubric and shuffled-weight controls are added to Table 3 (L343–353) and discussed in Section 4.3 (L406–411).
[Q2] CARE(R) and CARE(M) are not clearly defined at their first mention (Lines 096–097), making their use in Figure 1(b) confusing.
[A2] Thank you for pointing this out. CARE(R) denotes the dynamic reward of CARE integrated into the RLVER training framework, and CARE(M) denotes the same reward integrated into the MICA training framework.
Revisions: CARE(R) and CARE(M) are defined in Section 1 (L91–94), and the caption of Figure 1 clarifies that CARE (Ours) denotes CARE(R) (L75–76).
[Q3] How is Rt derived from the three empathy dimensions in Eq. (1)? Clarify how each dimension is evaluated, how priorities are determined, and why only the dimension weights are adjusted.
[A3] We clarify the principle here:
Revisions: The clarification is added after Eq. (1) in Section 3.1 (L191–195).
[Q4] In the experimental results presented in Table 1, the results of RLVER seem to be inferior to those of MICA. And CARE(R) is based on RLVER, while CARE(M) is based on MICA. Then why is CARE(R) superior to CARE(M)?
[A4] RLVER and MICA differ in both reward design and training data. CARE(R) and CARE(M) keep the original training data but replace the reward entirely with that of CARE, which removes the difference in reward design. The remaining difference is the data: RLVER simulates users whose hidden support needs surface gradually and whose emotions respond to every turn, which is exactly where a turn-adaptive reward helps most. This explains why CARE(R) outperforms CARE(M), although RLVER trails MICA under its original reward.
[Q5] Lines 261–302 contain repetitive content.
[A5] Thank you for the suggestion. We have removed this duplicated overview, and Section 4 now begins directly with the Experimental Setup (§4.1).
Revisions: Section 4 now begins directly with the Experimental Setup (Section 4.1, L263–265).