- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper studies the support–strategy grounding gap: an emotional support system may select an inappropriate strategy or fail to faithfully execute an appropriate one. GroundESC combines structured supervised fine-tuning with GRPO, using rewards for format compliance, strategy admissibility, strategy execution, and response quality. Its execution reward measures the increase in a frozen observer’s likelihood of the declared Strategy Line after observing the response. An information-theoretic analysis motivates this design. Experiments cover four backbones, SSConv evaluation, transfer to ESConv, reward ablations, and human validation.
Critical strengths
-
A useful decomposition supported by targeted ablations. The paper distinguishes selecting a suitable strategy from actually realizing its intended function, and trains these components separately. Table 2 shows that selection rewards mainly improve admissibility, while the execution reward provides additional fidelity gains, supporting the practical value of this decomposition.
-
Human evidence strengthens the empirical contribution. Adding the execution reward increases human-rated fidelity with little change in admissibility, providing meaningful evidence that it improves execution rather than merely strategy selection.
Critical weaknesses
-
The novelity of this paper seems to be limited. SFT-RL is a standard post-training pipeline for the development of instruct-format dialogue models, which has been widely investigated since instructGPT. This work applies this solution to a domain-specific problem: emotional spport conversation, with scenario-related implementations for GRPO and rewards. However, there is no critical innovation for the methods, or no significant observations for the problem.
-
There is no clear connection between the theoretical part and the experimental part.
-
The baseline is too weak. The propose approach is a two-stage tranining method, which has large computational cost. However, most of the baselines are prompting methods. How about the performance of some existed finetuning baselines? For example, GRPO (if the author believes there is some innovation compared to the original method), PPO, DPO, etc.
-
The training dataset has a limited distribution. Only SSConv is used to train the model, which is a pure-simulated corpus (by GPT-4).
-
Typos. For exmaple, the citatons on top of Table 1 and on Line 353 lack of parenthesis.
Questions for authors
-
Highlight the innovations compared to the standard SFT-GRPO pipeline.
-
Clarification of the theoretical contribution.
-
Add the finetuning baselines.
-
Consider adding more training datasets.