- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper post-trains Fun-Audio-Chat-8B using continued SFT followed by GRPO with a history-aware rubric reward. It aims to improve persona expression, multi-turn conversational quality, and emotional responsiveness in spoken role-play, with evaluations across T2T, S2T, and S2S settings.
Critical strengths
The paper addresses a practically relevant problem and evaluates multiple input/output modalities, with training-stage comparisons, reward ablations, and some human evaluation.
Critical weaknesses
- The motivation and incremental contribution relative to existing work are insufficiently established. Figure 1 illustrates the targeted problems but does not quantify their prevalence in competitive existing systems. PersonaPlex already studies role-controlled full-duplex speech interaction and evaluates role adherence and dialogue naturalness. The submission does not clearly establish the capability gap relative to such systems or provide direct comparisons supporting advantages in persona expression or emotional responsiveness. Consequently, the empirical gap motivating this work remains insufficiently established.
- The methodological contribution is primarily a training recipe, and the distinctive effects of its key designs are not isolated. The approach combines an existing backbone, standard cSFT/GRPO, and a manually weighted rubric reward. Training-stage comparisons and component-removal ablations indicate that some components are useful, but do not isolate the reward model’s access to full dialogue history or compare against a simpler holistic quality reward under matched data and training budgets. It therefore remains unclear how much of the improvement comes from the emphasized history-aware design rather than additional training and stronger quality supervision.
- Conversational progress across turns lacks direct validation. EN primarily measures natural persona expression, while CA combines multiple dimensions. The paper does not directly assess redundant repetition, uptake of user corrections, or response updates following new information. Improvements in aggregate scores therefore do not establish substantive conversational progress.
- Joint adaptation to vocal affect and persona lacks direct evidence. Persona consistency and empathy are primarily evaluated separately, without establishing whether the same response appropriately uses vocal emotional cues while preserving the assigned character. Removing the persona-consistency reward actually increases empathy in Table 12, further highlighting why separate scores cannot establish the joint objective.
- The evaluation lacks sufficient independent validation. Training rewards and persona evaluation use the same LLM judge, leaving open the possibility of adaptation to judge-specific preferences. Human evaluation only supports improved EN agreement, without validating other metrics, as well as conversational progress or joint adaptation to vocal affect and persona. The number of raters, blinding procedure, and inter-rater agreement are also insufficiently documented.
Questions for authors
When transferring this pipeline to another speech foundation model, which data-construction and reward components can be reused directly, and which depend on Fun-Audio-Chat’s model interfaces?