- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Dualistic Self-Evolution (DSE), a framework for developing transferable LLM-based sales agents by separating general sales skills learned in model parameters from business-specific knowledge, rules, and tools maintained in an external harness. The framework consists of two independent optimization loops: an inner loop that trains sales agents through supervised fine-tuning and reinforcement learning using a novel Human Nature as Reward (HNR) mechanism, which combines turn-level feedback, sales outcomes, and credibility constraints; and an outer loop that continuously improves the business harness through reward-guided modifications and real-conversation replay. Experiments on a production used-car sales platform and additional business domains demonstrate improved response quality, tool usage, and cross-domain persuasion. In particular, the trained 9B model achieves an 8.3-percentage-point improvement in strict response quality over its base model. The results suggest that separating transferable agent capabilities from domain-specific knowledge can improve adaptability while reducing the need for repeated model retraining.
Critical strengths
-
The paper addresses an important challenge in developing LLM-based sales agents: learning transferable sales skills while adapting efficiently to changing business-specific knowledge and requirements.
-
The paper includes extensive experiments across different model sizes, business domains, and evaluation benchmarks, supported by ablation studies and human evaluations.
-
The proposed approach demonstrates improvements in response quality, tool usage, and cross-domain persuasion, suggesting practical benefits for building adaptable LLM agents.
Critical weaknesses
-
The proposed framework primarily combines existing techniques, including SFT, GRPO, process rewards, and external harness optimization. The paper could better clarify its methodological contributions beyond integrating these established components.
-
The experimental results show that most performance gains come from prototype-tool SFT rather than the proposed HNR-GPO algorithm. In particular, RL slightly reduces strict response quality for the 9B model (73.5% to 72.9%), raising questions about its practical effectiveness.
-
Although HNR significantly reduces zero-variance rollout groups, this improvement does not consistently translate into better downstream performance. Alternative reward formulations achieve comparable results, making the necessity of the proposed reward mechanism unclear.
-
Much of the evaluation relies on LLM judges and simulated customers, which may introduce biases. Human evaluation shows relatively low inter-annotator agreement and does not establish a statistically significant preference for the trained 9B model.
-
The proposed outer-loop optimization still requires human participation for fault localization and harness modifications. Therefore, the framework does not yet demonstrate fully autonomous self-evolution.
Questions for authors
N/A