- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
The paper proposes Fake Player, a three-agent framework consisting of an Inner Monologue Agent, an Intent Analysis Agent, and a Typing Agent that jointly simulate human players to generate NPC training dialogues from strong LLM then SFT a small model.
Critical strengths
By simulating the player with an Inner Monologue Agent, an Intent Analysis Agent, and a Typing Agent, the framework produces more human-like and diverse player-side utterances than the ICL and RPA baselines.
Critical weaknesses
-
NPC dialogue optimization is a highly vertical application domain, and the proposed solution is overly simplistic. Thus, this work is not well-suited for submission to ICLR.
-
As shown in Figure 1, NPC dialogue needs to handle a wide variety of unexpected player inputs, and every response must account for multi-level information spanning the character, scenario, and game context. The data-generation harness is therefore crucial. Yet the paper addresses this with only the Inner Monologue / Intent Analysis / Typing agent pipeline, which is too simple to resolve the core challenges of NPC dialogue.
Questions for authors
N/A
Thank you for the review. We respectfully disagree that the application domain and simplicity of the method are sufficient reasons to dismiss its contribution.
Our work addresses a player-side training-distribution mismatch that has received limited attention in NPC training. LLM-generated user inputs tend to be formal, verbose, and contain several intentions, while real users often send short, colloquial messages and switch intentions during conversation. This mismatch affects the trained model’s ability to understand and respond to users. Games provide our application setting, but the same problem is relevant to conversational and personal agents.
Character, scenario, and game context are included in the interaction setup. Fake Player improves how players express their intentions within that context, generating more realistic and diverse inputs for NPC training. Its simplicity does not diminish the value of addressing this problem. With the same Qwen2.5-7B backbone, Fake Player achieves a downstream score of 73.10, compared with 67.00 for RPA and 53.29 for ICL.
The method has also been deployed in a commercial game serving over one million players. Post-deployment questionnaires showed a 15% increase in satisfaction with NPC interactions. We believe these experimental and deployment results provide concrete grounds for assessing the contribution of a simple, effective approach.