- Rating
- 2(−1)
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents a co-evolution approach for improving both user simulator realism and judges of realism, done solely via prompting. The authors's approach is based in a pairwise turing setup, where a judge must determine which of two dialogues was human vs. machine generated. The co-evolution approach iteratively improves the simulator using judge rationales, and then improves the judge using information about human vs. machine origins. The results show that the approach works quite well!
Critical strengths
The idea is great, the infusing of human data at each iteration is nice, and the results seem quite exciting!
Critical weaknesses
- Evaluation setup validity: I have some concerns of the validity of some of the evaluations.
- External validity: the setup is not really a Turing test; the real turing test is judging whether one conversation is real or AI, but here, it's much more simplified because the judgment is contrastive. While that doesn't negate the results, more discussion if needed for how this can be useful for evaluating simulators without human references.
- Circularity: This may be due to the writing issues (below) but I was confused whether the human judges in §2 were the same as the ones in §3, which could cause an issue of circularity (same humans who originally did the Turing task are the ones being improved upon)? Similarly, it seems that the "human-rationale-assisted judge optimization" uses some of the human-generated evaluation signal to improve, which makes it a bit less valid. I would appreciate some clarification and discussion to indicate how this is avoided.
- Win rate: I am not quite sure win for simulator is the goal; the goal should be for the human and the AI to be completely indistinguishable, not for the AI to appear "more human" (I'm not sure that even makes sense?). More discussion and perhaps results with a metric that aims for indistinguishability might be good.
- Low human agreement on turing task: Table 4 & §2.2 shows that LLM-human agreement is quite low, and so is human-human. This raises the question of whether the foundation of the paper is meaningfully valid enough... I wish authors had discussed these low agreement rates a bit more.
- Baselines: While I appreciate that the authors focus purely on prompt-based improvements, the impact and comparability of the paper is hindered by the lack of comparisons with models trained for user simulation (e.g., OSim/Odyssim, UserLM, CoSER). Having these results would help readers understand how prompting compares to training and which option is most likely to help with building truly good user simulators.
- Writing: The paper's writing and organization could be improved.
- Right now, §2 contains a mix of results and methods, it's a bit confusing. I'd suggest that the authors present their approach and methodology in §2, and relegate results to section §3, where they can frame each key result as a specific research question.
- Authors should make sure to use \citet for in-line citations but \citep for parenthetical citations (e.g., L68, 73).
- Table 2 is too small font-wise
- Table 3 should probably be a confusion matrix, to also indicate how many dialogues pass the Turing test but not RNR. Right now the stats are a bit hard to interpret.
Post rebuttal: I think this paper has an amazing idea, but the execution is just not valid enough imo. I therefore lower my score 3->2, based on the rebuttal not addressing my concerns and even making them more crucial. I do believe with a careful pass and slight redesign of the experiments this paper will be amazing!
Questions for authors
Out of curiosity, how would the results look of pitting two AI-AI dialogues against each other? Can this method be used for comparing simulators against others?
2 comments
Thank you for responding to my review. However, the rebuttal largely doesn't address my concerns, making me doubt the validity of the paper more than during my first pass.
W1: External validity / usefulness of contrastive Turing test
You're right that the original Turing test was contrastive. But that does not negate my point that this is an easier setup compared to a single-input human vs. AI classification. More discussion is still needed for how this can be useful for evaluating simulators without human references.
W2: Circularity of human evaluations
I still think that there is bleed over from what the authors described in their rebuttal. Authors should conduct a version of the experiments where the human judges are completely separate, because humans have low agreement.
W3: Why is a higher Turing win rate better?
Even though previous work does this, we should always think critically about adopting evaluation setups from previous works. In this case, in terms of construct validity of evaluation, since the goal of the evaluator is "determine which one is human vs. AI", if the evaluator consistently judges the AI as human, then you're not measuring the right construct, and could possibly even suggest the evaluator is overfitting to spurious correlations in the AI trajectories. This is a big flaw in the experimental design.
W4: Low human agreement
This is not addressed in the rebuttal. I want more discussion on this and how this affects the validity of the findings.
W5: User sim baselines.
Thanks for computing this. In retrospect, you're right, since these are smaller models, they likely won't compete against your frontier model setups. But still a useful thing to compute imo, so thank you!
W6: Confusion matrix
Thanks!
W7: AI-vs-AI
Sure, that makes sense.
We thank the reviewer for recognizing our idea and experimental results.
1. External validity
Our setup follows common Turing-test practice, including the setup in Turing’s original article.
As described in [1], “Player C, the interrogator, is tasked with determining which player – A or B – is a computer and which is a human using only the responses to written questions.”
2. Circularity
We carefully separate data sources and the uses of human signals to avoid leakage.
To clarify the presentation, the human judges whose rationales are used for human-rationale-assisted judge optimization in Section 2 are the same annotators who evaluate the simulator in Section 3. This does not create circularity because the evaluation precedes judge refinement: we first evaluate the simulator optimized only against the seed judge, before any human-rationale distillation. We then use the rationales collected during that evaluation to refine the judge.
3. Why is a higher Turing win rate better?
A higher Turing win rate indicates that the simulator is more frequently perceived as human.
We cannot directly measure the humanlikeness of user simulators. What the Turing test and our method measure is how consistent the simulator’s behaviors are with human reviewers’ mental models of humanlikeness [4]. Therefore, a win rate above 50% means that the simulator is more frequently perceived as human.
Meanwhile, a win rate of 50% alone does not establish indistinguishability from humans, because aggregate results can conceal systematic differences across scenarios. For example, a simulator consistently selected as human in half the scenarios and consistently identified as AI in the other half would also achieve an overall win rate of 50%.
Moreover, papers such as [2] and [3] interpret higher win rates as a sign of more human-like simulators. We follow their practice.
4. Low human agreement
Different judges use different clues and have different mental models of humanlikeness [4]. Accordingly, agreement is around 60% in our experiments.
5. Fine-tuned baselines
Our optimized prompt achieves a higher TWR than the fine-tuned baselines.
Their model sizes are small, so we do not directly compare them with our results based on closed-source LLMs.
6. Confusion matrix for Table 3
The conclusion remains the same: RNR is a weaker filter.
An RNR pass indicates that the dialogue is judged as human. The table shows that many dialogues judged as human by RNR are identified as AI by the Turing judge in both presentation orders.
7. Comparing two AI–AI dialogues
Comparing two AI-generated dialogues is feasible, but falls outside our Turing-test-style evaluation because the judgments cannot be validated against a real human reference.
References
[1] Pinar Saygin, A., Cicekli, I. & Akman, V. Turing Test: 50 Years Later. Minds and Machines 10, 463–518 (2000).
[2] Wang, Yingshan Susan et al. “Learning User Simulators with Turing Rewards.” ArXiv abs/2606.19336 (2026).
[3] Hathidara, Ashutosh et al. “MirrorBench: A Benchmark to Evaluate Conversational User-Proxy Agents for Human-Likeness.” Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (2026).
[4] C. R. Jones & B. K. Bergen. Large language models pass a standard three-party Turing test. Proc. Natl. Acad. Sci. U.S.A. 123 (21), e2524472123 (2026). https://doi.org/10.1073/pnas.2524472123