- Rating
- 3
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The current work attempts to model what is known as a disclosure trajectory in the context of multi-turn interactions between a user and an LLMs. In particular, their framework leverages doctrines from Social Penetration Theory in order to provide a rigorous investigation of how previous disclosures impact model behavior in current disclosures.
The contributions of the work are thus twofold - first they provide a benchmark-agnostic framework which is able to birth multi-turn conversations that also include disclosure trajectories. Second, they demonstrate the utility of this framework via controlled experiments that demonstrate the impact of such trajectories downstream.
Critical strengths
- the background from Social Penetration theory is well provided and necessary, as it is a level of detail and importance to the work that the average audience member for this work may not be as familiar with.
- Good diverse choice of models for evaluation purposes.
- the investigation into how prior disclosure history shapes model behavior in the future (RQ1) is thoroughly developed and the experimental methodology therein is sound with respect to the conclusions that were able to be drawn.
Critical weaknesses
- the use of a single model for persona construction as well as conversation generation is a bit worrisome, especially as the authors do not readily provide evidence of quality control and assurance that the subsequent generations are not only viable but also are of diverse and high quality. Despite mentioning a generate-evaluate-correct loop, it would be good if the authors provided more insight and detail into the specific ways in which this evaluation occurs.
Questions for authors
See above.
3 comments
Part 2
Regarding diversity, we did not simply ask Qwen to generate different personas. We selected six conversational domains based on recurring themes in studies of human–AI interactions by Skjuve et al. (2022) and Ta-Johnson et al. (2022): Career, Friendship, Family, Romantic Relationships, Future/Aspirations, and Social Belonging. We also selected seven Early Maladaptive Schemas (EMS) from Young et al. (2003), focusing on interpersonal vulnerabilities relevant to self-disclosure. The choice of EMS was further informed by Ang et al. (2025), who identified EMS-related characteristics in naturally occurring disclosures.
Combining the six topics and seven EMS gave us 42 persona configurations. This allows us to vary not only the topic of discussion of the personas, but also their underlying concerns when discussing the same topic. For each configuration and disclosure trajectory, we further generated three independent conversation chains, giving us 126 conversations per trajectory for each evaluated model. We also sampled and reviewed the generated conversations to check whether the discussions remained relevant to their assigned conversational domains. In Appendix A.10, we included examples to illustrate how the generated disclosures reflect the assigned topics and underlying EMS across different disclosure depths. The selection rationale is provided in Appendices A.4 and A.6.
To ensure consistency in the generation setup, we also kept Qwen as the generator throughout our experiments. While this does not establish whether the same findings would hold with other generators, the framework itself is not restricted to Qwen. Future evaluations could repeat these experiments using other generators and incorporate human assessments of conversational naturalness and diversity.
Dear Reviewer Uycm,
We apologize for following up again. As the discussion period is coming to an end, we would like to ask if you might have time to review our rebuttal. We have addressed the critical weaknesses raised and acknowledge your ratings on presentation and informativeness. We have thus revised our manuscript to improve on reading flow as well as clarity on the validation of our methods and additional qualitative investigations in the results section.
We would appreciate it if you could let us know whether our responses have sufficiently addressed your concerns, or if there is anything else you would like us to clarify. If you find our responses satisfactory, we would also be grateful if you could consider revising your score. Thank you very much for your time and consideration!
Best, Authors
Part 1
How do we ensure the quality and diversity of generated conversations?
We thank the reviewer for raising these concerns. We agree that the quality of the generated conversations is important since our experiments depend on producing disclosures at specific depth levels. We have also revised the manuscript to better explain our generation and evaluation procedures, following the reviewer's comment that parts of the paper were difficult to follow.
We summarize our validation results, generation acceptance rates, and analyses excluding fallback conversations in the table below.
We use Qwen3.6-35B-A3B to construct the personas and generate the conversations, but use Phi-4 to evaluate whether the generated disclosures match their intended depths. We explain the generation and correction procedure in Appendix A.8. For each disclosure turn, Qwen is given the target depth, the relevant persona information, and the six most recent dialogue turns. Each generated utterance is then checked for its disclosure depth, conversational style, and persona leakage before we accept it.
For disclosure depth, we follow Li et al. (2026a), who evaluate informational, cognitive, and emotional disclosure. Since Li et al. used GPT-4.1 while we used Phi-4, we also repeated the generation experiment with GPT-4.1 to examine whether changing the evaluator would affect the results. As shown in the table above, both evaluators achieved relatively high depth matching rates, although generating D3 disclosures remained more difficult (see Appendix A.2).
We also check for style violations, such as formulaic expressions, restricted punctuation patterns, and utterances longer than two sentences. For persona leakage, we use keyword matching to check whether the utterance explicitly reveals the assigned EMS or other internal generation information. When a candidate fails any of these checks, we provide feedback on what needs to be corrected and generate another candidate. We allow up to 12 attempts for each disclosure turn.
As reported in the table above, the acceptance rates were above 99% for D1, D2, and D4, but were lower for D3. When no candidate passed all three checks after 12 attempts, we selected a fallback candidate by prioritizing disclosure depth matching, followed by the absence of persona leakage and the number of style violations. If multiple candidates still satisfied these criteria equally, we selected the most recent attempt. These fallback turns were recorded separately (see Appendix A.8). We also repeated the analyses excluding conversation chains containing fallback turns (see Appendix A.18). Although fewer comparisons remained significant in RQ1, excluding these chains also reduced the sample size. We therefore cannot determine whether this decrease was due to fallback removal or reduced statistical power. However, we found that the persistence patterns in RQ2b remained similar under this restriction.