- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces stance drift, the phenomenon where an intended opinion or position changes as it passes through an AI-mediated communication pipeline. The authors model communication as a two-stage process: (1) an LLM generates an argument from a specified stance, and (2) another LLM extracts the stance from that argument. They define Stance Preservation Rate (SPR) as the probability that the final extracted stance (over 5-point Likert scale) matches the original one. Across 112 debate propositions and nine LLMs, no model achieves SPR above 0.7 under the default setup. The authors identify three dominant failure modes: polarization (moderate stances becoming extreme), deviation from neutrality, and stance flipping. The best mitigation strategy is GPT-5.4 with third-person reflection and medium reasoning effort, reaching SPR = 0.775, but substantial drift remains.
Critical strengths
- Novel problem formulation. The paper studies communication fidelity rather than generation quality, alignment, or stance classification in isolation.
- Clear metric and analytical framework. The transition-matrix formulation and SPR provide a simple, interpretable measure of preservation failure. The decomposition into polarization, flipping, and neutrality drift is particularly useful.
- Thorough intervention analysis. The paper identifies which drift modes dominate and tests several interventions, finding that most common prompting tricks help little.
Critical weaknesses
- Heavy reliance on LLM-as-judge. The primary measurement uses an LLM extraction stage. If extraction itself is noisy or biased, observed drift may partially reflect evaluator limitations rather than communication failure. The human study is interesting but limited to a single proposition.
- Artificial communication setup. Real-world AI-mediated communication often involves editing, summarization, translation, and iterative interaction. The proposed generation--extraction pipeline may not fully capture these settings.
- Limited theoretical insight into causes. The paper quantifies drift very well, but provides less explanation of why specific models drift, whether generation or extraction dominates across models, or what architectural properties predict drift.
Questions for authors
Q1: Are the results robust across communication tasks, e.g. email drafting, summarization, translation? Q2: Can a more fine-grained failure mode analysis be done with respect to the specific component (generator, extractor)? Q3: Is there a stronger mitigation strategy for stance drift?
3 comments
Response to Reviewer 3JXN(2)
(Part 2 of 2)
W3, Q2. "... provides less explanation of why specific models drift, whether generation or extraction dominates across models, or what architectural properties predict drift." and "Can a more fine-grained failure mode analysis be done with respect to the specific component (generator, extractor)?"
The paper is descriptive by design, and the new limitations subsection states that the conclusion does not isolate a causal source (quoted under W1). On the specific points:
- Generator or extractor. Separating the two stages needs a reference independent of the extractor, which human labeling, as in the human-extraction study, provides at a high cost.
- Models and architecture. The models were reached through APIs and differ in size, family and training at once, so the results do not identify which property of a model, architectural or other, predicts drift (Section 3.1).
Both are valuable directions, for example through analyses of the attention mechanism, but each calls for a standalone study. Nevertheless, we consider the description a contribution in its own right, for three reasons.
- It is an empirical finding enabled by a reusable evaluation framework. The transition matrix, SPR and the drift patterns apply to any model, and the same measurement detects the gain from reasoning effort (Q3), suggesting it can serve as the target of mitigation work.
- The finding is consequential and has several facets. The paper gives a systematic evaluation of end-to-end stance preservation, and none of the nine models exceeds an SPR of 0.7. The transition matrices separate the drift into five patterns, of which polarization, deviation from neutrality and flipping carry most of the drift of every model (Table 2).
- The phenomenon is robust and persistent. It holds across nine models from several families, over 112 propositions, under the robustness checks and mitigation strategies of Section 3.4, and in the exploratory email-writing task.
Q3. "Is there a stronger mitigation strategy for stance drift?"
The strongest effect we found is that of reasoning effort on GPT-5.4: medium reasoning effort raises the SPR from 0.593 to 0.686 with the default prompts and from 0.637 to 0.775 with third-person reflection (in which each stage is asked to check its output against the stance from the perspective of an impartial third-party reviewer). In both cases it lowers polarization and flipping but raises deviation from neutrality, and at the highest SPR, 0.225 of the transition mass still drifts. After reasoning effort, the largest effect is that of in-context learning, which raises the SPR of GPT-5.4 to 0.673 and, unlike reasoning effort, also raises the success rate for "Neutral", from 0.703 to 0.831; polarization remains its largest pattern. Five rows of Table S5, mean (SE) over the 112 propositions, with the new rows in blue:
| Model | SPR | Polarization | Moderation | Moderation to neutral | Flipping | Deviation from neutrality |
|---|---|---|---|---|---|---|
| GPT-5.4 | .593 (.008) | .328 (.006) | .002 (.001) | .000 (.000) | .018 (.004) | .059 (.006) |
| GPT-5.4 (third-person reflection) | .637 (.011) | .240 (.007) | .003 (.001) | .001 (.000) | .063 (.008) | .056 (.006) |
| GPT-5.4 (third-person reflection, medium reasoning) | .775 (.012) | .119 (.007) | .019 (.003) | .001 (.000) | .008 (.004) | .079 (.007) |
The run with the default prompts and the in-context learning run are new, and the revision adds them to Section 3.4:
To separate the reasoning effort from the reflection prompt, we also ran the prompts of the default configuration with medium reasoning effort (Fig. S5). Relative to the default configuration, the SPR rises from 0.593 to 0.686 and polarization falls from 0.328 to 0.197, but the success rate for "Neutral" falls from 0.703 to 0.517.
Meanwhile, although in-context learning made no meaningful difference for GPT-4o-mini, it raises the SPR of GPT-5.4 to 0.673, close to medium reasoning effort, and raises the success rate for "Neutral" to 0.831; about a third of the transition mass still drifts, mostly through polarization (0.280).
Thank you to the authors for the comprehensive response. The rebuttal substantially addresses the strongest validity concerns. While I still have reservations regarding generalization and causal understanding, I now believe the paper makes a meaningful empirical contribution and provides a useful evaluation framework, and I increased the score.
Response to Reviewer 3JXN(1)
We thank the reviewer for the careful reading and the comments, and respond to the weaknesses and questions below.
W1. "Heavy reliance on LLM-as-judge. ... If extraction itself is noisy or biased, observed drift may partially reflect evaluator limitations rather than communication failure. The human study is interesting but limited to a single proposition."
We would like to clarify a misunderstanding. The extraction stage models the receiver, a person who reads the message with the help of an LLM (Figs. 1 and 3); it does not score the generated argument. Drift caused by biased extraction is therefore part of the communication failure we study, since end-to-end drift is what the receiver experiences. The results of Section 3 and the appendix, measured by the SPR, the success rate per initial stance, the proportion of propositions whose confidence interval includes 1 and the pass rate at thresholds from 0.5 to 1, indicate that stance drift is pervasive rather than noise.
The human-extraction study is exploratory: on one proposition, it examines whether human readers recover the initial stance from the generated arguments and at which stage drift arises (Section 3.5). The revision states its scope in a new limitations subsection (Section 4.3):
W2, Q1. "Real-world AI-mediated communication often involves editing, summarization, translation, and iterative interaction ... Are the results robust across communication tasks, e.g. email drafting, summarization, translation?"
Realistic communication is also the motivation of our study. For email drafting, we added an exploratory run with GPT-5.4 as a proof of concept, in which the generation prompt asks for a short email to a colleague in place of the argument and the extraction prompt is unchanged. Drift remains, with an SPR of 0.713. Polarization is still the largest pattern, and an email written for "Agree" is read as "Agree strongly" in 0.494 of the trials. The revision describes the run in a new Appendix A.13 and Table S14:
However, real communication varies in setting, prompt and text length, so neither a single setup nor a small set of setups covers all of it. As a first study of stance drift in AI-mediated communication, we reduce communication to a generation-extraction pipeline that keeps its essence, a sender who expresses a stance and a receiver who reads it, and that can be quantified. For summarization, Liu et al. (2024) find that systems frequently alter the political stance of a news article (Section 1). Iterative interaction corresponds to the multi-hop communication chains proposed in Section 4.2, for which the transition matrix of one step is the building block. Covering more tasks, such as translation, is a valuable direction for future work.