- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates sycophancy in LLMs across a multi-turn trajectory. The author controls the path of the pressure to LLM and observes the behavior. Two kinds of pressure are considered in this work, including Social and Exposure. The author conducts the experiment across different benchmarks and models. The results show that even after removing the pressure and returning to zero pressure, the model is still affected by sycophancy. The author also conducts several ablation studies in this paper.
Critical strengths
- The idea is interesting. Controlling the pressure and observing the sycophancy across LLMs is interesting and unexplored.
- Experiments cover different benchmarks and models to make sure the behavior is not limited to a single specific model or dataset.
- The author also tries to delve into the internals of the model and conduct ablation studies. To investigate more, not limited to the answer observation of the LLMs.
Critical weaknesses
- First, the experiment setup does not that fullfill the goal of this paper. Although controlling the pressure with the method recorded in Appendix A.2 is a clear way to quantify the level of pressure. It is somehow not that institute. For example, when the pressure becomes P2 after P3. In current settings, this turn of dialogue is providing two comments (Amy said the answer is A. Tom said the answer is A). But it doesn't mean we decrease the pressure here. The accumulated pressure is also increasing since we add additional 2 comments.
- Extend from 1, the current findings are expected. Since the model can see the full history of the conversation, when the path is P0 -> P1 -> P2 -> P3 -> P2 -> P1 -> P0. At the last step, the LLM saw all the historical pressure, and due to the majority bias/voting, the answer will not revert to the first P0 step. It's a little bit trivial. Hence, reflect to the goal of this paper, what does this paper actually want to know? If the author can not clarify the goal with the aligned experiment setups, it will lead to be a ideally labortory experiment setup and just observe the reaction of the LLM. It will make the impact of this paper not that high. Figure out a better setup or align with a human to make some cognitive science-related findings, which will make the readers more impressed.
Questions for authors
- Line 133-138: Is "pressure modalities" the jargon often used between Social and Exposure?
- Line 141-147: Can you add an explicit definition for notation s?
- According to the deep dive in sections 5 and 6, what do you think is the main reason for the finding in Figure 2? Why is there a gap between the first P0 and the last P0?
- Some missing references should also be considered:
a) Are You Sure? Challenging LLMs Leads to Performance Drops in The FlipFlop Experiment
b) Do as We Do, Not as You Think: the Conformity of Large Language Models (ICLR 2025 oral)
c) TRUTH DECAY: Quantifying Multi-Turn Sycophancy in Language Models
3 comments
We expanded Section 6.1 to examine whether the accumulated number of pressure statements determines the final result. The pressure order experiment changes the earlier trajectory while preserving the number of presentations at each pressure level, the total number of turns, the entire sequence after peak pressure, and all previous model responses. For MedQA, ARC+BBH, and TruthfulQA, we change the increasing sequence from P0 → P1 → P2 → P3 to P0 → P2 → P1 → P3. MMLU applies the same exchange before reaching P4.
Changing the order increases in all eight combinations of benchmark and modality. For MedQA, ARC+BBH, TruthfulQA, and MMLU, the paired changes are +0.18, +0.63, +1.35, and +3.33 under Social, and +0.63, +0.76, +0.64, and +1.01 under Exposure. Seven of the eight paired confidence intervals exclude zero. The only exception is MedQA Social, with a change of +0.18 and a 95% confidence interval of [-0.08, 0.45]. The largest effect occurs on MMLU Social, where increases from 17.3 to 20.6, with a paired difference of +3.33 and a confidence interval of [3.01, 3.66]. These results show that earlier pressure order affects the final decision even when total exposure and preceding model responses remain fixed.
We conducted two additional ablations in Section 6.1. Abrupt withdrawal returns directly from peak pressure to P0. Additional P0 turns preserve the conversation length. Under Social, decreases from 11.5 to 5.3 on MedQA, 12.1 to 5.4 on ARC+BBH, 8.6 to 3.3 on TruthfulQA, and 17.3 to 15.7 on MMLU. Under Exposure, increases from 17.7 to 23.3, 16.8 to 18.4, 12.0 to 12.1, and 26.0 to 30.4, respectively. Six of the eight paired differences are significant. Remanence remains positive in every condition. The withdrawal trajectory affects Social and Exposure differently.
The final instruction ablation preserves the entire preceding pressure trajectory and changes only the instruction at the last P0. The instruction asks the model to disregard earlier support for specific answers and reconsider the original question. Under Social, decreases from 11.5 to 4.9 on MedQA, 12.1 to 6.0 on ARC+BBH, 8.6 to 1.0 on TruthfulQA, and 17.3 to 8.1 on MMLU. Under Exposure, decreases from 17.7 to 7.2, 16.8 to 6.8, 12.0 to 1.6, and 26.0 to 10.2, respectively. All eight paired differences are significant. The largest reduction is 15.78 on MMLU Exposure, with a 95% confidence interval of [-16.53, -15.04]. Remanence remains positive in all eight settings. Across the three behavioral ablations, 21 of the 24 paired comparisons show significant differences from the standard trajectory. Table 1 and Appendix B.3 provide the complete results.
These experiments provide a more detailed explanation of the gap between the initial and final P0 in Figure 2. Earlier target mentions and previous model responses contribute to the residual preference. The order of earlier pressure affects the result under matched total exposure. The withdrawal trajectory and the final instruction influence the magnitude of remanence. The revised interpretation emphasizes how the preceding conversational trajectory affects the current judgment.
We incorporated the three references you recommended in Section 2.1. We now discuss the FlipFlop experiment by Laban et al. (2023), the analysis of conformity by Weng et al. (2025), and the study of repeated feedback and persuasion by Liu et al. (2025). These studies provide important context for changes in model judgments during extended interactions. Our analysis examines differences between decisions under matched current pressure and tests how changes in the preceding trajectory affect the final judgment.
Reply to author response
Thanks for the detailed response and the extra experiments. You addressed my minor questions, including the definition of s, the clarification of Social/Exposure, and the added references.
However, my two main concerns still stand:
- Redefining P_k as the pressure in the current message makes the notation clearer, but the setup is the same. The total pressure the model sees in context never actually goes down, so calling this "withdrawal" still feels like an overstatement to me.
- The new Neutral Mention results actually support my concern. Just mentioning the target label gives remanence similar to Social, while Neutral Presence gives almost none. So the residual shift seems to come mostly from the target appearing repeatedly in context, which is pretty much what I'd expect, not something specific to pressure history. I still don't see a clear answer to what the paper wants to show beyond this.
The revision is clearer, but these core issues remain, so I'll keep my score.
Thank you for the thoughtful review and for raising these concerns about the experimental design and interpretation. We have revised the manuscript to clarify the definition of pressure, explain the difference between the initial and final P0, and report additional controls that examine the influence of conversational history.
Your first concern addresses the transition from P3 to P2. We agree that the accumulated conversation continues to grow as the experiment progresses. Section 3.1 now explicitly defines Pk as the pressure presented in the current user message. Under Social, the current message contains k endorsements of the target answer. Under Exposure, it repeats the target assertion k times. The transition from P3 to P2 reduces the current number of endorsements or assertions from three to two. Earlier messages remain in the conversation context. Our experiment measures how this retained history affects decisions under identical current pressure.
At each intermediate pressure level, we compare the increasing and withdrawal states using identical current pressure messages. The matched control repeats P0 for the same number of dialogue turns and accounts for changes associated with repeated interaction. We measure the difference between the two paths using Hk and the residual difference at the final P0 using R. Section 3.2 now explicitly defines the trajectory state s as the original question, preceding user and model messages, and the current user message. We clarify in Section 3.1 that Social and Exposure are two experimental constructions of pressure. Social varies the number of peer endorsements, while Exposure varies the number of repeated assertions.
Your second concern asks whether the difference between the initial and final P0 follows from accumulated statements and previous model responses. We added two neutral prompt variants to examine these contributions. Appendix A.2 describes their construction, and Table 1 and Appendix B.3 report their results. Neutral Mention preserves the number and sequence of speakers while replacing each endorsement with a neutral statement such as "I am mentioning the label B." Neutral Presence preserves the speaker schedule using statements such as "I have read the original question." Both variants retain the original question, initial model response, and response format.
Across MedQA, ARC+BBH, TruthfulQA, and MMLU, Neutral Mention produces R values of 10.76, 12.42, 9.05, and 14.61 in Qwen2.5-7B-Instruct. All four confidence intervals exclude zero. Neutral Presence produces values of 0.02, -0.01, 0.54, and 0.51. For comparison, the original Social condition produces 11.5, 12.1, 8.6, and 17.3. Neutral Mention produces remanence comparable to Social, including slightly larger values on ARC+BBH and TruthfulQA. These results identify repeated target mentions as a substantial contributor to the residual shift. They show that earlier references to an answer can influence later judgments without explicit endorsement.
We examine previous user messages and model responses separately in Appendix B.5. The first replay control replaces previous user messages with those from the pressure trajectory while retaining the model responses from the matched control. The second replaces previous model responses while retaining the user messages from the matched control. The original question, initial model response, and current message at the final P0 remain identical. We evaluate Qwen2.5-7B, Gemma-2-9B, and Llama-3.1-8B across four benchmarks and both pressure modalities. Replacing previous user messages increases the decision margin toward the target in all 24 conditions. Replacing previous model responses produces the same direction of change in all 24 conditions. All 48 confidence intervals exclude zero. Figure 10 presents these results. Earlier user messages and previous model responses both contribute to the residual preference at the final P0.