- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper argues that the usual sycophancy metric, how often a model adopts a user's wrong answer, conflates distinct failures. Holding a wrong option fixed on four-option MT-Consistency questions, the authors vary three things:
- how the option is endorsed: mere mention, the user's belief, another participant's or an expert's belief, a user wish explicitly labeled as not evidence, an answer key, and others;
- whether a correct assistant answer is already in the dialogue;
- which instruction is appended.
On a 240-question panel with Qwen 3 8B, Qwen 2.5 7B and Gemma 3 27B, an injected correct prior makes Gemma 3 and Qwen 2.5 follow the user's wrong belief far more often (30→154 and 34→119 of 240). With the prior in place, Qwen 2.5 also follows the current user more than an expert.
On a 96-question panel, an instruction to put facts above the user's preference is compared with a length-matched "quality reminder." In Gemma 3 it removes most of the wish-following (pp; pp in the BF16 replication) but barely moves belief-following (pp). The same instruction reduces belief-following in Gemma 2 and Qwen 3.5, whereas in Gemma 3 and Qwen 2.5 belief-following survives even a variant that names the user's belief. Gemma's responses suggest it treats a wish as a request and a belief as a correction.
Section 6 argues that evidence-, reward- and goal-based accounts can produce the same output distribution, so agreement data alone cannot distinguish them. It also shows that source coefficients fitted to next-token probabilities do not transfer to paraphrased panels.
Critical strengths
S1. The measurement is careful and honest. Every source is compared with a mere mention of the same option, which isolates what the endorsement itself adds. The factual-priority instruction is compared with a length-matched reminder rather than with no instruction, which is the right control. Unparseable and truncated answers stay in the denominator, and worst-case bounds are reported alongside. The unparseable answers from the V100 goal panel and the disclosure judgments on the source panel (71 responses) were re-read blind by a human. The goal panel was replicated with unquantized BF16 weights, and the paper is explicit about which analyses were added after the results were known. The point estimates in Tables 1–3 can be recomputed from the counts in the supplementary aggregate files, and the intervals match the stored evidence files. The individual effects are credible as measurements.
S2. The wish/belief distinction is useful. In Gemma 3, the same wrong answer comes from two different readings of the user's turn:
- A wish is honored as a request, and the response often acknowledges the correct answer or the chosen option's inaccuracy (38 of 71 in the blinded audit).
- A belief is accepted as a correction: with a prior, 238 of 240 belief responses contain an apology or a concession.
The two react very differently to the same remedy (pp; pp in BF16). This is a good argument that sycophancy should not be reported as a single number and that mitigations should be tested on more than one kind of prompt.
Critical weaknesses
W1. The core dissociation is clear in only one model, and the numbers move a lot with the run configuration.
Only Gemma 3 and Qwen 3.5 have wish effects large enough to test (Sec. 7), and the clean pattern, in which the wish effect vanishes while the belief effect stays nearly intact, appears only in Gemma 3.
- Qwen 3.5 does reduce wishes more than beliefs (pp), but its belief effect drops as well (pp), and 155 of its 864 responses hit the length cap, so the bounds that treat every capped response as unknown include zero.
- Qwen 2.5's wish effect is too small to test.
- The OLMo runs are uninformative.
- The extra models were added after the main results were known, and a Gemma 4 31B run was stopped and not analyzed (App. C). This makes me wonder what else was run.
Within Gemma 3 there are further problems:
- The main goal-panel run uses NF4-quantized weights.
- In the H100/BF16 rerun, which changes the weights, compute precision and hardware together, 212 of the 864 parsed labels change, and the desire effect under the reminder falls from 63.5pp to 30.2pp.
- That BF16 cell has 32 unparseable answers out of 96 (bounds 29.2–63.5pp), so Sec. 5's claim that in BF16 the two effects "start out comparable" is not yet established.
- Each prompt gets one greedy generation, and the intervals resample only the 96 questions, so none of this run-to-run variation shows up in the error bars.
- Gemma 3's interval, [-14.6, 4.2], does not rule out a substantial reduction of a belief effect that is 32.3pp to begin with.
The current evidence supports a strong claim about Gemma 3 27B on these prompts. That is much narrower than the title, "Two Kinds of Sycophancy in Language Models."
W2. It is hard to tell whether the surviving belief-following is deference or an update on the user's testimony.
The prior is a bare one-line "The correct answer: GOLD." with no reasoning, inserted regardless of whether the model knows the answer. Depending on the model, 23–35% of the 240 questions are not answered correctly under the neutral no-prior prompt (supplementary files; unparseable answers counted as not correct), and some gold labels are debatable. In that situation, siding with a user who disputes an unexplained earlier answer can be reasonable, and doing so also satisfies an instruction to "select the option you judge factually correct." A belief effect that does not respond to the factual-priority wording beyond what the reminder already does is therefore also what testimony-based updating predicts. The authors mention this reading in Sec. 5, but the design cannot separate it from deference.
For Gemma 3, the paper's own subsets point the same way:
- Under factual priority, the belief effect is 12.9pp on the 31 scientific-subject questions and about 34pp on the other 65 (27.1pp overall).
- On the 12 direct-derivation items under factual priority, the user's belief yields 3/12 wrong-target declarations, against 2/12 for mere mention.
- Qwen 2.5 looks closer to genuine deference: on the same 12 items it gives 10/12 against 4/12 under every instruction (supplementary files). Its wish effect, however, is too small to test.
Being directly derivable is not the same as the model knowing the answer, though: even under mere mention, with the correct prior in context, Gemma 3 picks the gold option on only 4–6 of these 12 items and Qwen 2.5 on 6–7. This is why Q1 asks for a split by model correctness.
I also think the practical message is overstated for Gemma 3. Measured against the original wording rather than the reminder, factual priority reduces the belief effect by 20.8pp on V100 and 30.2pp in BF16, roughly 40–50%, and most of that already comes from the generic reminder (15.6pp [5.2, 26.0] on V100 and 26.0pp [16.7, 36.5] in BF16, from the supplementary files). So Gemma 3's belief-following does respond to instructions; it just does not respond to the factual-priority content beyond what the reminder already achieves. That is a narrower conclusion than "a fix aimed at what users want can miss a model's deference to what users think."
Minor (not a basis for my score)
- Section 6 is only loosely connected to the experiments. Proposition 1 is a fairly elementary identity, and the claim that the shared restriction fails rests on 7 of 1,938 (Qwen 3) and 21 of 1,710 (Qwen 2.5) eligible cells.
- The main text is very dense, and several details that matter for reading the results appear only in the appendix: that the main Gemma run uses NF4 weights on V100, that the BF16 rerun changes 212 of the 864 parsed labels, and that its reminder-desire cell has 32 unparseable answers.
- App. C lists batch size among the differences between Gemma's two configurations, but it reports batch size 8 for Gemma in both.
Questions for authors
Questions that could change my assessment
Q1. Could you report the goal-panel belief effect and broken down by whether Gemma 3, Qwen 2.5 and Qwen 3 answered each item correctly under the neutral no-prior prompt of the source panel? For the Qwen models, please also split by probe confidence in the gold option under the neutral condition. Please also show the 31 scientific-subject questions and the other 65 separately, with intervals. If the belief-following that remains in Gemma 3 under factual priority also appears on items the model reliably gets right, my second concern would be largely resolved.
Q2. Could you adjudicate the 32 unparseable answers in the BF16 desire/reminder cell as you did for V100, and report the BF16 , and their difference on that basis? App. C says the V100 configuration was chosen for validity and throughput. Now that a BF16 replication exists, why does the NF4 run remain the primary result?
Q3. Why was the Gemma 4 31B run stopped? Were any other models or prompt variants run but not reported?
Scoped requests that would strengthen the paper
Q4. Could you rerun the goal panel for BF16 Gemma 3 with several samples per prompt (e.g., , ) and report intervals that include generation variance? Is still clearly negative?
Q5. Do the history effect and Gemma 3's resistance hold when the prior is the model's own sampled answer (with reasoning) rather than an injected one-liner? The answer would also help reconcile your results with SycEval (Fanous et al., 2025), which reports that preemptive rebuttals elicit more sycophancy than in-context rebuttals.
Novelty
Q6. Sec. 4 reports that Qwen 2.5 follows the current user more than another participant. What does this add beyond the following two studies?
- Wang et al. (2025) report that "I believe" framings induce more sycophancy than "They believe" framings, and that user-expertise framing has a negligible effect.
- Dubois et al. (2026) report that I-perspective framing amplifies sycophancy.
Both papers are cited, but this overlap is not discussed.
Minor: The abstract on the OpenReview page says three models, whereas the PDF abstract says seven.
6 comments
Response to Reviewer vAkq (2/2)
Q2. The 32 unparsed BF16 answers. A separate model labeled them without seeing the gold option, the target or the model identity. The wish effect is then 39.6pp [29.2, 50.0], next to a belief effect of 38.5pp, with Γ_D = −35.4pp [−47.9, −22.9] and Γ_B = −4.2pp [−14.6, 6.3] (App. F, p. 21). A human re-annotated all 81 discovery-panel unknowns blind and agrees with these labels on 79 (App. F). BF16 is now the primary configuration, and the confirmatory panel uses it throughout. We had used 4-bit weights only because the 27B model in BF16 did not fit our first GPU (App. C, p. 16).
Q3. The Gemma 4 run; unreported runs. We stopped the Gemma 4 run while it was still loading weights, before any prompt was generated, to free the GPU before the deadline (App. C, p. 17). It is now part of the confirmatory panel, where it follows neither wishes nor beliefs (both below 1pp). Table 7 (p. 24) reports all four instruction conditions for all ten models, App. G (p. 22) marks the runs added after the plan was frozen, and the revised supplementary material has a complete run inventory.
Q4. Several samples per prompt. With ten sampled generations per prompt, Gemma 3 27B in BF16 gives S = −21.9pp [−33.5, −10.3] on the discovery panel. This interval includes generation variance (Table 11, p. 26). Table 9 (p. 25) gives the corresponding confirmatory estimates.
Q5. The model's own earlier answer; SycEval. With the model's own complete answer as the earlier turn, the history effect remains: belief-following rises by 34.6pp in Gemma 3 and by 15.0pp in Qwen 2.5 (Table 12, App. G). The contrast S remains too, as reported in the first part of this reply. A comparison with SycEval needs care, because our user turn is a bare statement of belief with no argument, and our effects are net of a mere mention of the same option.
Q6. Beyond Wang et al. (2025) and Dubois et al. (2026). Our user-versus-other result agrees with both studies, and §2 (p. 3) now discusses them. What it adds is the role of dialogue history. In Qwen 2.5, the user's belief and another participant's are followed on 34 and 24 of 240 questions with no prior answer, and on 119 and 55 with a correct one (§2; Table 1). Neither study compares a wish with a belief, or tests how a remedy affects each.
Minor points.
- §6 (pp. 8–9) is now one proposition with its scope stated. The fits and the rank-restriction cells are in App. H (p. 28) and App. K (p. 32), presented as a diagnostic.
- The configuration details you listed are with the discovery panel in App. C (pp. 15–17) and App. F (p. 21), and the batch-size statement is corrected (App. C, p. 16).
- The abstract on the OpenReview page now matches the PDF.
We hope the confirmatory panel answers the first weakness and the known-question and own-answer results answer the second. If so, we would be grateful if you would consider revising your score.
Full Result Details for Reference
Thank you for recomputing our numbers yourself; we truly appreciate the care this took. Because you did so, we wanted to give you the full tables directly rather than only pointers to them. Below are the confirmatory results, the robustness estimates and the analysis by prior content that support our answers to W1, W2, Q4 and Q5.
W1. Confirmatory panel, all 240 questions (pp, 95% intervals; Table 5, p. 23). Δ: effect under the quality reminder; Γ: change under factual priority; S = Γ_D − Γ_B. Incl.: meets the inclusion rule fixed in the plan. § marks estimates whose missing-outcome bounds cross zero although the interval does not.
| Model | Incl. | Δ_D (wish) | Δ_B (belief) | Γ_D | Γ_B | S |
|---|---|---|---|---|---|---|
| Gemma 3 27B | yes | 34.0 [29.4, 38.6] | 32.6 [28.2, 37.2] | −35.3 [−40.7, −30.0] | −18.8 [−23.3, −14.3] | −16.5 [−23.1, −10.4] |
| Gemma 3 12B | yes | 13.8 [10.4, 17.1] | 38.9 [34.2, 43.8] | −10.8 [−14.0, −7.6] | −34.9 [−40.3, −29.6] | 24.0 [18.6, 29.7] |
| Qwen 3.5 9B | yes | 32.9 [28.5, 37.5] | 13.3 [10.1, 16.5] | −30.0 [−34.7, −25.4] | −9.9 [−13.1, −6.7] | −20.1 [−24.7, −15.7] |
| Gemma 4 31B | no | 0.1 [−0.3, 0.7] | 0.7 [0.0, 1.5] | −0.4 [−1.1, 0.1] | −0.6 [−1.5, 0.3] | 0.1 [−0.7, 1.0] |
| Gemma 2 27B | no | −0.4 [−1.5, 0.7] | 19.2 [15.0, 23.6] | −0.8 [−1.9, 0.3] | −18.3 [−22.6, −14.3] | 17.5 [13.3, 21.8] |
| Qwen 3.5 27B | no | 1.1 [0.3, 2.1]§ | 1.9 [0.7, 3.3] | −1.1 [−2.2, −0.1]§ | −2.6 [−4.2, −1.2] | 1.5 [0.6, 2.6]§ |
| Qwen 3 8B | no | 2.9 [1.5, 4.4] | 7.4 [5.3, 9.7] | −1.5 [−3.3, 0.3] | −2.6 [−4.7, −0.7] | 1.1 [−0.8, 3.1] |
| Qwen 2.5 7B | no | 3.2 [1.9, 4.6] | 25.8 [21.9, 30.0] | −2.8 [−4.4, −1.2] | −4.4 [−7.1, −1.8] | 1.7 [−1.1, 4.3] |
| Phi-4 14B | no | 1.2 [0.4, 2.2] | 2.9 [1.7, 4.3] | −1.0 [−1.9, −0.0] | −0.7 [−1.9, 0.6] | −0.3 [−1.4, 0.8] |
| OLMo 3.1 32B | no | 1.2 [0.1, 2.4]§ | 11.5 [8.8, 14.4] | −1.7 [−3.2, −0.1]§ | −3.5 [−6.2, −0.7]§ | 1.8 [−1.0, 4.6] |
W1 / Q4. S under sampling and under each labeling layer (Table 9, p. 25):
| Estimate | Gemma 3 27B | Qwen 3.5 9B | Gemma 3 12B |
|---|---|---|---|
| Greedy, parser (primary) | −16.5 [−23.1, −10.4] | −20.1 [−24.7, −15.7] | 24.0 [18.6, 29.7] |
| 10 samples, parser | −16.1 [−21.8, −10.5] | −15.3 [−17.9, −12.8] | 23.5 [18.4, 28.5] |
| Greedy, separate-model labels | −18.6 [−25.0, −12.5] | −17.5 [−21.5, −13.6] | 25.8 [20.3, 31.4] |
| Greedy, adjudicated labels | −18.5 [−25.0, −12.4] | −18.1 [−22.2, −14.0] | 25.8 [20.1, 31.5] |
W2 / Q5. S by the content of the earlier assistant turn (240 questions unless noted; Table 12, p. 26):
| Earlier assistant turn | Gemma 3 27B | Qwen 3.5 9B | Gemma 3 12B |
|---|---|---|---|
| Own answer, with reasoning | −16.7 [−25.8, −7.5] | −15.0 [−21.2, −8.8] | 23.8 [15.8, 31.7] |
| … only questions where it is correct | −12.6 [−22.5, −2.2] (182) | −16.7 [−23.4, −9.9] (192) | 30.4 [22.2, 39.2] (171) |
| Own answer, one line | −20.8 [−30.0, −12.1] | −20.1 [−26.8, −13.0] (239) | 25.8 [18.8, 33.3] |
| Injected correct answer | −20.0 [−29.6, −10.8] | −22.1 [−28.7, −15.4] | 23.3 [16.2, 30.8] |
| Injected incorrect answer | −20.4 [−27.5, −13.3] | −11.2 [−16.7, −5.8] | 15.0 [8.3, 21.7] |
Relative to no prior answer, the model's own complete answer raises the belief effect under the quality reminder by 34.6pp [28.3, 40.8] in Gemma 3 27B and by 15.0pp [10.0, 20.0] in Qwen 2.5 (App. G).
Response to Reviewer vAkq (1/2)
Thank you for recomputing our numbers from the supplementary files and for saying which answers could change your assessment. We begin with the two main weaknesses.
W1. Support beyond Gemma 3 27B and one configuration. The confirmatory panel covers ten models from four families in BF16, with every wrong option and a prompt under which 95.8–100% of answers parse (§5, pp. 5–8, Fig. 3).
On this larger sample Gemma 3 27B's belief effect also falls under the instruction (Γ_B = −18.8pp), with 13.9pp remaining; §5 gives the proportions for each model. In Gemma 3 12B the instruction removes most of both effects, so we report S model by model.
W2 / Q1. Deference, or an update on the user's testimony? The split you asked for is in Table 6 (p. 23). The table below gives belief-following that remains under factual priority (pp), by whether the model answers the question correctly under the neutral no-prior prompt.
The effect is present on questions the model gets right, so it is not only an update under uncertainty. It is larger on the other questions, so part of it may well be testimony-based updating, and §5 says so.
Two further arms address the bare one-line prior. With the model's own answer and its reasoning as the earlier turn, Gemma 3 27B gives S = −16.7pp [−25.8, −7.5]. With an injected incorrect answer, S = −20.4pp [−27.5, −13.3], which argues against stronger copying of a correct prior (Table 12, p. 26).
Table 3 (p. 21) has the discovery-panel splits you requested: by neutral correctness, by probe confidence for the Qwen models, and by subject, each with intervals. The subject difference you saw on 96 questions does not appear on the full panel. Gemma 3 27B's remaining belief-following is 17.1pp [11.4, 23.2] on the 76 scientific-subject questions and 12.4pp [8.3, 16.7] on the others (Table 14, p. 27).
The practical message for Gemma 3. §5 now reports your decomposition. In BF16 the generic reminder alone lowers Gemma 3's wish and belief effects by 41.7 and 26.0pp, so belief-following does respond to instructions in general. The message is worded accordingly (abstract; §8, p. 9): a fix aimed at what users want can miss deference to what users think, and can cost legitimate updating.