- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The authors aim to explain and mitigate “constraint-induced response collapse,” where prompted constraints can reduce the comprehensiveness of answers. They find that this can be resolved either by prompting the LLM to be thorough (Table 2) or steering (Section 3). The authors also trace the emergence of the described phenomenon to reward-based post-training (Section 4).
Critical strengths
S1: The topic is relevant and practical. Format constraints are common (e.g., in judge protocols), so the documented phenomenon has the potential to be problematic.
S2: The steering experiment in Section 3 and the results in Section 4 are interesting. I found especially interesting that subtracting the direction from constrained prompts barely reduced constraint adherence.
Critical weaknesses
Weakness 1
Concerns about the discussion of form primers and alternative hypotheses. This limits my ability to endorse the downstream conclusions at this stage.
-
The definition in Section 2.1 ("when the thing it talks about is one of the properties of the response as a piece of text rather than of its content") is imprecise. Notwithstanding the foregoing, I do not follow the "form primer" classification in Table 2, e.g., why are (1) whether em or en dashes are present or (2) whether kittens or cats are discussed properties of the response "as a piece of text" and not "its content"?
-
I find the alternative hypotheses incomplete (and, with the exception of R3, somewhat implausible), so the conclusion that Table 2 “leav[es] form priming as the likely explanation” is a bit unconvincing. For example, the following hypothesis appears substantiated by other results in the text:
Reward-based post-training primes LLMs to infer a preference from the user. Absent additional constraints, the implicit preference is “thorough response” (or something to that effect). Introducing constraints to the prompt pushes the LLM to prioritize constraint-adherence and de-prioritize any implicit preference, since these prompts do not instruct the LLM to answer in the way the judge is scoring (e.g., details, examples, etc.). This is consistent with Table 2 (e.g., no collapse is observed when the constraint is aligned with this objective).
Weakness 2
The measurement and discussion of comprehensiveness and "collapse" depend on aspects of the experimental design that are not satisfactorily justified.
-
In Section 2, the authors define comprehensiveness as “substantive content conveyed about [the prompt],” but I would say that both responses in Figure 1 are reasonable and deliver substantive content. Meanwhile, the judge explicitly calls for “examples,” which are not strictly necessary for a comprehensive answer (Appendix A).
-
The “collapse” is largely driven by reliance on a pairwise judge, and the effect appears much more modest under pointwise scoring (Table 3). The authors say this means the pointwise judge only “see[s] half of the full story,” but it is also plausible that the pairwise judges exaggerates the loss.
I believe this is a significant oversight and feel the authors do not engage sufficiently with prior work that may help clarify the issue. First, the idea that pairwise judgement exaggerates the perceived distinction between candidate items has been discussed in the social sciences for many years (i.e., "distinction bias" [1]) and is consistent with pre-existing work regarding judge/feedback protocols (e.g., "distracted evaluation" [2] and ranking vs. rating [3]).
Weakness 3
Missing details and overstated clams. For example:
-
The judge prompts are described in Appendix A but not actually provided in full.
-
The abstract claims that "Controlled ablations identify the trigger as form primers," which is not supported (i.e., causal). The second sentence of the Conclusion is more appropriate, in my view.
-
Section 3 (steering) is introduced as "a practical way to study the effect and to reduce [constraint-induced response collapse]." But simply prompting with "Be thorough, include all details" - certainly far more practical than activation steering - appears to mitigate the collapse on its own (Table 2). This by no means invalidates the section, as I find its content interesting (as mentioned in Strength 2), but it weakens the stated claim, which appears to motivate the section's existence.
References
[1] Wikipedia, "Distinction bias," https://en.wikipedia.org/wiki/Distinction_bias
[2] Tripathi et al., "Pairwise or Pointwise? Evaluating Feedback Protocols for Bias in LLM-Based Evaluation," COLM (2025).
[3] Bansal et al., "Peering Through Preferences: Unraveling Feedback Acquisition for Aligning Large Language Models," ICLR (2024).
Questions for authors
-
How were the questions selected for the benchmark? It would be nice to include some example questions. Are the experiments only on questions?
-
Do the models adhere to the constraints after SFT (but before the reward-based post-training)?
-
How are the authors using the negated turnstyle operator in Appendix G? Its usage here appears nonstandard and unintroduced.
-
Appendix F mention "released code," but I do not see it. Have I missed this somewhere?
18 comments
(2/4)
R1, R2, and R4 are the explanations that prior work and readers are likely to consider first. Template dependence (prior work) needs the clause to ban something that the answer uses (R1). An instruction-following account needs an order (R2). R4 is the basic null hypothesis that any added sentence causes the loss. Table 2 is built so that each row removes one of these factors and keeps the reference to the form. R3 is the alternative that the reviewer finds plausible, and Table 2 tests it most directly. "Pay attention to your formatting and punctuation as you write" asks for no change and costs 15 to 22%. "Italicize each section's heading" asks for more text and costs 28 to 30%.
W2. Comprehensiveness and the word "examples". We measure a relative quantity. We compare what a model conveys with the constraint to what the same model conveys without it. Each answer in Figure 1 looks reasonable when it is read alone. For this reason, single-answer evaluation does not notice the loss, and we compare each answer with the model's own unconstrained answer instead. Factual coverage never asks for examples. We also re-scored the answers with a pairwise prompt that asks only "how much of the information needed to answer this question does each response convey". This prompt does not mention examples, edge cases, or depth (Appendix A gives the full prompt). It reports -26.1% on Qwen3-4B-Instruct and -15.7% on Llama-3.1-8B-Instruct. The unconstrained answer wins 97.2% and 79.0% of the pairs.
W2. Could the pairwise judge exaggerate the loss? We tested this with five checks. One check does not ask any judge which answer is better. Another check uses a judge from a different model family.
- An independent count gives a loss of the same size. Factual coverage does not ask a judge which answer is better. It lists the claims in the unconstrained answer. It then checks, one claim at a time, whether each claim is present in the constrained answer. On the 160-question benchmark (Qwen3-4B-Instruct, all 1,760 pairs), constrained answers convey 36.1% of these claims. A second unconstrained answer to the same question conveys 58.0% (Table 7). Relative to an answer given with no constraint, this is a loss of 37.8%. We re-ran the pairwise judge on exactly these pairs for this check, and it reports -36.1%. The two measures also rank the eleven constraints in nearly the same order (Spearman 0.91). On Llama-3.1-8B-Instruct, the same comparison gives 52.4% against 63.9%, a loss of 18.0%, and the pairwise judge reports -21.6%.
- As a null control, we ran the same pairwise judge on two unconstrained answers to each of the 160 questions. It reports Delta = -0.4% (95% CI -2.1 to +1.3). It scores 51.2% of the pairs as exact ties. The mean absolute gap between the two scores is 0.54, against 3.13 when one of the two answers has a constraint. So the judge does not create gaps between answers that are equally complete.
- To test the effect of answer order, we re-judged the 440 pairs of the 40 written questions (Qwen3-4B-Instruct) with the A and B positions swapped. In 394 of the 395 pairs that received a score in both runs, the two runs agree on whether the unconstrained answer wins (Appendix A.1 gives Delta for each position).
- To control for length, Table 3 includes a length-discounted judge. This judge is told to ignore length, formatting, and style, and to count distinct points. It still finds most of the loss: -26.6% against -29.0% for the pairwise judge on Qwen3-4B-Instruct, and -17.0% against -21.6% on Llama-3.1-8B-Instruct. Correction: in the submission, the Llama rows for the pointwise and length-discounted judges (-14.3% and -19.1%) had been scored by Sonnet 5 on answers from a different generation run. We re-scored them with Opus 4.8 on the same answers as the pairwise row. The new values are -12.4% and -17.0%, and the revised Table 3 uses them.
- We re-scored 220 of the benchmark pairs (20 held-out questions, eleven constraints) with a judge from another model family, an OpenAI model (gpt-6.1-sol), and the same prompt. We also re-scored the null control on the same questions. This judge reports Delta = -29.2% (the unconstrained answer wins 92.7%), against -34.9% for Opus 4.8 on the same pairs. On the null pairs, it reports +2.2%, with 65% ties. The two judges pick the same winner in 207 of the 220 pairs, and they rank the eleven constraints in nearly the same order (Spearman 0.96).
(3/4)
Regarding the work that the reviewer cites, Tripathi et al. (2025) find that pairwise judgments change toward a response that carries a distractor (an assertive tone, wordiness, or sycophancy) more often than absolute scores do. In their study, the distractor is added by a rewrite that keeps the content the same. In our pairs, the content differs. Check 1 measures this difference without asking which answer is better, and check 4 discounts wordiness. Bansal et al. (2024) find that ratings and rankings disagree mainly on pairs that are judged close, where ratings give ties. Check 2 shows that our judge gives ties when nothing is missing. Hsee and Zhang (2004) describe the evaluation of a single option as "close to a step function". Zheng et al. (2023) note that single-answer grading "may be unable to discern subtle differences". We report the same behavior for pointwise judges, which give close scores to answers that differ in content. Finally, the omission does not depend on a comparison being made. A user who sees only the constrained answer still does not receive the 42% of essential claims that this answer drops (Appendix B). We add these citations to Appendix K, and Section 2.1 now cites Hsee and Zhang (2004) and Zheng et al. (2023).
W3. Judge prompts. Appendix A now gives the full text of every prompt: pairwise, pointwise, length-discounted, content-only, claim extraction, claim matching, importance grading, and compliance.
W3. "Controlled ablations identify the trigger". We revise the abstract to state what the ablations show: "Controlled ablations show that form primers, phrases in the prompt that refer to the form of the response rather than its content, are enough to trigger the collapse, even when they restrict nothing." The conclusion makes the same claim. Each row of Table 2 changes one appended sentence and keeps everything else fixed, so each comparison is an intervention on the prompt. Section 3 adds an intervention on the activations. When we add the direction computed from form-primed prompts to a prompt with no constraint, the collapse appears.
W3. Steering vs. "be thorough" prompting. We agree that the sentence that motivates Section 3 puts the emphasis in the wrong place, and we revise it. (The "be thorough" row of Table 2 adds that sentence to a question with no constraint. It is the control for R4.) The purpose of Section 3 is to test cause and effect. We read a single direction from the prompt at its last token, before the model generates any answer token. This direction alone is enough to produce the collapse on a prompt that has no constraint. It is also enough to remove most of the collapse from a prompt that has a constraint, while the model still follows the constraint (Table 4). A prompting experiment cannot show this, because prompting changes the input. Steering keeps the input fixed and changes only the internal state. The new held-out evaluation (Appendix C.1) shows that both effects hold on questions and constraints that were not used to build the direction. We keep the practical benefit as a secondary point. The intervention needs no change to the prompt that the user or the deployed system provides.
(1/4)
We thank the reviewer for the detailed review. In response, we made the following changes. The revised PDF shows new and revised text in blue. We summarize the answers here, with details for each following the summary.
W1. Definition of a form primer, and the kittens case. We define a form primer in a way that can be applied to any clause. A clause is a form primer when it refers to the response as a piece of text, by which we mean its characters, layout and formatting, register and tone, delivery medium, or what it must not mention, instead of the information that the question asks for. The em-dash ban refers to characters in the response. The kittens clause names a subject, but no answer to the question contains this subject, so the clause restricts nothing that the question asks for. It belongs to the no-op group in Figure 2. "Be thorough" and "address the question in the best possible way" refer to the content of the answer, that is, how well the response covers the question. Therefore, they are not form primers, and they do not cause the collapse (Table 2). We add this definition to Section 2.1.
W1. The reviewer's alternative (post-training installs an implicit "be thorough" preference, and an explicit constraint overrides it). We agree with the first half of this account, and it is the account of Section 4. Reward-based post-training makes one elaborated answer the model's default way of being thorough (Tables 5 and 6, Figure 4). Section 2.1 asks a different question, namely what moves the model away from this default. Two results in the paper show that the second half cannot explain every collapse. (i) The no-op clauses give the model nothing to put ahead of thoroughness. "Freely use any words in your response" permits everything, and "Do not discuss kittens" forbids nothing that an answer would contain. Yet these clauses cost 15 to 38% of the content (Table 2). If the model gave up thoroughness in order to obey, it would need something to obey. These clauses act only by being present in the prompt. (ii) Statements that give no instruction at all ("Your response will be read aloud", "displayed in a monospace font") cost 20 to 33% (Table 2, R2). In both kinds of clause, the cost comes from a reference to the response that asks nothing of it. We call this effect form priming. We add the reviewer's account as R5 in Section 2.1, together with these two observations.
We also tested the account directly. Before generating any answer, we wrote down what R5 and form priming each predict for nine new clauses. On Qwen3-4B-Instruct (40 questions, the setup of Table 2), R5 explains part of the effect. Instructions about content that do not ask for thoroughness also cost content: "Use an analogy to explain the main idea" (-40.9%), "Mention one common misconception" (-27.0%), and "Include at least one concrete, real-world example" (-16.3%). Other rows go as form priming predicts. "Explain why this matters in practice" leaves the answer unchanged (+0.3%), and "I am reading this on a train", which gives no instruction, costs 31.1%. Two statements that neither account predicted also cost content ("Em dashes are longer than en dashes", -32.1%; "Today is Tuesday", -15.6%). Four added sentences in the same test do not collapse the answer (+0.3%, +1.9%, -5.8%, +10.1%), so the effect does not come from a longer prompt (R4). The new Appendix M reports all twelve rows (the nine new clauses and three rows of Table 2). Section 2.1 now states which part of the effect R5 explains, and it no longer says that Table 2 leaves form priming as the likely explanation. The abstract now states that form primers are enough to trigger the collapse.