acceptodds
Under review as a conference paper at ICLR 2027

To Compare, or Not to Compare: On Methodological Practices in Evaluating Social Bias

Abstract

As Large Language Models are increasingly deployed in critical applications, robustly evaluating their social biases is paramount. However, the current literature suffers from widespread methodological fragmentation, which yields contradictory conclusions. As we show, this is in part related to the structural framing of benchmark-level evaluations: whether demographic targets are assessed in isolation or compared directly in a forced choice. Our evaluation across multiple model families reveals a massive, systematic paradigm gap: while isolated assessments limit prejudice activation, comparative settings act as aggressive catalysts for latent stereotypes and discrimination, a shift primarily driven by underspecified contexts. To isolate this effect, we introduce a unified and controllable framework that standardizes heterogeneous benchmarks across both paradigms and disentangles the confounding effects of Chain-of-Thought reasoning, neutral fallback options, and other structural artifacts in social bias evaluations. Alarmingly, CoT reasoning strongly exacerbates social biases under comparative settings while having virtually no effect in isolated ones, and this systemic bias persists even when models are provided neutral fallback options or claim to answer randomly. Finally, we demonstrate that this comparative prejudice is a generalized phenomenon that scales positively with model size. Ultimately, we offer a practical methodological guideline: while researchers must leverage comparative settings to robustly audit hidden biases, practitioners cannot safely rely on comparative deployments in ambiguous real-world tasks.

Primary area:
alignment, fairness, safety, privacy, and societal considerations
Keywords:
Large Language Models, Comparative Evaluation, Social Bias, Evaluation Framework, Fairness, Ethics

Reviews

Among:
Shape:
1234this paper, Top 30%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.67 over 3 reviews, above 70% of the others.
Reviewer_6GmEOpenReview ↗
Rating
3
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

Interesting paper - The paper compares yes/no judgements with comparison between two targets using social-bias benchmarks. The paper analysis finds that models tend to show greater [references when asked to compare (especially with CoT), but the gap get smaller when the context provides enough information to answer. Neural options and random instructions are also tested. I think the main takeaway is the way we ask questions can substantially change the bias we measure - unsurprising finding, but good that we have a rigorous student to examine this.

Critical strengths
  • S1: The main strength of this paper is that the research questions are well-structured with experiments designed to answer these important questions. The findings also shows that the prompt has substantial effects on the results.
Critical weaknesses
  • W1: My main concern is whether ISO and CMP are measuring sufficiently similar things to support the paper's interpretation. Asking whether a sentence is unusual and asking which of two sentences is more unusual are different judgment tasks. Technically, both sentences could receive the same yes/no answer while still being distinguishable in a comparison. - I suspect this design choice has a strong influence on how we should interpret the results.

  • W2: I think one of the key concern I have is the effect of abstention, and the interpretation of neural answers. For instance, on BBQ, some models abstain almost all the time (Table 4). Their remaining answers can still be biased, but abstention may nevertheless greatly reduce the number of biased decisions overall.

Questions for authors
  1. Does the ISO–CMP gap persist with graded isolated judgments, rather than binary yes/no answers?

  2. How do neutral options change unconditional disparity, and how often is PG determined by the no-definitive-answer default?

7 comments

Dear Reviewer 6GmE,

Thank you for the positive review. We are glad that you found our research questions well structured and our experiments suited to answering them.

Below, we address your concerns regarding weaknesses (W) and questions (Q). In the revised manuscript, the changes made in response to your comments are marked in violet. The line numbers below refer to the revised manuscript.

W1: Similarity of the ISO and CMP tasks We agree that ISO and CMP are distinct judgment tasks, absolute and relative, as stated in Section 3.2 (lines 189-192). Since benchmarks use the two formats interchangeably (Table A.2), our aim is to quantify how this choice alters bias conclusions. The two formats still capture a related signal, as per-pair ISO and CMP preferences are moderately correlated (mean r between 0.34 and 0.58, Appendix C.1). We also agree that both sentences could receive the same yes/no answer while still being distinguishable in a comparison. The distinction that emerges in the comparison is not arbitrary, as models consistently judge the anti-stereotypical sentence as the more unusual one (Section 4.1, lines 291-292). The gap is also not specific to this question or to the binary answer. It appears across all five benchmarks (lines 286-289), it persists when ISO uses a graded 1-to-5 scale (Q1 below), and it is rarely statistically significant when the context determines a correct answer, as in disambiguated BBQ, WinoBias, and MMLU (lines 306-312; Appendix E.3).

Q1: Graded isolated judgments This is indeed a reasonable and interesting setting, which the submitted version listed as future work in the Limitations. Nevertheless, we provide here a limited analysis on a subset of models. We replaced Yes/No in ISO with a 1-to-5 scale (1 = definitely no, 2 = probably no, 3 = uncertain, 4 = probably yes, 5 = definitely yes). As shown in the table below, graded ISO remains close to binary ISO and far below CMP, with a significant gap in 14 out of 15 cases. We have added this analysis to Appendix E.5.

PG (%) under binary ISO, graded ISO (1-5 scale) and CMP (gender, CoT). Bold: statistically significant difference between graded ISO and CMP.

ModelRBBBQDE-Gen
ISOISO-gradedCMPISOISO-gradedCMPISOISO-gradedCMP
Qw3-4B-I13.414.159.64.02.024.01.2-0.19.4
LMa3.1-8B-I10.02.824.45.80.118.81.2-0.623.0
DS-LMa-8B5.60.858.03.80.124.62.4-0.18.2
Min3-14B-R5.63.451.43.90.632.64.60.939.2
OSS-20B7.68.560.62.42.522.2-2.22.84.4

W2 & Q2: Abstention and the parity default We thank the reviewer for this point. For W2 and the first part of Q2 (unconditional disparity), as also replied to Reviewer uMNo (R1.Q3), the first table below compares |PG(CMP)| with the neutral option computed only on the definitive answers (Def., as in Table 5) and on all the answers (All). The bias drops where models often abstain (e.g., BBQ, DiscrimEvalGen) and barely changes where they rarely do (StereoSet). We agree that abstention reduces the overall number of biased decisions and have revised our claims accordingly. Nevertheless, its practical effect depends on the deployment. Indeed, for example, when a selection of N candidates is required (e.g., hiring settings), a neutral answer only leads to querying the model again, so the biased decision is delayed rather than avoided.

|PG(CMP)|% with the neutral option, computed only on the definitive answers (Def.) and on all the answers (All), gender, CoT. Bold: statistically significant difference between Def. and All (p < 0.05).

ModelSS (Def.)SS (All)RB (Def.)RB (All)BBQ (Def.)BBQ (All)DE-Gen (Def.)DE-Gen (All)DT-Tox (Def.)DT-Tox (All)
DS-LMa-70B63.263.082.472.58.20.317.03.298.667.3
DS-Qw-32B60.259.179.273.915.00.831.04.896.679.3
LMa3.1-70B-I60.860.080.467.614.41.132.64.796.672.7
LMa4-17B-16E-I59.659.471.871.621.410.735.019.399.699.7
Min3-14B-R49.048.650.043.437.29.538.25.696.883.1
OSS-120B65.664.676.870.010.60.91.41.699.851.9
Qw2.5-32B-I59.058.383.262.70.40.024.23.296.684.1
Qw3-30B-A3B-I59.055.170.844.53.00.73.81.396.465.3
Qw3.5-27B63.858.782.266.03.00.24.01.563.212.6
Qw3.6-35B-A3B60.453.081.855.75.41.14.60.593.270.2

As for the second part of Q2, PG falls back to the default only when the model always selects the neutral option. The second table below compares CMP without the neutral option (A/B) and with it (A/B/C, Table 5). It shows how much |PG(CMP)| changes from A/B to A/B/C, as a percentage change, and splits this change into two parts. Non-Def. is the change due to the neutral answers. Def. is the change due to the A or B answers.

For example, for OSS-120B on BBQ, |PG| decreases by about 54%, as it decreases by 65.7% due to the neutral answers but increases by 11.4% due to the A or B answers. Where PG decreases, mainly on BBQ and DiscrimEvalGen, this is mostly due to the neutral answers. On BBQ, this may partly reflect familiarity (data contamination) with the original benchmark, the only one whose original design includes a neutral option, which is also the correct answer in the ambiguous split we evaluate (lines 392-395; Appendix G, lines 1758-1761).

Importantly, when the model picks one of the two targets in A/B/C, its answers are more biased than in A/B in 31 of the 50 model-benchmark pairs, and almost equally biased (less than 0.5% of change) in 7. So the neutral option may lower the measured bias because the model often selects it, not because its choices become fairer, consistently with Section 4.3 (lines 395-401). If a neutral answer leads to asking the question again, as when a decision is required, the final decision comes from the A or B answers, which in most cases are more biased than in A/B.

We have added these analyses to Appendix E.8, with a pointer from Section 4.3. The first one is marked in gold (lines 1512-1538), as it was also requested by Reviewer uMNo, and the second one in violet (lines 1541-1555).

Change (%) of |PG(CMP)| from A/B to A/B/C, relative to A/B, due to the neutral answers (Non-Def.) and to the A or B answers (Def.). Negative values reduce |PG|, positive values increase it.

ModelSSRBBBQDE-GenDT-Tox
Non-Def.Def.Non-Def.Def.Non-Def.Def.Non-Def.Def.Non-Def.Def.
DS-LMa-70B0.0+0.7-0.3+1.2-70.7+4.3-46.1-19.80.0+0.6
DS-Qw-32B0.0-0.10.0+1.8-51.6+14.7-19.2+21.10.0+1.9
LMa3.1-70B-I0.0-0.3+0.3+7.5-30.7-13.6-57.5-0.40.0+1.3
LMa4-17B-16E-I0.0+0.70.0-0.6-37.0+2.5+5.3+56.40.0+0.2
Min3-14B-R0.0-3.80.0-2.8-10.4+24.50.0-2.80.0+3.8
OSS-120B0.0+0.70.0-0.6-65.7+11.4-73.5-11.90.0+17.7
Qw2.5-32B-I0.0+0.3-0.2+12.9-92.9-1.2-27.8+77.50.0-0.4
Qw3-30B-A3B-I0.0+2.3-0.5+4.0-84.5+5.6-59.7+62.00.0-0.4
Qw3.5-27B0.0+10.2-1.2+16.5-59.9-12.0-52.2-8.8-15.8+57.2
Qw3.6-35B-A3B0.0+5.60.0+18.1-78.3-5.9-139.9+180.00.0+6.3
Reviewer_yEihOpenReview ↗
Rating
2
Confidence
4
Informativeness
1
Presentation
2
Soundness
1
Read review
Paper summary

The paper converts eight social-bias benchmarks into an isolated Yes/No format (ISO) and a forced binary comparison (CMP) and measures a self-defined Parity Gap across 19 open-weight models and two Gemini models. It reports that CMP has larger gaps than ISO in underspecified contexts.

Critical strengths
  1. Good ablation, existing benchmarks mix isolated and comparative formats without control. This paper separates them

  2. Broad experiments, 19 models, three demographic axes, both option orders, 25 samples per prompt, 54-variant prompt robustness.

Critical weaknesses

W1. The paper builds the analysis on the parity gap and avoids reporting on a variety of standard metrics developed specifically for LLM bias assessments such as StereoSet SS/ICAT, CrowS-Pairs score, BBQ bias score, DiscrimEval discrimination score, DecodingTrust toxicity, WinoBias accuracy gap. The paper does not clarify the motivation for using PG metrics or why it did not consider standard metrics. I know many of them are not designed for iso case of the paper, but it is good to discuss the limitations and motivation behind the metric choice and whether it was possible to adapt the current metrics, particularly the Iso one with modifications to make them applicable for CML in this study.

W2. ISO and CMP gaps are different quantities. CMP is a forced-choice share. Also, there is a clear weakness with ISO, a very polite model would always give the same answer for both questions, and it would look like no bias, but the actual problem would be sycophancy. More controlled experiments are needed to rule this out.

W3. For CMP, when we force models to choose between A and B, the models have shown to have tendency toward mainly selecting A or B. To avoid this problem, the study design needs to randomly distribute the common preferred group or have the same questions while the order of A and B has changed and see if it still chooses the same preferred group. Such analyses are very common mistakes which are missing.

W4. CoT amplification may be a parse-failure artifact. No-CoT is capped at 5 tokens, unparseable outputs are dropped, and empty prompts default to 0.5. The invalid rates are not reported

W5. No confidence intervals is reported. The work has significant numbers in bold when both metrics have statistically significant correlation. A question this may arise is the usability of Iso metric when the outcome mainly has a statistically significant correlation to the CMP, bearing in mind that CMP is very well established and there are many metric for that. If the paper evaluates Iso and it has such a high correlation to CMP why we need it all

W6. Some figures are not readable like Figure two is unreadable with overlapping text.

W7: No limitations section in the main text.

Questions for authors

Addressing weaknesses. I look froward for clarification in rebuttal.

2 comments

Dear Reviewer yEih,

Thank you for the detailed review. We are glad that you recognized the extent of the experiments we ran to support our claims.

Below, we address your concerns regarding weaknesses (W). In the revised manuscript, the changes made in response to your comments are marked in blue. The line numbers below refer to the revised manuscript.

W1: Choice of the Parity Gap Our goal is not to replace the standard metrics but to compare ISO and CMP in a controlled setting. As discussed in the Introduction, the standard metrics are tied to the original format of each benchmark (Table A.2) and cannot be computed in the same way under both paradigms. This required a metric applicable to both settings, so we used the Parity Gap. In Appendix C (lines 1034-1040), we ran the original perplexity-based protocol of SS, RB, and CrowS-Pairs on our 10 core models and showed that our conversion to both formats preserves its signal. The Limitations (Section 6, lines 522-533) discuss the limitations of this metric. Following your comment, we have made this motivation explicit in Section 3.5 of the revised manuscript.

W2: ISO vs. CMP and sycophancy ISO and CMP are different tasks by design, since our goal is to show that the two paradigms, applied to the same content, lead to different conclusions. We agree that a "polite" or sycophantic model that gives the same answer to both ISO questions would look unbiased in ISO, and CMP exposes exactly this hidden preference. This is possible thanks to our standardized framework, which removes confounding factors. To check whether our models behave in this way, the revised manuscript reports their raw ISO answers (Appendix E.4, Table E.2, lines 1249-1252). The answers are not a fixed "Yes". Averaged over the 10 models, the share of "Yes" among the valid answers ranges from 9.0% on BBQ to 84.4% on DE-Gen (table below), the remaining answers being "No". On SS and DT-Tox, it differs between the two targets (12.6% vs. 41.5% and 83.9% vs. 23.9%), so the same models do show preferences in ISO (Table 2). Both ISO and CMP preferences also agree above chance with the original perplexity-based protocol, which involves no answer at all (Appendix C, lines 1051-1053).

Percentage of "Yes" among the valid ISO answers, mean over the 10 models (gender, with CoT, all contexts; Table E.2).

SSRBBBQDE-GenDT-Tox
Target + (%)12.641.49.384.483.9
Target - (%)41.549.59.082.923.9

W3: Positional bias in CMP In all our experiments, every CMP prompt is evaluated with both option orders (e.g., “A: Male, B: Female” and “A: Female, B: Male”), as described in Section 3.4 (lines 236-240). We are glad that the reviewer also lists this among the strengths (“both option orders”).

W4: Parse failures and the 5-token cap Table E.7 shows that the lower bias without CoT is not caused by the parse failures hypothesized by the reviewer. As stated in its caption, it reports the difference in PG between the no-CoT setting with a 5-token cap and with a 2,000-token cap, which is at most 2.7 points (lines 1390-1401). Nevertheless, for completeness, the table below reports the parse failure rates, which we have added to Appendix E.6.

Parse failure rate (%) in the no-CoT setting with the 5-token cap (gender).

ModelRedditBias ISORedditBias CMPBBQ ISOBBQ CMPDE-Gen ISODE-Gen CMP
DS-LMa-70B0.00.00.00.00.00.0
DS-Qw-32B0.00.00.00.00.00.0
LMa3.1-70B-I0.00.00.00.00.00.0
LMa4-17B-16E-I0.021.30.014.10.09.8
Min3-14B-R0.02.50.04.50.14.9
OSS-120B13.418.519.619.612.715.8
Qw2.5-32B-I0.00.00.01.50.00.0
Qw3-30B-A3B-I0.00.00.00.00.00.0
Qw3.5-27B0.00.00.00.00.00.0
Qw3.6-35B-A3B0.00.00.00.00.00.0

W5: Statistical significance Due to space constraints, the confidence intervals are not shown in the tables but in the corresponding figures, which report the same PG results with 95% bootstrap confidence intervals (Figures H.1-H.4; Appendix F). Moreover, in the result tables, bold marks statistically significant ISO-CMP differences under an approximate randomization test (lines 265-268), not a correlation between ISO and CMP. Only in Tables 8 and E.14 (|PG| vs. model size) and Table E.9 (neutral-option rate vs. |PG|) does bold mark a correlation. For clarity, we have marked these correlations with † instead of bold, keeping bold only for significant ISO-CMP differences. As shown by the bold entries, the two formats lead to significantly different results in most cases, and at the level of single pairs they are only moderately correlated (mean r between 0.34 and 0.58, Appendix C.1). Since established benchmarks use both formats (Table A.2), this is the difference our work aims to quantify.

W6: Readability of Figure 2 We agree that Figure 2 and other figures (i.e., Figure E.1) have overlapping labels. Since these labels are redundant or extra information not needed to draw the conclusions of the plots, we have removed them in the revised manuscript.

W7: Limitations in the main text As it is not mandatory to have the Limitations in the main text, we originally placed them in Appendix H of the submitted version, with an explicit pointer in the Conclusion. Nevertheless, based on your suggestion, we have used the extra page allowed during the discussion period to move the Limitations section to the main text (Section 6).

Reviewer_uMNoOpenReview ↗
Rating
3
Confidence
4
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

The paper studies how social-bias measurements change when LLMs evaluate demographic targets separately using yes/no questions (ISO), compared with choosing directly between two targets (CMP). CMP often yields larger preference gaps under ambiguous contexts; the disambiguated BBQ analysis reduces this gap. The contribution is a useful behavioral comparison of elicitation formats.

Critical strengths
  1. An empirical testbed addresses an important evaluation-design choice. Shared content, counterbalanced CMP option order, make the observed framing sensitivity useful for interpreting bias evaluations.

  2. Separate ablations examine reasoning instructions. These make the behavioral findings more informative than a single forced-choice result.

Critical weaknesses

The quantitative ISO–CMP comparison changes both the judgment task and the estimator. Appendix B assigns parity if both rates are zero, whereas CMP measures forced relative choice. Please report the paired affirmation rates and check whether the central conclusion survives a comparable scoring or calibration analysis; otherwise narrow the claim to elicited preference differences between these two task formats.

Questions for authors
  1. What do the paired raw ISO affirmation rates look like for contexts driving the largest ISO–CMP gaps? Does the conclusion hold under a comparison exposing these rates or bridging absolute and relative judgments?

  2. Which main claims should be read as format-specific behavioral findings rather than latent-bias amplification?

  3. How do unconditional target-choice disparities change with a neutral option? Would the conclusion be more accurately stated as persistence of residual bias conditional on commitment while recognizing possible reduction in overall biased decisions?

2 comments

Dear Reviewer uMNo,

Thank you for the careful review. We are glad that you found our experimental setup useful for interpreting bias evaluations.

Below, we address your concerns regarding weaknesses (W) and questions (Q). In the revised manuscript, the changes made in response to your comments are marked in gold. The line numbers below refer to the revised manuscript.

W1: Comparability of the ISO and CMP estimators The parity default is the same in both settings (Appendix B, lines 952-955 and 968). In ISO it applies when the model answers No for both targets, a valid answer that treats them equally. The paired raw affirmation rates (table below) are almost identical on BBQ and DE-Gen (9.3% vs. 9.0% and 84.4% vs. 82.9%), so the ISO parity is already in the raw answers and is not produced by the estimator. As a comparable scoring, we scored ISO as a forced choice, counting a preference only when the model answers Yes for one target and No for the other. CMP remains significantly higher in 37 of 50 model-benchmark pairs (46 of 50 with the original scoring). The exceptions are mostly on DT-Tox, where ISO already elicits a strong bias. As a calibration, when the context determines a correct answer the gap is never statistically significant on disambiguated BBQ (lines 306-312) and rarely on WinoBias and MMLU (Appendix E.3). The central conclusion therefore holds under a comparable scoring. We have added these analyses to Appendix E.4, with a pointer from Section 4.1, and described the gap as a difference in the preferences elicited by the two formats.

Gender, CoT, mean over the 10 models. Targets as in Table 1. Last two rows: number of models with CMP significantly higher (p < 0.05).

SSRBBBQDE-GenDT-Tox
Yes rate + (%)12.641.49.384.483.9
Yes rate - (%)41.549.59.082.923.9
ISO (original scoring)38.49.10.91.964.6
ISO (forced-choice scoring)41.613.12.04.681.9
CMP (original scoring)59.171.822.826.289.2
CMP > ISO (original scoring)10/1010/109/108/109/10
CMP > ISO (forced-choice scoring)9/1010/109/106/103/10

Q1: Paired affirmation rates For each model, we ranked all contexts by their CMP-ISO gap, |PG(CMP)| - |PG(ISO)|, and took the 10% with the largest gap, ties included (table below). For the sake of visualization, here we report only the results averaged across the 10 models. In these contexts, ISO is at parity on SS, RB, BBQ and DE-Gen, with almost identical Yes rates for the two targets, while CMP strongly favors target +. This also holds with the forced-choice scoring of ISO (see W1). On DT-Tox, ISO already favors target +, but less than CMP.

On all contexts, CMP remains significantly higher in 37 of 50 model-benchmark pairs with this scoring. Finally, with a 1-to-5 scale instead of Yes/No in ISO, as asked by Reviewer 6GmE and reported in our answer to R3.Q1, ISO remains far below CMP on 5 models (RB 5.9 vs. 50.8, BBQ 1.1 vs. 24.4, DE-Gen 0.6 vs. 16.8), with a significant gap in 14 of 15 cases. We have added these analyses, with the per-model results, to the Appendix, together with those of W1.

For each model, the 10% of contexts with the largest CMP-ISO gap. Gender, CoT, mean over the 10 models.

SSRBBBQDE-GenDT-Tox
ISO Yes / No rate + (%)12.2 / 87.432.1 / 67.95.9 / 94.193.8 / 6.283.7 / 16.3
ISO Yes / No rate - (%)13.3 / 86.332.5 / 67.15.9 / 94.192.2 / 7.842.3 / 57.7
PG ISO0.70.20.01.239.7
PG ISO (forced choice)4.22.2-0.68.559.9
PG CMP78.996.268.264.295.6

Q2: Behavioral evidence vs. latent bias Our methodology is strictly behavioral (Limitations, Section 6, lines 511-515), so all the results of Section 4 describe the preferences elicited by each format, and we do not claim a mechanism inside the model. These preferences are not an artifact of the forced choice, since both option orders are averaged (lines 236-240) and, when the context determines the answer, the gap is never statistically significant on disambiguated BBQ (lines 306-312) and rarely on WinoBias and MMLU (Appendix E.3). Throughout the paper, we have removed the terms "latent" and "catalyst" and now describe the results as preferences elicited by each format.

Q3: Unconditional disparity with a neutral option We thank the reviewer for this suggestion. The table below compares |PG(CMP)| with the neutral option computed only on the definitive answers (Def., as in Table 5) and on all the answers (All). The bias drops where models often abstain (e.g., BBQ, DiscrimEvalGen) and barely changes where they rarely do (StereoSet). We agree with the reformulation and have revised our claims accordingly. We have added this analysis to Appendix E.8, which already discusses the neutral option, with a pointer from Section 4.3. Nevertheless, the practical effect of abstention depends on the deployment. Indeed, for example, when a selection of N candidates is required (e.g., hiring settings), a neutral answer only leads to querying the model again, so the biased decision is delayed rather than avoided.

|PG(CMP)|% with the neutral option, computed only on the definitive answers (Def.) and on all the answers (All), gender, CoT. Bold: statistically significant difference between Def. and All (p < 0.05).

ModelSS (Def.)SS (All)RB (Def.)RB (All)BBQ (Def.)BBQ (All)DE-Gen (Def.)DE-Gen (All)DT-Tox (Def.)DT-Tox (All)
DS-LMa-70B63.263.082.472.58.20.317.03.298.667.3
DS-Qw-32B60.259.179.273.915.00.831.04.896.679.3
LMa3.1-70B-I60.860.080.467.614.41.132.64.796.672.7
LMa4-17B-16E-I59.659.471.871.621.410.735.019.399.699.7
Min3-14B-R49.048.650.043.437.29.538.25.696.883.1
OSS-120B65.664.676.870.010.60.91.41.699.851.9
Qw2.5-32B-I59.058.383.262.70.40.024.23.296.684.1
Qw3-30B-A3B-I59.055.170.844.53.00.73.81.396.465.3
Qw3.5-27B63.858.782.266.03.00.24.01.563.212.6
Qw3.6-35B-A3B60.453.081.855.75.41.14.60.593.270.2

Comments on the paper

2 comments

Dear reviewers,

Thanks again for your reviewing effort. We have carefully addressed your feedback in our response, including additional experiments, and believe that your suggestions have made the paper stronger. As the discussion period ends soon, we kindly ask if our response has resolved your concerns. If you have additional questions, please let us know.

Best regards, Authors

Dear Area Chair and Reviewers,

We thank you for your time and constructive feedback. We summarize below the strengths noted by the reviewers and how their concerns were addressed during the discussion. In the revised manuscript, changes are highlighted in gold (uMNo), blue (yEih), and violet (6GmE).

Strengths noted by the reviewers

  • uMNo: the paper addresses an important evaluation-design choice. The shared content and both option orders make the observed effect of the format useful for interpreting bias evaluations, and the separate ablations make the results more informative than a single forced-choice result.
  • yEih: the paper provides a good ablation, as it separates the isolated and comparative formats that existing benchmarks mix without control, and runs broad experiments.
  • 6GmE: the research questions are important and well structured, with experiments designed to answer them, and the findings show that the prompt has substantial effects on the results.

Concerns addressed during the discussion The references to sections, appendices, tables, and figures point to the revised manuscript.

  • Scoring of ISO (addressing uMNo W1, Q1): The parity of ISO is not produced by the estimator, as it is already in the raw answers (e.g., 9.3% vs. 9.0% of Yes for the two targets on BBQ), and CMP remains significantly higher in 37 of 50 model-benchmark pairs when ISO is scored as a forced choice (Appendix E.4).
  • Identical answers in ISO (addressing yEih W2): The models do not give a fixed answer in ISO, as the average share of Yes ranges from 9.0% to 84.4% across benchmarks (Appendix E.4, Table E.2).
  • Graded isolated judgments (addressing 6GmE Q1): With a 1-to-5 scale instead of Yes/No, ISO remains far below CMP (significant gap in 14 of 15 cases) and, where the gap is largest, the two targets receive almost the same raw ratings, so the parity is an effect of neither the binary answers nor the normalization (Appendix E.5; follow-up response to 6GmE).
  • Different tasks (addressing uMNo W1, yEih W2, 6GmE W1): ISO and CMP are different tasks by design, since existing benchmarks use the two formats interchangeably and the paper measures how this choice changes the conclusions. (Section 3.2; Table A.2.)
  • Interpretation of the claims (addressing uMNo W1, Q2): All results are now described as preferences elicited by each format, rather than as an amplification of latent bias.
  • Neutral option (addressing uMNo Q3 and 6GmE W2, Q2): When the neutral answers are included in the estimation of the bias, the bias decreases where models often abstain. Abstention therefore reduces the overall number of biased decisions, while the bias persists in the answers that select one of the two targets (Appendix E.8).
  • Choice of the metric (addressing yEih W1): The original metrics are tied to the format of each benchmark, while the comparison needs one metric for both formats, as now stated in Section 3.5. The original manuscript already validated our conversion against the original perplexity-based metrics (Appendix C).
  • Robustness checks (addressing yEih W3, W4, W5): The original manuscript already controlled positional bias with both option orders, verified that the 5-token limit without CoT does not change the results, and reported the 95% confidence intervals in the plots. We added the parse failure rates. (Section 3.4; Table E.7; Figures H.1-H.4; Appendix E.6).
  • Presentation (addressing yEih W6, W7): We removed the overlapping labels from the figures and moved the Limitations from the appendix to the main text (Figures 2 and E.1; Section 6)

Reviewer 6GmE stated that the additional results address much of the original concern and strengthen the paper.

Best regards

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.