- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies how different sampling settings affect social bias in diffusion language models. Changing block length, remasking strategy, and the number of tokens generated at each step changes both the bias scores and which model appears less biased. The paper also tests whether ARLM debiasing methods work on DLMs. These methods reduce bias, but the results still vary across sampling settings, suggesting that DLM-specific generation settings should also be considered when evaluating and mitigating bias.
Critical strengths
-
The paper systematically compares different sampling configurations across three DLMs. Showing that these settings change both bias scores and model rankings is useful for fairness evaluation across different models.
-
I like that the paper includes mitigation as well as evaluation. The transferability of ARLM debiasing methods to DLMs is an interesting finding.
-
The mitigation experiments show that reducing bias and reducing variation across sampling settings are not necessarily the same. Some fairness terms help with both, which is useful for understanding what successful debiasing should achieve.
Critical weaknesses
-
Finding social bias in DLMs is not particularly surprising, given what is already known about bias in language models. The more interesting finding is how sampling changes that bias, why this happens, and how it differs from decoding effects in ARLMs.
-
I understand why the authors chose the short-answer task. However, the prompt still provides answer options, and evaluation uses the selected option. It is unclear how much this differs from multiple-choice evaluation, so the “open-ended” claim should be toned down.
-
Some mitigation methods substantially reduce variation across sampling settings. The paper should explain whether the remaining differences are large enough to matter, rather than focusing only on the fact that some dependence remains.
Questions for authors
-
Since the training data and model weights are fixed within each sweep, why do different remasking strategies produce different bias scores? Do you think this comes from generation order, parallel token prediction, or the amount of refinement?
-
ARLM bias also changes with decoding settings. What is different or specific to DLMs here?
-
How much of the bias difference across the three models might come from differences in their training data itself, rather than their diffusion generation process?
-
The prompt provides answer options. How is this different from multiple-choice evaluation? Did you measure bias in the reasoning as well as the final answer?
-
Do the findings extend to free-form generation without predefined answer options?
-
Based on your results, which sampling settings would you recommend to reduce bias, and what would be the cost in speed or answer quality?
4 comments
Response to Reviewer W54B (2/2)
This is the second part of our response, covering your questions.
Q3.1
Our results point to generation order and parallel token prediction (§2.1), rather than to the amount of refinement. We have added this analysis as §5.4.
Amount of refinement. LLaDA, LLaDA-1.5, and Dream-7B never remask a token once it is committed. The variation we observe therefore does not come from the amount of refinement.
Generation order and parallel token prediction. The trend differs between models.
On LLaDA and LLaDA-1.5, the bias score hardly changes with the remasking strategy in two settings: at TPS = 1, where each step commits a single token, and at B = 8 and TPS = 8, where each step commits a whole block and the strategy has no positions to choose from. In the other settings, the two strategies differ by up to .056 (Fig. 2). On these models, the bias score thus changes mainly when generation order and parallel token prediction interact.
On Dream-7B, in contrast, the gap is already present at TPS = 1 and is significant on high-validity configurations (see our response to Reviewer RTri, W2.1), so the order alone is sufficient there.
How the order changes the answer. Under random remasking, once the reasoning names one of the two subjects, the model follows it into the answer more often and answers "none" less often (see our response to Reviewer YtFv, Q1.1).
Q3.3
Differences in training data may well contribute to the differences in social bias among the three models. However, attributing these differences to their sources is outside the scope of this study. As stated in §1, our aim is to examine whether the sampling controls specific to DLMs affect social bias.
Q3.5
Yes. We repeated the sweep on two benchmarks without predefined answer options: CEB [1] (single-turn free-form generation) and FairMT-1K [2] (multi-turn free-form dialogue); see our response to Reviewer YtFv, W1.3. On both benchmarks, the bias score still depends on the sampling configuration (Fig. 6 in §5.3; Fig. 15 in App. G). The model ranking also changes, most clearly on FairMT-1K (Fig. 6, third row; Fig. 16). Our claim that "fairness in DLMs must be assessed across sampling configurations" therefore also holds for free-form generation.
Q3.6
As stated in §1, our aim is not to identify a single best sampling setting, but to show how much bias changes across settings. We then claim in the conclusion (§7) that "fairness in DLMs must be assessed across sampling configurations, both before and after mitigation".
On answer quality, Fig. 2 reports the box failure rate for every setting, and §5 evaluates the utility of the debiased models on GSM8K, IFEval, and MMLU. Sampling speed is outside the scope of this study.
References
[1] Wang et al. “CEB: Compositional Evaluation Benchmark for Fairness in Large Language Models.” ICLR 2025.
[2] Fan et al. “FairMT-Bench: Benchmarking Fairness for Multi-turn Dialogue in Conversational LLMs.” ICLR 2025.
Thank you for the detailed response. The new free-form experiments address my concern about whether the results depend on predefined answer options. The remasking analysis also helps clarify when token order and parallel prediction affect bias scores, even under greedy decoding.
My main concern is how much these findings add to prior work showing that measured bias depends on models and decoding settings. Is there any statistically significant consistent pattern found? I still find it unclear what additional findings or insights it adds to the existing literature. I am keeping my original rating.
Response to Reviewer W54B's follow-up comment
Thank you for reading our response and for acknowledging the additional analyses. We have accordingly revised the paper and indicate the changes in red text. In particular, we reorganized the related work (§6) and added §6.1, which compares our work with studies of decoding and bias in ARLMs.
To your question: yes, we find three consistent patterns. For each pattern, we state what we show and how far prior work had gone.
Pattern 1: The sampling controls specific to DLMs significantly change the bias score of a single model. We systematically evaluated the effect of the sampling controls specific to DLMs, taking confounding factors into account. This evaluation showed that, with the model weights and the decoding controls of ARLMs (temperature, top-p, and top-k) held fixed, the bias score of every model varies significantly across sampling configurations (§3.2; Fig. 2). We additionally verified that this is not specific to Open-BBQ and also holds on CEB and FairMT-1K (§5.3; Fig. 6). We also confirmed that it holds when restricted to high-validity configurations (Fig. 13a in App. E). Furthermore, we analyzed why the bias varies with the sampling configuration (§5.4).
Prior work had shown only that the bias of ARLMs varies with temperature, top-p, and top-k, which modulate sampling stochasticity. The sampling controls of DLMs instead change how generation itself unfolds and are chosen to set the speed–quality operating point, yet their effect on social bias had been examined only on a single task, primarily in the context of adversarial perturbations (§6.1, §6.3).
Pattern 2: The sampling configuration significantly changes the ranking of models by bias. On the practical question of which model is the most biased, we showed that the answer changes across sampling configurations on all three benchmarks (§3.2, §5.3; Fig. 13b and 13c in App. E). A fairness conclusion drawn from a single sampling configuration can therefore be misleading.
Prior work on DLMs had not examined whether a comparison between models is stable across sampling configurations.
Pattern 3: Debiasing lowers the bias but does not consistently reduce its sensitivity to the sampling configuration. We confirmed that mitigation strategies established for ARLMs transfer to DLMs and lower the bias, and observed that the sampling dependence can nevertheless persist after mitigation (§4.2; Fig. 3). Lowering the bias and reducing its sensitivity to the sampling configuration are thus distinct objectives. This changes what successful debiasing means: effective debiasing should maintain low bias across all sampling configurations.
Prior work had established these strategies for ARLMs only, where they are assessed by how much they lower the bias. To our knowledge, none had been applied to DLMs.
Together, these patterns lead to our message, which prior work on DLMs had not established, that fairness in DLMs must be assessed across sampling configurations, both before and after mitigation (§7). We appreciate that your review recognized these points among the strengths of the paper, and we hope this response conveys the value of our work.
Response to Reviewer W54B (1/2)
We thank you for appreciating that the paper covers mitigation as well as evaluation, and that reducing bias and reducing variation across sampling configurations are not necessarily the same. We respond to each comment below. To address each point fully, we reply in two parts. In the revised manuscript, the changes that directly relate to our responses are shown in red.
W3.1, Q3.2
We agree that how sampling changes bias matters more than its existence. Still, research on DLMs has focused on generation quality and sampling speed, and their social biases had not been evaluated systematically in published work (§1).
Why sampling changes bias. Two additional analyses address this, and we have added both to the revision.
Difference from ARLMs. The difference appears under greedy decoding: an ARLM then produces a single output and a single bias score, whereas LLaDA and LLaDA-1.5, which we decode greedily, still change their bias score across sampling configurations (Fig. 2).
Remasking strategy, block length, and TPS do not exist in ARLMs (§2.1), so their effect cannot be evaluated directly in ARLMs. Conversely, we have started an additional evaluation that applies temperature, top-p, and top-k to LLaDA. With these results, we will add to the final version an analysis of how the controls shared with ARLMs and the DLM-specific controls each affect social bias.
W3.2, Q3.4
We would like to clarify what "open-ended" refers to.
What "Open-ended" refers to in Open-BBQ. In Open-BBQ, "open-ended" describes the response format, not the answer space. Every item involves two subjects, and all three formats are scored over the same three options: the two subjects and "unknown" (App. A.1). In the original short-answer format, the model writes a free-form answer, and a GPT-4o judge is given the three options and maps the answer to one of them. The final answer is therefore selected from a closed set in the original short-answer format as well.
Our setting. As stated in §3.1, we use the short-answer format with a boxed final answer for three reasons.
That said, showing the options and requiring a boxed answer may themselves affect how social bias appears in the model's output. We adopted the short-answer format with a boxed final answer nevertheless, because the three reasons above make it necessary for a valid experiment.
Bias in the reasoning. We score bias on the final answer only, on which the BBQ bias score [1] is defined. We did not score the reasoning itself: in our pilot study, many reasoning traces could be read as supporting any of the three options, so they could not be labelled reliably (App. A.1). We did, however, analyse how the reasoning relates to the final answer: under random remasking, once the reasoning names one of the two subjects, the model answers "none" less often (see our response to Reviewer YtFv, Q1.1).
W3.3
Thank you for raising this point. We computed 95% bootstrap intervals for the variation that remains in LLaDA tuned with a lexicon-based fairness term, and confirmed that part of it is not statistically significant.
What we intended to convey in §4.2 is that (1) “lowering the bias and reducing its sensitivity to the sampling configuration are distinct objectives in DLMs”, and (2) “improvements in sampling robustness are not consistent across models and training objectives”. We have revised the text so that this claim is clear.
References
[1] Parrish et al. “BBQ: A Hand-Built Bias Benchmark for Question Answering.” Findings of ACL 2022.