- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper describes a dataset for diagnosing cultural biases related to religion, nationality, and socioeconomic status, called Cultural Counterfactuals. Moreover, a bias evaluation framework is presented to analyze cultural bias in over 9 million responses produced by LVLMs. The results highlight the usefulness of the Cultural Counterfactuals dataset for diagnosing context-dependent biases in multimodal models.
Critical strengths
None
Critical weaknesses
None
Questions for authors
I'm wondering if the authors can suggest some reliable methods for bias mitigation for LVLMs, based on the bias evaluation strategy from the authors.
Thank you for your positive assessment of our work and for recognizing the dataset's usefulness for diagnosing context-dependent bias.
To address your question, we tested three bias mitigation strategies: prompt instructions, representation steering, and counterfactual-consistency fine-tuning (LoRA). Steering and fine-tuning were fitted on training sets and evaluated on a held-out panel of 180 sets per dimension by whether they removed the context effect, preserved context recognition, and avoided collapsing person-to-person variation.
Prompt instructions. First, we tested the anti-stereotype instruction from our appendix pilot (telling the model not to use perceived nationality, religion, socioeconomic status, race, age or gender as evidence about a person, and to avoid stereotypes) against a length-matched placebo asking it to inspect the image carefully. On 180 sets per dimension for Qwen2.5-VL and Molmo-7B, it never significantly reduced salary disparity relative to the unmodified prompt; relative to the placebo, it helped only Qwen on nationality (15% lower disparity) and did worse for Molmo (23% and 46% higher disparity). Second, we appended a sentence restating that the job is in San Francisco (or the room in Seattle) and that where the photo was taken is irrelevant, tested across five models on 180 sets per dimension (Holm-corrected over 30 tests). Qwen kept 75% of its SES salary gap (person variation unchanged); InternVL3-8B (HF)'s SES gap fell by 56% only because all person-to-person variation shrank equally; Gemma-3's rent effects grew; and Molmo and LLaVA showed no measurable change.
Representation steering. On Qwen2.5-VL-7B, we recorded residual-stream activations at the last salary-prompt token for 1,700 training images outside the test panel and centred them within each counterfactual set to isolate context differences from the person. At inference, we projected out each dimension's per-context mean subspace (5, 7 and 2 directions for religion, nationality and SES) at every token position in layer 24 (selected over layers 8–24 on 20 validation sets per dimension), alongside a same-size random-subspace placebo. On the held-out panel, the SES gap falls from $14,972 to $713 and the nationality gap from $5,528 to $192 (classification within 1 point; placebo has no effect), but 96% of answers become $120k (vs. 69% before), between-person variation falls by ~75%, and the −$34k age gap disappears. Steering thus removes across-context disparities only by collapsing response diversity.
Counterfactual-consistency fine-tuning. To teach the model to give the same answer across contexts in a set while allowing different answers across people, we trained a rank-16 LoRA on Qwen2.5-VL-7B for 263 steps on the salary prompt using 600 religion and nationality sets whose persons and photos never appear in the test sets. Every image's target in a set was the (lower) median of the base model's own salary answers for that set across contexts and seeds, removing context variation while keeping each person's salary level.
On Qwen2.5-VL-7B, the held-out SES gap falls from $14,972 to $2,972, classification accuracy changes by at most 1 point, person-level variation is preserved (set-mean r = 0.91–0.92 with the base model), and MMBench accuracy is unchanged (0.870 → 0.870). Transfer to the untrained rent prompt is partial (−18% to −31%), which training on several judgment prompts may improve.
Counterfactual-consistency fine-tuning is therefore the most reliable method we tested. More broadly, our evaluation strategy maps different failure modes to different interventions: counterfactual-consistency fine-tuning when a model exhibits seed-stable context sensitivity (such as Qwen2.5-VL), output calibration when apparent sensitivity mostly reflects same-image seed noise (such as Molmo-7B or LLaVA-v1.6), and refusal-parity checks when safety-tuned models abstain at context-dependent rates (such as Gemma-4-31B). We also recommend evaluating any mitigation with person-level checks rather than a disparity score alone, because steering looks successful while collapsing the answers. We will add a short main-text "Implications for mitigation" paragraph and an appendix section with these new results.