- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes HEAL, which is an inference-time method for reducing multimodal hallucinations.HEAL uses counterfactual interventions to classify attention heads and rescales related value vectors in the heads. The improvement ares upported by several models and benchmarks. The paper also argues that an imbalance within synergy heads helps explain hallucination generation.
Critical strengths
The improvements looks fairly broad to me, and I don't think its just because the answers got shorter. On LLaVA-1.5, HEAL bring sentence-level CHAIR down from 51.0 to 36.7, but response length stay roughly same and object recall even goes up a little (Table 1). Plus the extra models and robustness check in appendix, I'd say it's worth to try as a practical fix.
Critical weaknesses
1.Theorem 1 relies on a information measure that is additive and positively homogeneous. But the scores actually used in Equation 8–10 are difference of cosine similarities, and in general those doesn't have either property. The paper do mention a local approximation, but it never show when that approximation holds. So I'm not convinced that rescaling the value vectors really push the measured information ratio toward to the target. 2.The bidirectional interventions do show that shifting the balance between visual and language information change how much the model hallucinate. What they don't show is whether picking these specific head matters, beyond the general gain you get from reweighting visual information at all. A simple way to check this would be apply the same intervention, at similar strength, to same number of randomly chosen heads or non-synergy heads. That would test the author's explanation directly.
Questions for authors
1.After calibration, how close does the recomputed cosine-based information ratio actually gets to the target α? And does the approximation still holds across different head and generation steps? 2.If you calibrate the selected synergy heads, does that actually works better than apply the same intervention to a matched set of random head or non-synergy heads?
5 comments
Response 2 to Reviewer av3M
W2: The bidirectional interventions do show that shifting the balance between visual and language information change how much the model hallucinate. What they don't show is whether picking these specific head matters, beyond the general gain you get from reweighting visual information at all. A simple way to check this would be apply the same intervention, at similar strength, to same number of randomly chosen heads or non-synergy heads. That would test the author's explanation directly.
Q2: If you calibrate the selected synergy heads, does that actually works better than apply the same intervention to a matched set of random head or non-synergy heads?
We agree that it is necessary to distinguish the benefit of calibrating synergy heads from the general benefit of visual reweighting in arbitrary attention heads. We conduct a controlled comparison among three intervention strategies: (1) randomly selected heads, (2) non-synergy heads, and (3) the synergy heads identified by HEAL. All three strategies use exactly the same number of heads as well as comparable intervention strength (the target is set to 0.5). The decoding configuration is kept identical across all settings.
Table R3: Performance comparison on Qwen2.5-VL-7B when intervening different groups of heads.
| POPE F1↑ | LLaVA-Bench↑ | |
|---|---|---|
| Baseline | 87.4 | 76.8 |
| Random Heads | 87.8 | 77.1 |
| Non-synergy Heads | 87.5 | 75.9 |
| Synergy Heads | 88.4 | 78.5 |
We observe that random-head calibration provides some improvements over the baseline, suggesting that visual reweighting can have a general mitigating effect. However, calibrating the synergy heads identified by HEAL achieves consistently greater improvements. Additionally, calibrating non-synergy heads has a tiny increase in POPE F1, but a decrease in LLaVA-Bench score. Non-synergy heads include visual, language and redundant heads. For visual heads, they don’t need visual reweighting, because they are already visual-sensitive enough. Calibrating redundant heads has little influence on the output. For language heads, intervening on them may damnify the general linguistic expressiveness, which may have a negative effect on some overall metrics, like the LLaVA-Bench score.
These results provide further evidence for the importance of the proposed synergy-head identification and support our central claim that hallucination is associated with information-distribution drift within these heads.
Discussion Window Coming to Close
Dear Reviewer av3M,
Thank you again for your valuable comments!
As the discussion phase is coming to a close, please let us know whether we have satisfactorily addressed your concerns and questions in the revised version. If you have any further questions, please feel free to raise them. We are expecting you to re-consider our work.
Many thanks,
Response 1 to Reviewer av3M
We thank Reviewer av3M for the thoughtful comments. We address each concern below.
We want to explain this question from two perspectives.
From a theoretical perspective, we derive an approximation error bound for the implemented cosine-based scores. The idea is to use a second-order Taylor expansion around the original, uncalibrated point, and explicitly account for the nonlinear deviations from the desired scaling. The deviation between the recomputed α and the target α for every head or step is bounded by
\leq \frac{ (1-\alpha)\varepsilon_{v} +\alpha\varepsilon_{l} }{ \left| I_{v}^{ori} +I_{l}^{ori} -\varepsilon_{v} -\varepsilon_{l} \right| }.$$ where \$ \varepsilon_{v} \:= |$\left.\frac{\partial I_{v}^{cal}}{\partial\beta}\right|_{(1,1)} - I_v^{ori}$ (\beta-1) \$ \$ \+ \left.\frac{\partial I_{v}^{cal}}{\partial\gamma}\right|_{(1,1)}(\gamma-1)| \$ \$ \+\frac{L_{\mathrm{v}}}{2}\left[(\beta-1)^2+(\gamma-1)^2\right], \$ \$ \varepsilon_{l} \:=|\left.\frac{\partial I_{l}^{cal}}{\partial \beta }\right|_{(1,1)}(\beta - 1) \$ \$ \+ $\left.\frac{\partial I_{l}^{cal}}{\partial\gamma }\right|_{(1,1)} - I_l^{ori}$(\gamma -1)| \$ $+\frac{L_{\mathit{l}}}{2}\left[{\left(\beta -1\right)}^{2}+{\left(\gamma -1\right)}^{2}\right].$ This is a per-head, per-decoding-step bound and its numerical tightness depends on the local derivatives and curvature of the cosine-based scores. From an experimental perspective, we directly compute MAE between the recomputed $\alpha$ and the target $\alpha$ for different heads and generation steps. Specifically, we sample decoding steps at intervals of 10. In each sampling, we divide synergy heads into groups of 50. In each group, we report MAE between the average recomputed $\alpha$ and the target $\alpha$. Table R1: MAE between the recomputed $\alpha$ and the target $\alpha$ (0.4) on Qwen2.5-VL-7B. ||1|2|3|4|5|6|7| |-|-|-|-|-|-|-|-| |10|0.032|0.061|0.093|0.015|0.021|0.057|0.108| |20|0.015|0.056|0.052|0.102|0.023|0.007|0.043| |30|0.096|0.004|0.081|0.012|0.021|0.045|0.001| |40|0.052|0.009|0.026|0.073|0.057|0.054|0.034| |50|0.081|0.038|0.088|0.017|0.097|0.075|0.032| Table R2: MAE between the recomputed $\alpha$ and the target $\alpha$ (0.5) on LLaVA-1.5-7B. ||1|2|3|4|5|6|7| |-|-|-|-|-|-|-|-| |10|0.002|0.013|0.106|0.068|0.029|0.042|0.051| |20|0.103|0.075|0.021|0.072|0.058|0.037|0.023| |30|0.046|0.035|0.088|0.021|0.017|0.107|0.032| |40|0.072|0.059|0.036|0.104|0.028|0.074|0.014| |50|0.001|0.028|0.046|0.005|0.053|0.033|0.098| These results provide a direct empirical assessment of whether value-space calibration moves the information ratio toward the target. Most errors are within the range of 0.005-0.095, which demonstrates that the calibration generally moves the information ratio toward the target, though the vector rescaling isn’t very exact.