- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3(+1)
Read review
Paper summary
This paper primarily investigates how different probability aggregation rules—specifically when combining human and AI predictions within a hybrid decision-making system—affect group disparities in mean predicted probabilities. Using linear fusion (an additive approach) as a reference, the authors examine the Log-odds Pooling method, while noting that the proposed framework theoretically accommodates general aggregation rules. They analyze the difference between the group disparities produced by this method and the linear reference; this difference is defined as HDDI, the paper's core metric, which quantifies the group-level disparity deviation from additive aggregation. The authors further establish the fundamental properties of HDDI through two mathematical propositions: that group disparity under linear fusion is a weighted sum of component disparities, and that HDDI can equivalently be expressed as the difference in mean individual-level fusion deviations between groups.
In the experimental section, the authors first use the ACSIncome dataset to confirm that HDDI behaves as mathematically predicted and responds to controlled variations in simulated human predictions. Next, using the Civil Comments dataset, they examine conditional HDDI in identity-sensitive text moderation scenarios and its statistical recoverability across different sample sizes. Finally, using COMPAS data derived from observed human judgments, the authors demonstrate that nonzero HDDI persists when human probability inputs are based on actual human judgments rather than simulations, while also showing that its magnitude depends on how these judgments are represented probabilistically.
Critical strengths
-
The research addresses a problem of scientific value: Hybrid decision-making systems involving both humans and AI are increasingly widespread yet entail substantial risks regarding fairness. Since different decision aggregation rules can lead to varying group disparities in mean predicted probabilities, the HDDI metric proposed in this paper offers a method to measure such potentially fairness-relevant deviations relative to an additive reference, providing a valuable perspective on issues in hybrid decision-making systems.
-
The experimental design is robust and logically sound: The paper provides a clear mathematical definition of HDDI and validates it through a comprehensive series of experiments—ranging from verifying the metric's properties under controlled conditions to analyzing conditional disparity deviations and statistical recoverability in text moderation, and finally assessing its applicability using observed human judgment data. The experimental design demonstrates a clear, progressive logic that offers reasonable empirical support for the proposed diagnostic metric within the scope of the study.
Critical weaknesses
-
The core definition of HDDI rests on premises that lack robust justification, and it lacks validation regarding generalization across different aggregation methods: HDDI’s calculation uses linear fusion as a reference point; while the authors mathematically demonstrate that linear fusion provides a clear additive component reference, they do not sufficiently justify why this reference is particularly meaningful for fairness diagnosis. Although the authors do not claim that linear pooling is optimal or normatively preferable, I remain unconvinced that deviations from this reference have sufficiently clear practical significance for fairness diagnosis. While subsequent experiments validate HDDI’s computational properties, the fundamental significance of the metric itself remains insufficiently articulated. Furthermore, although the theoretical framework is defined for a broad range of integration operators, the empirical evaluation uses log-odds pooling as its only nonlinear operator, alongside a linear-pooling control; the extent to which the observed patterns hold under other nonlinear rules remains untested.
-
The experiments do not encompass "human-AI collaborative hybrid decision-making systems" in interactive real-world settings: HDDI is designed for such collaborative systems, yet the paper merely utilizes "actual human judgment data" from the COMPAS dataset, performing a post-hoc mathematical aggregation of these judgments with calibrated COMPAS probabilities rather than investigating the actual decision-making process within a collaborative context. In an interactive human–AI system, humans might accept AI suggestions, adjust their judgments based on the interaction, or selectively adopt AI outputs—or at least remain aware of their role within the system. Consequently, this post-hoc aggregation does not establish HDDI’s applicability to deployed interactive human–AI decision-making, leaving its external validity in such settings open to question.
-
HDDI’s relationship to fairness is largely indirect, and its practical diagnostic value has not been sufficiently substantiated: Although the paper provides a comprehensive account of HDDI’s proposal, definition, mathematical properties, and validation, it fails to directly demonstrate the added value of this metric for addressing fairness issues in hybrid decision-making systems. For instance, the authors themselves acknowledge that a non-zero HDDI value does not necessarily indicate unfairness, nor does a zero value guarantee fairness. Thus, the paper’s current status is best characterized as proposing a computational metric, HDDI, and demonstrating its ability to measure—as intended—deviations in group disparities (relative to an additive baseline) arising from different aggregation rules. However, while the paper demonstrates that HDDI captures information distinct from final group disparity, further analysis and discussion are still needed regarding how these deviations should be interpreted, under what circumstances they hold practical significance, and what new diagnostic insights they offer compared to traditional fairness metrics. Of course, this does not conflict with the paper's aforementioned strength; HDDI indeed provides a method for measuring these potential fairness-related disparities, yet the paper still needs to further articulate the unique value and role of this measurement capability within the context of practical fairness research.
Questions for authors
-
Beyond the mathematical arguments already presented in the paper, could the authors further explain the rationale for choosing linear pooling as the reference? In particular, what specific significance does this reference have for fairness diagnosis in hybrid human–AI decision systems?
-
Could the authors provide a concrete example from the existing experimental results to illustrate what additional fairness-related diagnostic insights HDDI offers beyond directly examining the group disparities of the human, AI, and final hybrid systems? In particular, how should the practical significance of HDDI be interpreted, given that a nonzero value does not necessarily indicate unfairness?
3 comments
Response to Authors
I appreciate the authors' clarifications and additional experiments. While I remain somewhat uncertain regarding the specific practical scenarios and the real-world application value of the paper, these responses have addressed most of my concerns; therefore, I have decided to raise my score.
Thank you for taking the time to reconsider our work. We sincerely appreciate your thoughtful feedback and recognition of our revisions. Your suggestions have been very helpful in improving the paper.
Thank you for your thoughtful review and for recognizing the motivation and experimental design of our work. We appreciate your concerns about the choice of reference, the practical value of HDDI, and its applicability beyond the settings originally examined. We have uploaded a revised manuscript, with changes highlighted in blue. We have clarified the rationale for using additive pooling as the reference (Section 3 and Appendix A). Its group disparity is exactly the weighted combination of the component disparities, and it can also be interpreted as the expected prediction under group-independent random source selection. This gives HDDI a clear component-based benchmark without assuming that additive pooling is optimal or inherently fair. To make the diagnostic value more concrete, we added a risk-stratified ACSIncome analysis (Section 5.1 and Appendix D). In the primary setting, aggregate HDDI is −0.000378, while pooled-weight standardized HDDI is +0.000600. Only the lowest AI-risk quartile shows a clearly nonzero local deviation after simultaneous adjustment. This suggests a practical audit follow-up: examining the subgroup where the departure is detectable rather than relying on the aggregate result alone. We also added an audit-prioritization analysis, which shows some setting-dependent screening benefits while making clear that these findings do not establish an effective fairness intervention. We further extended the evaluation to learned hard routing (Sections 4–5 and Appendix C), allowing us to examine an instance-dependent integration rule beyond fixed-weight log-odds pooling. We have also clarified that COMPAS uses observed human judgments combined post hoc, rather than observed human–AI interaction. We believe these additions better explain both the value and the current scope of HDDI. Thank you again for your constructive suggestions; they helped us strengthen the paper and present its contribution more clearly.