- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
In this work, the authors illustrate that data pruning in an equitable fashion across represented subgroups can lead to unequal performance across subgroups with the final model. They motivate that this is an important phenomenon to address as conventional "average performance [metrics] alone [do] not reveal whether the resulting savings [from pruning] affect all demographic groups equally." After describing this problem and relevant notation, they show that it arises theoretically using "the standard power-law relation between data quantity and excess risk" and demonstrate that it holds empirically in most of the cases they evaluate in an audit (while attributing results in cases where it does not hold to large amounts of available data and relative dataset balance compared to the other cases). They additionally propose EquiPrune, a pruning method to address the shortcomings of demographics-blind pruning. Via ablation study of its three components, they find that the data retention floor component is most impactful in mitigating unequal performance while maintaining data efficiency (in addition to being demographic agnostic), but the other two components (which handle retention and rescaling of relevant subgroups) also help with this mitigation (though they are not demographic agnostic). They conclude by summarizing their work and its impact while acknowledging that improving the components that currently require demographic information is appropriate future work.
Critical strengths
This work tackles an important problem by proving that the problem exists theoretically and empirically, and they follow this analysis with an algorithm that takes major steps towards remedying the problem. Moreover, they perform ablation analysis of their proposed solution to study which parts of their approach are most impactful, and they additionally explore a setup with multiple protected attributes per example (not traditionally the norm in algorithmic fairness research). The experimental setup more generally is sensible and explores a Cartesian product of datasets, models, and optimization schemes.
Critical weaknesses
The primary drawback of this work is that its prose and organization were not always easy to understand. In particular, Figure 1, "the paper in one picture", is text-heavy and squeezed into the top corner of page 3 and only referenced on pages 4 and 5 despite serving as a visual summary of the work. Similarly, they describe the math behind their audit and proposed algorithm in Section 3 while they describe and analyze their experiments in Section 4. While this is not an incorrect approach, it was confusing to read about how "The audit yields a clear target: the pruner that saves the most also harms the most" and learn how EquiPrune works before seeing any of the results or supported/refuted hypotheses or predictions.
The authors also make use of several remark/point organization systems throughout their work (e.g., R1,R2 for research questions and for different hypotheses). Individually, these systems are helpful, but the authors use them simultaneously in a way that is sometimes confusing (e.g., in Section 4, "(D3) Exposure is equal... is accepted...In the worst regime, Black loses 5.07 AUC points against 3.29 for White, and across datasets the largest loss falls on a minority group (Figure 3, Appendix C.3), as prediction (P2) of Proposition 1 expects...The repair closes the loop: the demographics-blind floor alone, which bounds only how much is removed, passes R2 in five of nine regimes..."). Furthermore, it appears that this work would benefit from line breaks while introducing these systems and new ideas (e.g., the bolded "Fixed pre-registered decision rules." in Section 4 appears to be a paragraph header, but it itself is buried in the introductory paragraph of Section 4).
Lastly, it was clear to me that AI tooling was used to draft and organize this paper before I read the authors' statement asserting this. This in itself is not grounds for rejection, but one could also argue that sentences like "Data pruning is sold as a free lunch: the same accuracy for less data. We asked who pays for it.", headers like "Who is compromised, and what comes back", and other parts of the main body could have benefited from polishing and human review. This said, I found the abstract and Introduction strong and easy to read (to the extent that I am unsure whether AI assistance was used in drafting those sections). However, the portions with more obvious AI use, in conjunction with the organization issues mentioned above, are noticeable drawbacks of the work.
Questions for authors
I have the following questions for the authors beyond the points I mentioned above:
- To your knowledge, do the distance metrics used as fairness metrics also run into statistical bias noted by Lum et al. (2022)?
- How are (certain) hyperparameters for EquiPrune chosen?
- For instance, why is 0.15? ( makes sense of 0.9 in the group-retention quota rule, but nothing is said about the absolute retention floor rule at least in the main body of the work)
- I am aware of sensitivity analysis of these parameters, but it appears was chosen a priori. How was this determination made? (More of a justification in the main body would also be welcome)
4 comments
Response to Reviewer o6aE (2/2)
Q1. Do the distance-based fairness metrics suffer from the statistical bias noted by Lum et al. (2022)?
To the best of our knowledge, yes, in principle. ES-AUC, DPD, and DEOdds are spreads of noisy per-group estimates, so in finite samples they are biased toward larger disparity, most for small groups. Worst-group AUC is biased downward. Two features of our design limit the effect: every comparison is paired on the same test set and groups, and "Unknown" and very small groups are excluded from all gaps.
To check this directly, we estimated the bias of every run with a bootstrap (App. N). We resample the test patients with replacement 200 times and recompute the metric each time. The average difference between the resampled values and the original value estimates the bias, and subtracting it gives a bias-corrected value. All numbers below are in AUC points ×100.
- What the bias is. The bias of ES-AUC is negative: −0.75 points on average for the unpruned baseline. In other words, finite-sample noise makes the measured ES-AUC about 0.75 points lower, i.e. the model looks slightly less fair, than it would with an unlimited test set. This is the effect Lum et al. describe.
- Why it matters little for our conclusions. Our claims are about differences between a pruned model and the unpruned baseline on the same test set, not about absolute ES-AUC. The bias is about the same for both: −0.64 for B-PAS and −0.72 for EquiPrune, against −0.75 for the baseline (averages over all runs of each method). When we subtract the baseline from a pruned model, the two biases almost cancel; what remains is about 0.1 point, far smaller than the effects we report.
- What happens after correction. We recomputed each difference from the bias-corrected values. For B-PAS on FairVLMed/R50+SGD (8 seeds), the change in ES-AUC relative to the baseline goes from −4.84 (uncorrected) to −4.88 (corrected), and the change in worst-group AUC from −5.60 to −6.60. Both are still clear losses, and the corrected losses are slightly larger. The same holds in the other regimes: no conclusion changes.
The uncorrected numbers in the paper therefore, if anything, slightly understate the harm. We report the corrected values in App. N.
Q2. How were EquiPrune's hyperparameters chosen; in particular, why φ = 0.15, and how was it chosen a priori?
- How φ was fixed. The floor was introduced after a preliminary run on FairVLMed/R50+SGD, in which B-PAS reduced the active set to 1–4 of 54 batches for the last ~80 epochs. We then fixed φ = 0.15 (9 of 54 batches) before the nine-regime study and did not tune it per dataset or on test results. We have corrected Appendix B.4, which described all three values as chosen before any experiment.
- What the floor is for. Our new analysis (App. O) shows that B-PAS's harm arises when it empties its active set and stops training at epoch ~108, while the learning rate is still at ~47% of its peak. The floor's main job is to keep enough batches for training to complete its schedule. Even a very small floor does this: φ = 0.05 (3 batches) already lands at −0.04 ES-AUC in the sensitivity sweep (App. K). The sweep is noisy at small floors (φ = 0.10 lands at −0.80), so φ = 0.15 adds a safety margin above that region while keeping ~56% savings.
- The trade-off. Above that point, φ is a savings–safety dial. φ = 0.40 keeps more data at 43% savings, and φ = 0.15 keeps 56% (App. K). For practitioners, we suggest choosing φ so that the smallest protected group keeps a minimum number of samples per epoch, φ ≥ N_min / n_smallest-group.
- γ = 0.9 and c = 5 are flat across their plausible ranges in the same sweep (γ ∈ [0.70, 0.95], c ∈ [2, 100]).
We will move this justification from the appendix into the main text, where EquiPrune is introduced; the supporting analysis is in App. O.
Response to Author Rebuttals
I thank the authors for their engagement with my feedback and updates made to the draft in response to my comments. The reorganized paper is much clearer, and I appreciate the blue text highlighting crucial insertions. However, there are still a few paragraphs where additional line breaks could be helpful if allotted space allows for them (e.g., in the "Two hypotheses, and the instrumentation that separates them" paragraph to emphasize the hypotheses and the falsifiable predictions). As a more minor point, some of the blue text does not have adequate spacing before the normal text it follows (e.g., in the abstract, "modular wrapper that operates at the pruning decision stage to preserve sufficient training exposureand to let training complete its schedule"). Given that these lingering issues are minor, I will retain my overall positive score.
Follow-up Response to Reviewer o6aE
We thank the reviewer for the engagement, thoughtful review, and constructive discussion. The remaining suggestions and some other minor issues have already been addressed, and they are reflected in the updated manuscript. We expect the final version to be more organized and complete based on the overall discussion. We thank the reviewer again for helping us make the manuscript better.
Response to Reviewer o6aE (1/2)
We thank the reviewer for the positive assessment and for the detailed, actionable feedback on presentation. We answer the three weaknesses together, since they all concern how easy the paper is to read, and then the two questions.
W1–W3. Organization, overlapping labels, and wording that reads as AI-generated.
We agree with all three points, and we apologize for the wording. Phrases such as "Data pruning is sold as a free lunch… We asked who pays for it" and headers like "Who is compromised, and what comes back" were our attempt to make the trade-off concrete through analogy. We agree they came across as stylized rather than precise, and they did not suit a technical paper.
We went through the text. We replaced rhetorical phrasing with plain statements and made headers say what the paragraph contains, using the abstract and introduction, which the reviewer found clear, as the reference style. For example, the opening of the conclusion now reads "Data pruning is usually judged by how much data it saves at the same average accuracy. We studied how these savings affect demographic subgroups." The header "Who is compromised, and what comes back" is now "Per-group effects", the Figure 1 title "The paper in one picture" is now "Overview: the pruner, the audit, and the repair", and the guardrail summaries "Never train on almost nothing" and "Count what is left more heavily" now read "Keep a minimum amount of data" and "Up-weight the remaining data of under-retained groups". We also fixed several small inconsistencies and garbled sentences found during this pass.
Based on the complete discussion, we will address all the remaining points, and we will use the additional page to organize the paper better.