- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes a pre-deployment procedure for auditing identity leakage in data collected for behavioral or clinical prediction tasks. It uses approximate Rashomon sets and Model Class Reliance to identify features consistently used by sampled near-optimal identity models, tests whether near-optimal target models can avoid them, and measures the target-accuracy cost of removing them.
Across ten public datasets, identity is predictable above chance from target-task features. On six datasets, feature removal reduces identity accuracy by 8.7-58.0 percentage points at a target-task cost of 0.4-14.1 points; on four high-dimensional datasets with substitutable features, the effect is limited. The results are further evaluated with TabPFN, alternative feature-selection methods, differential privacy, different Rashomon-set constructions, and personalization. The method is an empirical privacy–utility audit, not an anonymization or formal privacy guarantee.
Critical strengths
The paper addresses a practically important and underexamined deployment risk. It provides an interpretable workflow for measuring identity leakage in task-oriented features and explicitly quantifying the trade-off between reduced identifiability and target-task accuracy.
Critical weaknesses
The necessity and incremental value of the Rashomon analysis are not established. A single identity model selects highly similar feature subsets (median Jaccard 0.90) and is statistically indistinguishable from the proposed method on both tasks in three of five testable datasets. Moreover, the target-task Rashomon step does not directly determine the subsequent XGBoost removal curve. Thus, the central contribution appears to be a costly combination of existing tools without clear evidence that the Rashomon component materially improves the audit.
Key methodological choices threaten the validity of the main conclusions. The paper claims to identify features required by “every near-optimal identity model,” but flags a feature when this holds for only one model class; nearly all flags come from GAMs while near-optimal trees can avoid them. In addition, zero-loss models are assigned MR=1, potentially suppressing reliance precisely on near-perfect identity datasets, and feature selection is not fully nested with identity evaluation. Correcting these issues would require substantial reanalysis and could change both the flagged features and reported identity reductions.
Questions for authors
Given the median Jaccard similarity of 0.90 with single-model identity importance, what measurable benefit does the Rashomon analysis provide over the simpler baseline?
Why does the paper describe features as required by “every near-optimal identity model” when a feature is flagged based on only one model class and near-optimal models from another class may avoid it?
Why is model reliance set to MR=1 when the intact loss is zero, and how do the results change under a loss difference or smoothed ratio?
How do the results change under a fully nested evaluation in which held-out samples and subjects are excluded from feature flagging, removal ordering, and cut selection?
Why does the method remove every flagged feature when no step achieves the required identity reduction or favorable accuracy trade-off?
Thank you for your reviews. We are glad the problem came through clearly. For the ethics question, the release terms of all datasets we used permit this analysis, as documented in our ethics statement. We understand the issues we need to address, and your thoughtful comments point us toward what the next version of this work needs.