- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies multi-risk certification under a limited human annotation budget, aiming to determine whether a model’s risks are below their respective thresholds across all prespecified risk dimensions. The authors propose JointValid, which combines PPI++ risk estimation with an intersection–union test to control the global false-certification rate. The paper provides theoretical support for the allocation algorithm. Simulations and experiments on real-world datasets evaluate false-certification rates, statistical power, and allocation stability, providing empirical evidence of the method’s effectiveness.
Critical strengths
- The paper addresses a practically relevant problem: certifying that a model satisfies multiple risk constraints under a limited human annotation budget. By accounting for differences in certification difficulty across tasks, the proposed framework allocates annotations and improve the efficiency of model evaluation.
Critical weaknesses
-
The experiments provide limited evidence for the generality of the allocation gains. Improvements are substantial mainly on BeaverTails and modest on the other two datasets.
-
The motivation for task-wise budget allocation is not convincing. Labels for multiple risk tasks are often collected jointly for the same response. Also, once an annotator has read a response, providing labels for tasks does not necessarily cost times as much as labeling a single task. Therefore, the assumed additive per-task cost model may not reflect actual annotation workflows, and reductions in labels needed may not translate into comparable savings in human effort or cost.
Questions for authors
-
The clarity of the presentation could be improved. The paper introduces risk estimation, pilot-guided allocation, and final certification without a clear overview of how these components fit together. A workflow diagram showing the overall framework and distinguishing the roles of pilot and confirmatory data would make the method easier to follow.
-
Could the authors report the total human annotation budget required to reach the same target power at fixed risk thresholds by the proposed method and uniform allocation?
-
The comparison with the plug-in baseline does not appear entirely fair, as the posterior method also changes the risk and variance estimates. Could the authors provide a comparison using matched estimation procedures to isolate the contribution of posterior averaging?