- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper applies an existing statistical certificate to bound the fraction of harmful responses in filtered fine-tuning data. It studies how filtering removes safe responses to harmful prompts and proposes certifying harmful-prompt and benign-prompt groups separately.
Critical strengths
The manuscript reports certification failures, fallback selections, and settings where stratification worsens results, making these failure cases visible.
Critical weaknesses
-
The writing makes the paper extremely difficult to understand. The abstract and introduction compress methods, results and causal explanations into dense sentences, repeatedly switching between properties of the dataset and behavior of the trained model. Basic claims require substantial reconstruction before they can be assessed. I find this presentation frustrating: the reader should not have to piece together what is being proposed, what is guaranteed and what the experiments actually establish. For example, the abstract contains: "We bring to fine-tuning data a distribution-free certificate: given any scorer and a few hundred human labels, it returns a cutoff whose kept set is at most an α-fraction harmful with probability 1−δ, or refuses". No human reader can interpret what this sentence means unless they read the entire paper and appendix and then come back to the abstract and read it over and over again! That is not how an abstract should be!
-
The results do not show benefits of the proposed method. Table 2 changes the label budget from 400 to 800 and replaces a 10% harmfulness target with separate 20% and 15% targets while introducing stratification. These changes prevent attributing the improvement to stratification, which also performs worse on the aligned 8B model in Table 3. Safety evaluation relies entirely on automatic classifiers; Table 20 shows similar credit-limit advice receiving opposite safety labels without a clear improvement in the response. Meanwhile, unchanged ROUGE-L on 229 prompts does not establish unchanged helpfulness: word overlap does not measure factual accuracy or usefulness. Matched comparisons and human validation are needed.
-
The claims about when certification can succeed need correction. Proposition 2 incorrectly states that reliable certification is impossible when the harmful fraction equals the allowed limit. For example, a set with 10 harmful examples out of 100 satisfies a 10% limit, and checking every example confirms this. The interpretation of failed certification is also too strong. Even with all labels known, the procedure stops after its first selection fails: keeping the top 15 examples could include 2 harmful ones (13.3%), while keeping the top 20 could include the same 2 harmful ones (10%). The first selection fails, but the second meets the requirement and is never checked. Therefore, failure of this procedure does not establish that the scorer cannot produce a qualifying selection.
Questions for authors
-
Effect of stratification: Which reported comparison separates the effect of stratification from the additional labels, looser harmfulness targets, and changed training-set size in Table 2? What evidence attributes the improvement specifically to stratification?
-
Meaning of the evaluation results: What substantive safety difference explains the opposite labels for similar credit-limit advice in Table 20? What evidence supports the claim of unchanged helpfulness beyond ROUGE-L similarity to reference answers?
-
Proposition 2: Should the impossibility condition require the harmful fraction to be strictly greater than the target? At equality, labeling the entire finite pool should allow certification. Would this correction affect any proofs or reported label-budget calculations?
-
Interpretation of certification failure: For the reported failures, was it verified that no candidate threshold meets the harmfulness target, or did the procedure simply stop at its first failed test? These outcomes support different conclusions about the scorer's ability.