- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper classifies user prompts into one of the 16 AIR 2024 Level-2 risks or a non-harmful class. It builds Risk Atlas by mapping 23 public datasets to AIR Level-2, using native labels or an LLM judge, and adds judge-filtered synthetic prompts (§3.2–3.3, p.3). It then trains Pharos, a DeBERTa-v3-base classifier (§3.4, p.3). Pharos reaches 0.753 Level-2 macro-F1 on a source-stratified test set, ahead of released guards and same-data decoders (Table 3, p.6).
Critical strengths
- Models trained on the corpus are nearly tied on binary F1 (0.975/0.970/0.969) but separate at Level-2 (Table 3, p.6). This shows that binary metrics hide category errors. It is the paper’s main useful finding, but it confirms an expected effect of target-taxonomy supervision.
Critical weaknesses
-
Limited novelty. Distilling LLM labels and LLM-generated harmful prompts into a small DeBERTa is the recipe of HarmAug (Lee et al., ICLR 2025), which the paper does not cite (§2, p.2). It also omits Markov et al. (AAAI 2023), who built a taxonomy-driven multi-category moderation classifier. The main change is a 17-class label space instead of a binary one. The dataset crosswalk cannot offset this, because Risk Atlas is released only on request (p.7) and is not analyzed (W2).
-
Unverified labels and an uncharacterized dataset. No human verification is reported anywhere:
- Labels come from native mappings or the judge (§3.2, p.3).
- Synthetic prompts are filtered by a model (App. C, p.11).
- The audit covers only deterministically mapped items, which never needed the judge (§4.2, p.4).
The paper also reports no judge-label share, no per-category distribution, and none of the per-source error analysis it motivates (§1, p.1). Since the same judge labels both training and test data, Table 3 largely measures agreement with that judge.
Questions for authors
Clarifications:
- What fraction of test labels is judge-assigned, and do the Table 3 rankings hold on the native-mapped subset? (W2)
- Were any labels checked by humans? If so, what were the guidelines, the annotators’ background, and their agreement with the judge? (W2)
- Beyond the label space, how does the method differ from HarmAug? (W1)
Suggestions:
- Report per-category and per-source statistics, add a human-annotated test subset and a source-held-out split, and ablate the synthetic data.