- Rating
- 2
- Confidence
- 2
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper investigates whether Continued Pretraining (CPT) can improve model safety by learning shared knowledge and reasoning capabilities across different safety tasks. The authors propose CapCPT, which first performs Knowledge CPT on factual accounts and safety explanations generated from web documents, followed by Capability CPT on non-QA documents and QA reasoning trajectories to learn five safety capabilities. Experiments show that CapCPT improves performance across multiple safety benchmarks while largely preserving general capabilities. Ablation studies and downstream SFT/GRPO experiments further demonstrate the contribution of different training components and the transferability of the learned safety capabilities.
Critical strengths
The paper views safety training as learning shared knowledge and reasoning capabilities across tasks, rather than treating each task as an independent alignment problem. This perspective is valuable for improving transfer across safety tasks and supporting subsequent safety alignment training.
Critical weaknesses
The paper emphasizes improving multiple safety tasks by learning shared safety reasoning capabilities. However, the current ablations do not fully isolate the contribution of reasoning trajectories. Although the paper includes token-matched CPT baselines, these baselines differ in data sources and generation procedures. Could the authors provide a comparison using the same data generation pipeline and matched token budgets, but without explicit reasoning trajectories, to clarify whether the improvements come from learning shared safety reasoning rather than additional synthetic safety supervision?
Questions for authors
See Weaknesses.