- Rating
- 1
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper proposes CASTLE, a method for learning under multiple safety constraints and checking when those constraints are satisfied. It distinguishes constraints the agent can influence from conditions outside its control and redundant constraints. CASTLE combines a smooth safety check for controllable constraints with a direct check for uncontrollable conditions. The authors derive a threshold for the smooth check and evaluate the method in three simulated control environments.
Critical strengths
The paper makes a useful distinction between a safety penalty used for training and a certificate used to declare a situation safe. The weighted bound and its associated conditional soundness guarantee provide a mathematical basis for constructing such a certificate.
Critical weaknesses
The empirical conclusions are inconsistent with the reported results. Section 5.1 claims that CASTLE achieves the best safety–performance trade-off on SafeConf. However, Table 1 reports lower mean success and higher mean cost for CASTLE (0.89, 0.12) than PPO-Lagrangian (0.97, 0.09) and DENSSE-LSE (0.97, 0.11). These results do not support the claimed superiority. The safety-audit counts are also inconsistent: counting certified-but-unsafe steps over all predicates should yield at least as many as counting only controllable predicates, but the Product baseline reports the reverse, including 259 versus 518 on SafeNavC. These discrepancies undermine confidence in the central empirical conclusions.
Questions for authors
Could the authors reconcile the claimed safety–performance improvements with Table 1 and clarify the definitions and aggregation of CBU and CBU_all? Which numbers or conclusions require correction?