- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors claim that the paper presents a solution for applying "ethical temporal logic" to a RL game based on Q-learning. In actual fact, it is very difficult to understand how the temporal logic techniques are actually applied to the problem taken into consideration (the authors reported only one equation without explaining it) and why the proposed solution can be considered "ethical" and lead to efficient training.
Critical strengths
- The area of using RL with "shields" is an interesting and active one.
Critical weaknesses
-
The definition of the problem is unclear. For example, the authors use fixed values of parameters that are not justified and the actual game itself is essentially not described in sufficient detail. The formal definition of the constraints is again very hard to understand. The authors report Equation 2, but it is not explained in terms of its structure. The equation also includes symbols that are not defined. The actual use itself of this equation is not discussed. The authors talk about "temporal logic", but thel definition of the "temporal logic" problem is not discussed in the paper.
-
Many parts of the manuscript are very hard to understand, somehow disconnected from the rest of the paper. The authors keep talking about ethical temporal logic, but this concept is not really defined. What could be considered ethical in the model the authors describe? The intuition at the basis of the proposed approach is very unclear: besides the aspect of ethics, why should the proposed approach speed up the learning in that specific case? Essentially, the authors present one case study: it is difficult to understand how the proposed model could generalise to others.
-
In Table 1, given the fact that the confidence intervals (?) are overlapping, there is no clear statistical advantage obtained by the proposed method. The interpretation of this table does not appear to be correct.
Minor comment:
- The illustration of the work-flow is also very unclear and somehow disconnected from the description of the approach described in the text.
Questions for authors
The reviewer has a negative view of this paper. Unfortunately, the major concerns expressed above cannot be addressed easily.