- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This work provides theoretical discussions on the usefulness of "external advice". The authors study this as a sequential decision problem along three axes: reliability, actionability and preservation. They first formalize the decision problem for certified and actionable deployment, then analyze the learner conditions for that to happen and finally construct some examples with a ridge-logistic model.
Critical strengths
I could not identify any, primarily due to the presentation.
Critical weaknesses
The paper is very opaque, hard to read and follow. For example, there are several terms mentioned in the introduction (such as "advice", "fallback", "level- reliability", "certification") that are not introduced or defined. This makes it very difficult to understand any discussion that happens there (e.g., lines 55-61). This pattern exists throughout the paper and makes it very difficult to understand what is going on and what the contributions of the authors are.
Questions for authors
As the paper is currently, it makes it very difficult to understand what is going on and I believe it would benefit greatly from a full rewrite by properly introducing all of the terms used, the problem setting and what the results of the authors are (ideally with accompanying intuitions to make things easier to follow). Therefore, my main question / request to the authors is to properly introduce all of the terms and settings that they use.