- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper is studying something related to the cost of running a verifier in reinforcement learning.
Critical strengths
None
Critical weaknesses
The manuscript as presented does not satisfy basic scientific standards of communication.
- It is incredibly dense writing.
- The text does not clearly establish what it attempts to do or why.
- The main claim according to the text is that L015 "proxy calibration of audit certainty need not transfer across temporal structures for learning agents". After reading the text, it is still not clear to me what that means.
- Mathematical notation is not defined.
- Uncontextualized numbers are scattered everywhere. These may be referring to experiments that are not described or referenced.
- The experiments are missing proper descriptions as to what the experiments are trying to do and how.
The manuscript also seems that the paper is simply not finished since it references "earlier drafts" as if the reader should be familiar with them: L086 "Three negative results against our own earlier draft are stated where a reader meets the claim each retracts". Sentences like these are scattered throughout the text.
My review is not particularly detailed as the text is not readable. I believe extensive revisions are needed in terms of writing before it can be properly reviewed
Questions for authors
None