- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper proposes studying the stability of a distribution when its scores suffer a Gaussian perturbation. The main goal is to find a deviation inequality for the "non linear" residue of the log evidence. This is done in theorem 3.1.
The rest of the paper concerns discussing theorem 3.1 and its application to decision theory as well as providing some numerical illustrations on the tightness of the bound.
Critical strengths
The paper is concern with an important problem. Also, the main theorem is a nice result of interest for the community.
Critical weaknesses
I found the paper extremely hard to read. A lot of the definitions are re-explained with words and conversely some of the maths are done only with phrases and could benefit of formal definitions. Also, the paper discusses at length things that are relatively easy in my opinion while some other slightly more complicated things are done really fast. For example, in section 3.2 the authors discuss the fact that the Taylor remainder depends on the actual value that is being approximated, and this takes the same length as the section 3.1 where the authors use several (granted standard) concentration inequalities.
Another intriguing phrase is what appears in the beginning of section 3.3, namely phrase 145. The authors have already explained that it is not needed to introduce a covariance, namely in line 092, but here they introduce it. This covariance will not be used in the next lines at all, thus it begs the question of why stating it just before the main theorem ?
Corollary 3.2 is also extremely puzzling. The authors define a quantity for all . Then the implication seems to be true only for , namely equation 10. But it is not stated that they chose the q for before the conclusions, only after ! So the reader is uncertain of what does the result actually means and has to delve in the really entangled proofs to understand.
Some other terms are really hard to understand, such as : (155-156) "The theorem is therefore stronger than the local quadratic approximation: it retains the same Gamma benchmark ...". I have no idea what is a Gamma benchmark, even if I might suspect what it is...
Section 4 starts with the phrase "The proof tracks". It has not yet been explicited the proof of what. While we guess it is the proof of the main theorem, it shows well that we are always wondering if we are on the right track when reading this paper. I could not understand, even after several tries, the structure of the proof of theorem 3.1. There is a section in the appendice that has this name, but also section 4 seems to be trying to provide a roadmap of the proof.
Questions for authors
See above
Awaiting Your Feedback on Our Rebuttal
Dear Reviewer cc9j,
Thank you again for your review. As the discussion period is drawing to a close, we would appreciate it if you could take a look at our rebuttal. We would be happy to clarify any points or address any remaining concerns while the discussion is still open.
Best regards,
The Authors