- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper claims to propose a new conformal prediction method for early exits in neural networks.
Critical strengths
I don't see any strength in the paper.
Critical weaknesses
The paper is terrible in organization and textual clarity, and it doesn't even have a figure explaining the main contribution. I don't do research on conformal prediction but I reviewed some conformal works earlier and I could understand and make helpful comments for them. However, this paper is nowhere close to being readable, and it looks totally AI-written, to be honest; see the ethical section for that. Some examples I listed here, and there are many more in the paper: 1 - claims without citation in the intro, see line52 2 - acronyms without explicit forms; see abstract, section 4.2 3- notations without definitions, see everywhere!!!! 4 - one line paragraphs, see section 3.4 5- No explanatory figures! 6 - Jumping from one topic to another without coherent transitions; see everywhere, especially related works. The list goes like that but I won't spend more time than the authors writing the paper for this paper.
Questions for authors
I don't have any questions
2 comments
Unfortunately, you should have written a readable paper before the deadline. Otherwise, everybody can submit an unfinished draft and edit the paper after the rebuttal. The rebuttal is not for rewriting the paper, and even with the current changes, the abstract is not readable and contains unnecessary details. About the ethics flag, I don't claim you fabricated the results or AI came up with the idea etc. but it's very apparent that AI wrote most of the text (not edited, directly written) and your statement sounds misleading to me. I let AC decide about the ethics flag.
Thank you for the direct feedback. We accept the criticism of the presentation. The submitted version was hard to read, and we have rewritten it. For each example you gave:
Claims without citations in the introduction: citations added. Acronyms not spelled out (abstract, Section 4.2): every acronym is now expanded at first use, including EENN, AVCS, FyS, CALM, PABEE, APS, RAPS and DKW. Undefined notation: every symbol is now defined before it is used. One-line paragraphs (Section 3.4): merged. No explanatory figure: the new Figure 1 shows the whole method. Weak transitions, especially in Related Work: rewritten so that each paragraph leads into the next.
On the ethics flag. We understand why a hard-to-read paper raises this concern, and we want to answer it directly. As our AI Use Statement says, generative AI assisted with manuscript organization, prose revision, and mathematical review. The research itself is ours. The method came out of our own experiments: our first version calibrated a separate set at each layer, a diagnostic showed that these sets were not nested, and the running maximum at the center of the paper was our fix. We also dropped an earlier certificate-based method after the simpler construction beat it in every run. The authors are responsible for every claim, proof and number in the paper. We agree that the submitted text read poorly, and we hope the revised version is clearer.