- Rating
- 1
- Confidence
- 1
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The authors consider online learning problems in which exploration is unnecessary because the learner obtains the necessary information regardless of policy employed and provide analytical and experimental results.
Critical strengths
I am not sure this paper has any discernible strengths.
Critical weaknesses
My biggest concern is that I think there is a chance this is (at best) very lightly edited AI output of a low quality as far as human readability is concerned. This is in line with the acknowledgment of the authors that they used AI to draft and edit the paper. Possibly in part as a consequence of this, the paper has the following weaknesses.
W1) The paper is filled with hard to understand jargon, and that goes for all parts of the paper including the introduction. This one might be partly on the responsible parties which have assigned this review to me despite my marginal expertise on the topic and refused to reassign it, but at the very least I would expect an understandable high-level explanation of what the authors are trying to achieve with this paper.
W2) There is zero discussion in the paper of why the particular type of online learning problem studied in this paper might be or become relevant in practice.
W3) I would be very surprised if the technical arguments in the paper hold water, although I probably am not familiar with this area to really judge this.
Questions for authors
Q1) How are the various symbols defined that appear in the introduction?
Q2) Please describe the problem setup better. I gather from the language that it might be some sort of communication network, but it is absolutely not clear to me how it is laid out or what it does.
Q3) Why is the Related Work section in the end of the paper? The usual choice would be to have it at the beginning so it could be more explicitly contrasted with the contributions list.
Q4) What are the 1-3 most significant contributions of the paper? The actual contributions list is over half a page long with seven distinct items and no discernible emphasis.
3 comments
Thank you for the response. Can you please upload a revised version with changes compared to the original submission highlighted. Also, please clarify, what this sentence in the AI statement means: "the proofs in Appendices A.3, A.4, A.7 and A.8 have not been checked by an independent expert" -- have the authors checked these proofs or not?
Overall, I have to say I do not like the overall workflow that is becoming apparent with the thread of reviews and current version of the AI statement. The authors have AI write proofs, one of the reviewers points out flaws, then the authors have AI correct the proofs. It does seem to me as though the authors are mainly prompting the model and outsourcing an overly large proportion of the human work to reviewers.
Response to Reviewer uqUM: Highlighted Revisions, AI Use, and Author Verification
Thank you for your follow-up and for raising these important concerns.
Highlighted revision: We have uploaded a revised manuscript with new and substantially rewritten text highlighted in blue relative to the original submission.
AI use and proof verification: We have expanded the AI-use statement on page 9 to disclose Claude's contributions in detail. The authors personally checked the equations, assumptions, and reasoning in the proofs in Appendices A.3, A.4, A.7, and A.8, with AI assistance. This was author-led verification, not independent external review; no external expert has verified these proofs. The cited results from Asmussen (2003) and Borovkov (2013) were checked only through secondary sources.
Research responsibility: We acknowledge that AI contributed substantially to drafting the corrections following Reviewer k2Ek's comments. We recognise that errors in the original submission placed an additional verification burden on reviewers, and we sincerely regret this. We agree that peer review should not substitute for author verification, and we do not expect reviewers to validate AI-drafted proofs on our behalf.
We take full responsibility for the manuscript, its mathematical claims, and any remaining errors. We appreciate your careful scrutiny and the opportunity to address these concerns.
Response to Reviewer uqUM
Thank you for the specific questions. Each is addressed in the revision.
AI use. We disclosed AI assistance in full under the ICLR policy, and the revised statement names the AI's main contributions and which proofs have not yet been checked by an independent expert. Every numerical result is produced by the released, seeded code, which regenerates all of them with one command; the solver behind them is validated against independent Monte Carlo. We accept the readability criticism and have rewritten the abstract and introduction.
Q1 (symbols in the introduction). The revised introduction describes every quantity in words before using its symbol; formal statements start in Section 3.
Q2 (setup). A sensor samples a randomly drifting signal at fixed intervals. It decides when to send its current value over a link that drops packets with unknown probability; failed sends are retried at a cost. The receiver is penalised for estimation error. The sensor must learn the signal's volatility and the link's reliability while choosing when to send. A figure is added.
Q3 (Related Work). Moved to Section 2 and contrasted directly with the contributions.
Q4 (main contributions).
W2 (practical relevance). Battery-limited sensors in IoT and networked control operate over lossy links with unknown statistics. Deliberate probing costs energy or accuracy, so it matters to know when probing is unnecessary and which plug-in rule is safe. A motivation paragraph is added.
W3 (technical arguments). Reviewer k2Ek identified two gaps in the proofs. The revision replaces both arguments, with details in our reply to that review. Limitations now states which results are proved in full, which are sketched, and which rest on a numerically verified assumption or a cited renewal-rate condition.