- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper studies the recently introduced model of PAC learning with "monotone adversarial corruptions." This model allows for an adversary to observe the usual iid training set S, along with the data-generating process (D, h*), and then inject correctly-labeled datapoints into S. S is then shuffled and presented to the learner.
The paper's primary result is that there exists a hypothesis class of infinite VC dimension that exhibits a sharp degradation in error rates from adversarial insertions to insertions. As the class has infinite VC dimension, this result holds in the distribution-family model, for certain instances that hold fixed the marginal distribution over unlabeled data. Various other properties of these particular learning instances are also explored, including the effects of identifying an iid datapoint for the learner.
Critical strengths
The paper's primary claims are stated precisely and appear to be sound.
Critical weaknesses
First, the paper is extraordinarily difficult to read. To my eye, it seems to have been generated entirely by an LLM and then left virtually untouched. The writing is constantly using jargon that has not been introduced yet, and I found the technical portions very difficult to follow. Even if its results were notable, I think the paper would need to be rewritten from scratch in order to be fit for publication. Consider the abstract. What is the role of in the second sentence? It does not appear in any property of the hypothesis class. What is an "honest insertion channel"? Why is an "exact transport characterization" being discussed? As with the rest of the paper, the writing is very clunky and quickly becomes hard to follow.
Second, the primary results seem very limited. They only concern the effects of monotone corruption for a specific class of infinite VC dimension on a particular easy-to-learn marginal. In particular, this means that the results: 1) Concern a hypothesis class that is nonlearnable in the usual distribution-free setting; 2) Hold for only particular distribution-family instances, that are constructed ad hoc. I would consider this to be insufficient for publication at a tier-1 conference such as ICLR, COLT, NeurIPS, etc.
Questions for authors
I found the paper nearly impossible to read. On line 51, how can I interpret "At high levels of our class, a target is almost constant"? On lines 75-77, how can I interpret "Product panels provide an exact efficient conditional sampler"?