- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper is difficult to read due to convoluted prose and poorly defined words, which prevents me to reliably assess the proposed idea.
As far as I understand, the paper is working on finding the optimal intensity of degradation operations (e.g., downscaling, blur) used to learn a robust neural representations of images (and music audio). This is seemingly done by training a neural network architecture on varying degradation operators and intensity levels, and measuring some robustness metrics. It appears that different operators have different effects on the network's robustness. For example, the curve for downscaling operator shows a threshold-like behavior, with sudden drop in task performance at some intensity level, whereas gaussian noise degrades task performance gradually. Additionally, it seems that "transition landmarks" can be estimated from each operator's curve, but this landmark is poorly defined in the manuscript.
Critical strengths
There might be some strengths that I have missed, but unfortunately I could not properly understand what the manuscript is proposing.
Critical weaknesses
The manuscript in its current form has poor clarity. At the most granular level, the words and the grammars make sense. But when read at sentence-level, the combination of words often don't make sense. At paragraph-level, it is hard to identify what is being argued, and the logic of the arguments. The readers often have to infer the meaning of a sentence.
Below I put a small set of examples just from the introduction, but this issue persists throughout the manuscript.
- (L038) "... and all three must be redone for every new operator set, every new task, and every new coupling; none computes a schedule from measurable properties of its operators."
This is the first paragraph of the introduction. Operator, task, coupling, and schedule are not defined. Each word can easily have multiple interpretations depending on the fields.
- (L046) "... but with landmarks no existing account locates --- with a reproducible valley and recovery peak across five seeds."
Landmark, valley, recovery peak are not defined. One might infer that this is a performance-intensity curve's valley and peak only after reading Section 3 and 4.
- (L047) "The decision-relevant layer is larger... self-matched nearly-optimal anchors lose 4-31 R@1 points.... shifts harsher as deployment hardens"
What do decision-relevant layer, self-matched, R@1, and deployment mean? What attribute is being measured by "larger", "harsher", and "hardens"?
- (L053) "Measurement already delivers one surprise before any prediction is attempted: operator classes turn out to be measured, domain-dependent facts, not a priori labels..."
What kind of prediction is this?
The lack of clarity prevents me from fully understanding the manuscript, and therefore I cannot reliably assess the informativeness and soundness. My recommendation to reject is primarily based on the clarity.
Questions for authors
A major rewriting is needed to make sure the readers can understand what the paper is proposing.