- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper explores the generalization properties of neural networks when extrapolating to data that differ from the train set along different directions. They investigate this setting under a variety of symmetry conditions present in the training data generating process.
Critical strengths
- The paper tackles a relevant problem regarding the geometry of OOD generalization in neural networks
Critical weaknesses
- The paper is very clearly heavily written by Claude. While this alone is not disqualifying as a weakness, several AI prose issues (e.g. the introduction of definite descriptions like "The LayerNorm Model" on L062 without introducing their referents first, claudish sentence structures like L082-084 that bloat the paper, etc...) make the paper very difficult to interact with. This severely inhibits my ability to engage with the content of the paper.
Questions for authors
N/A
Thank you for the review. We take the point on the prose. The paper discloses that generative AI was used for drafting and polishing, and the responsibility for how it reads is ours. Your two examples are real defects:
In the revised PDF, now uploaded, we rewrote the introduction and §2 so that every model and term is introduced before it is used, with one claim per sentence, and shortened dense passages in §4 to §10. Changes are marked in blue.
Since the prose kept you from the content, a plain summary may help. A model can leave its training data in different directions. Along some, an architectural constraint such as rotation invariance fixes the answer. Along others, the model must extrapolate a law it learned from data. We measure the two separately and find:
We would be grateful if you would look at the content again with the revised text and engage with the paper.