- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper perhaps gives an improper learning algorithm for nonnegative sums of () bias-free ReLU units under standard Gaussian inputs and noiseless labels. With probability at least it returns a polynomial hypothesis satisfying $ |H-F|_2 \le \epsilon|F|_2, $ with from Theorem 1.1. The paper however does not provide a proper context such as settings, definitions of used terms, related work neither any experiments and appendices. On a side note, based on its AI use statement it looks AI has generated the whole paper with authors taking responsibility for it.
Critical strengths
Derived results may be possibly correct under certain (not mentioned) circumstances. It is impossible to check paper's soundness, validity and contributions without definitions and assumptions, that are not stated. Thus I have not even tried, see weaknesses.
Critical weaknesses
Abstract is already confusing and it is hard to understand its meaning first hand, e.g.,
"...The guarantee holds for arbitrary nonnegative weights and ridge vectors, including coincident and antipodal directions. The central step estimates a small, label-observable covariance at each degree. Aligning its factor with the hidden ridge tensors gives a low-rank comparator for tensor-train rounding; ..."
Missing context, settings, related work and goal of the paper makes this paper impossible to evaluate for the conference. There are no experiments and appendices with additional information either.
Without a massive, major remake, I found the paper not ready for publication in its current form.
Questions for authors
See above.
2 comments
I thank authors for the proposed changes. Current revision of the paper seems like a new paper, yet I still find it unsatisfactory clear, e.g., what does that even mean to learn from just for starters? This is a first sentence of the abstract: ("We study learning a positive sum of k ReLUs, ... from noiseless examples with Gaussian inputs ."). Further, a lack of broader motivation and missing experimental evidence for proposed algorithms, etc., provides more than enough ground for rejecting the paper for the current edition of the ICLR conference. I maintain my previous recommendation.
Response to Reviewer yMCs
We agree that the submission lacked the setting, definitions and context a reader needs. The revision supplies them.