- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper tackles the task of learning on neural network weights. While previous methods use predictors with only a multiplicative probing component or did not normalize the inputs, this paper shows that subtracting a constant matrix from the layer, prior to learning to probe it improves the accuracy. Most of the gain simply comes from normalizing the matrixor using the value of the pretrained weights, although learning it is better.
Critical strengths
The task of predicting the function of a neural network just given a single layer is interesting, and can make understanding large neural populations far more efficient. The paper presents a very simple yet successful approach. It is super easy to implement. It makes perfect sense to me that centering the data prior to fitting an affine predictor should work. While it may seem obvious, previous approaches did not do it, so it is novel in my view. The empirical results are good. This appears to work. It is compared on suitable benchmarks and against suitable benchmarks.
Critical weaknesses
I think this paper is justifying its approach in an incredibly complex way. First, it used a general formulation of high moments of the matrix when it is only using first a second moment. Second, it is spending about 2 pages describing the training dynamics of finetuning, justifying something that is fairly obvious i.e, that function vectors are an useful quantity, which is very well established. Furthermore, the best results are obtained by learning the offset, and this does not seem too related to the theory. Furthermore, centering in machine learning is very well established, that a simple reference would suffice. Overall, I think the writing is a blocker. I think we need a occam’s razor, simplest story as opposed to a complex story and proofs that are not necessitated by the evidence. Specifically, if the story really is to predict layer attributes we first center the first and second moments, and then learn an affine classifiers then so be it! I can imagine the authors feared this may sound too simple, but this reviewer things that given that previous approaches failed to do it, it is novel. Also, the SoTA performance suggests it is significant. To me it would be compelling and simple. It will also surely be used by future approaches, as it is so simple.
As this is ICLR, the revision can actually make these modifications and still be reviewed. I would be ok even if the change is rather large, although note the AC and other reviewers may take a different view. While my pre-rebuttal rating is weak reject, I like the result and give a good revision I could be persuaded.
Questions for authors
Can you ake the story sharper and simpler? s there justification for the high complexity?
The authro revision improved the clarity of the paper and I can raise my rating to weak accept.
We thank the reviewer for reviewing our revision and for raising the score. Following the reviewer's suggestion, we simplified the story to match what the evidence supports, which substantially improved the clarity of the paper.