- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper asks about input frequency fourier transform analysis on MLPs trained on modulo arithmetic (somewhat missing from the title). This setting was studied by He et al (https://openreview.net/forum?id=aVh9KRZdRk). Whereas the previous paper showed magnitude and phase influence at the neuron level, this paper shows that initial power of embeddings affects an entire network of paired MLPs output with domination at a few frequencies. The paper also checks whether this extends to transformers (positive for prediction, not for manipulating).
Critical strengths
- The paper extends previous work in showing: a . The Fourier power of init embeddings predicts the dominating final network frequencies, for modular arithmetic and both bottlenecked MLPs and transformers b. Changing the initial power affects the fequency selection for tied quadratic MLPs (but the main claim was not reported as holding for transformers)
- I would like to commend the authors on the execution of the experiments. Care was taken with seeds and splits to ablate the effects correctly. The authors were also careful to report what worked and what didn't.
Critical weaknesses
It is perhaps subjective, but, to begin with, the question of Fourier fequency over modular arithmetic seems to have limited scope, as the setting seems particularly structured for Fourier, and generalizations of insights are unclear. Due to this, I feel that the incremental value of the paper should be relatively high with respect to previous work.
- Network level prediction and determination results are useful extensions to He et al, but the previous paper already I feel covered magnitude and phase dependencies, so most of the conceptual value was there.
- The title overstates, as causality is shown only for tied quadratic MLPs on modular addition. I don't think that this is just nitpicking, as the accurately framed title would underscore the relative limitideness of the results.
Questions for authors
- The modular arithmetic task is favorable to Fourier. Could you please show more general positive results in terms of scope?
- He (see above) already analyzed magnitude and phase dependencies at the neuron level. Could you please highlight the conceptual delta regarding it?
- While the title implies MLP causality in the title (via "steers"), the paper seems to actually establish this for tied quadratic MLPs on modular addition. Could you please explain how the paper supports the title?