- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies implicit input and output biases in unbiased Transformer FFNs. We find that in both Dense and MoE models, gate weights tend to align with the input mean, and that many neurons contribute to the output mean rather than a few neurons producing a constant output. We test these patterns using randomized controlled experiments and intervention methods, and show that a shared output bias explains most of the similarity between experts as measured by their average output.
Critical strengths
- The paper studies dense and MoE models and checks the findings from several angles. The randomized controls and intervention experiments help separate patterns in the learned weights from effects of the mean input alone. This gives more support to the observations than an analysis of trained models alone.
Critical weaknesses
- The presentation makes the findings difficult to understand. For example, because the analysis moves back and forth between average output and output at average input, it is hard to understand which quantity each experiment measures and which claim it supports.
- The functional significance remains unclear. While randomized control groups and demeaned-replacement experiments provide some evidence, they do not establish what computational role gate alignment and variance contributions play.
- The implications for expert redundancy are limited. While the paper shows that similarities between averaged outputs differ from those at common inputs, it does not show whether accounting for this difference changes existing conclusions about expert redundancy.
Questions for authors
See weakness.
Withdrawal and Thanks to the Reviewers
I would like to thank the reviewers for taking the time to read the manuscript and provide thoughtful and constructive feedback. After consideration, I have decided to withdraw the submission and take additional time to revise the paper and improve the clarity and presentation of this work. I sincerely appreciate the reviewers' time and effort.