- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper considers a form of matrix-valued normalized updates which includes Muon-like iterations. The authors find that such a form may dot descent in a worst-case regime. Overall, I think this paper is based on an interesting observation, and therefore I lean towards an acceptance. However, I cannot provide a higher score since the realistic setting does not exhibit this damage.
Critical strengths
- Analysis around the Muon are pretty interesting.
- I think finding counterexamples for Muon is of great importance.
Critical weaknesses
I think this paper would benefit much with a polished writing. The message of this paper is clear, however, the organization and the wording of the paper is somehow confusing. Take the abstract as an example, the symmetric noise appears without any introduction. Similar situations happens many times. Besides, for the organization, I think the authors should first introduce the main results and then the details on how the result is constructed.
Questions for authors
I have no major concerns for the authors.