- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates the properties of initial noise in generative models and challenges common assumption that Gaussian property must be preserved with non-Gaussian initial noise example. The paper further demonstrates that having coherent spatial structure in initial noise degrades output quality. In initial noise optimization algorithms, the paper connects these observations to the existing Muon optimizer, using momentum orthogonalization to improve reward–quality trade-offs in initial-noise optimization.
Critical strengths
- I find the investigation into non-Gaussian initial noise particularly interesting. The observation that generative models can tolerate substantial deviations from Gaussian distributions while maintaining generation quality is insightful.
- The experiments showing that different spatial arrangements of the same noise values can lead to dramatically different generation quality are also interesting.
Critical weaknesses
- While the analysis of spatial structures in initial noise is interesting, the connection between these observations and the choice of Muon remains somewhat indirect. It is unclear whether this theoretical motivation fully explains the observed improvements in generation quality
- Although the paper provides examples of structured momentum emerging during optimization, it remains unclear how consistently these harmful patterns arise across different prompts, reward models, and optimizers, and to what extent their suppression explains Muon's performance improvements.
Questions for authors
- How consistently do harmful spatial patterns emerge during reward-guided optimization across different prompts, reward models, and optimizers?
- Is mitigating reward hacking one of the intended goals of using Muon for initial noise optimization? If so, are there direct empirical results demonstrating that Muon reduces reward hacking compared with existing methods? If not, do the authors expect Muon to be effective against reward hacking, and why? It would be interesting to investigate whether suppressing harmful spatial structures also improves robustness against reward-model exploitation, like maybe comparing with DNO (PRNO)
3 comments
Thank you
Thank you very much for the detailed response, additional experiments, and revisions.
I find the non-Gaussian source analysis interesting, and I think the newly added Appendix E provides further evidence that momentum is an important component to investigate in noise optimization. The additional experiments also help strengthen the motivation for the proposed approach. Overall, I appreciate the authors' efforts in addressing my concerns, and I will raise my score.
Additionally, I have one minor comment regarding Appendix G. I find the experiment of using momentum directly as initial noise somewhat confusing, since momentum is not used as the initial noise during the actual optimization process. That said, I understand the authors' intention to isolate and visualize the potentially harmful structure in momentum. Perhaps explicitly clarifying the diagnostic purpose would make its results easier to interpret?
Thank you very much for your encouraging follow-up and helpful suggestion. We would like to address your remaining concern with the new examples in Figures 26 and 27.
Our intention in using normalized momentum as initial noise was to show that these vectors carry structure that is harmful to generation when used as a source. As you rightly point out, this diagnostic alone does not show how such patterns affect generation when momentum enters through small updates during optimization. We have made this diagnostic purpose explicit in Appendix G.
We therefore added Figure 26 to show this process directly. We would particularly appreciate your attention to the yellow-highlighted latent and incoming rows. The two runs use the same model, prompt, and initial latent. In this comparison, Muon is obtained by adding momentum orthogonalization to SGDM while keeping all other optimization settings, including update RMS, fixed.
Under SGDM, strong patterns in the incoming vectors visibly accumulate in the latent as the generated sailboat loses realism. Muon's raw momentum also contains strong patterns, but orthogonalization substantially weakens them in the incoming vectors. Correspondingly, its latent shows very little visible coherent structure, and the generated sailboat remains realistic throughout the displayed trajectory. This comparison illustrates how suppressing incoming patterns before accumulation helps preserve image quality during actual optimization.
Figure 27 extends this view across the full FLUX.1/Aesthetic experiment set. The largest singular value and low-frequency energy fraction capture complementary aspects of concentration, reflecting different features of the underlying patterns. Both increase in SGDM's latent, alongside substantial deterioration in all three held-out rewards. With Muon, concentration is reduced in the incoming direction before each update, and latent concentration stays close to its initial level. The target reward rises steadily while the mean held-out scores remain near or above their starting levels. These trajectories show the same pattern of reduced accumulation and better reward–quality behavior beyond the individual example in Figure 26.
Taken together, Figures 19 and 21 in Appendix E suggest that stronger suppression of momentum patterns tends to yield better reward–quality trade-offs in the tested settings. In particular, Figure 21 shows that flattening improves upon clipping, while Figure 19 provides an intuitive visual comparison of how these operators weaken patterns in the same momentum snapshot.
We are thankful for the time and care you have devoted to reviewing our work, and sincerely appreciate your thoughtful assessment. We hope these additional examples address your remaining concern and make the practical role of momentum processing clearer.
Thank you for your thoughtful review. Harmful momentum patterns consistently arise in our experiments, motivating our investigation of source properties and the resulting Muon update.
[W1] From source observations to Muon
We clarify below the connection between our source observations and the resulting Muon update.
Generators tolerate broad non-Gaussian entry-wise distributions (Section 3.1) but can fail under coherent arrangements of the same entry values (Section 3.2). Singular spectra capture forms of concentration without requiring Gaussian marginals (Section 4.1). To prevent a few singular components from dominating each update, we flatten momentum's singular values while preserving its singular vectors (Section 4.2; Appendix E explains why we process momentum instead of the latent). This yields Muon's orthogonalized update (Section 4.3).
If there is a particular step in this connection that the reviewer still finds indirect, we would greatly appreciate any clarification so that we can address the concern more precisely.
[W2, Q1] Consistent harmful momentum patterns
To answer this question, we added Appendix G with six pages of randomly sampled examples across two generators and three rewards, including a VLM-based reward. The examples were selected entirely at random, with no cherry-picking. Using the observed momentum as initial noise severely degrades generation under the same prompts. In our experiments, further random sampling has consistently revealed the same harmful momentum patterns. We would be happy to provide additional randomly sampled examples if the reviewer would find them helpful. These observations motivate suppressing such structures in the momentum, as illustrated by the singular-value flattening in Figure 7.
[Q2] Reward hacking and existing methods
Yes. Mitigating reward hacking, understood here as increasing the target reward at the expense of image quality, is an explicit goal of our work. Our submission compares against MPGR, What Is Noise, and GPER, which all address harmful latent structure and were introduced after DNO/PRNO (Tang et al., ICML 2025). In particular, MPGR and GPER also report improved reward–quality trade-offs over PRNO in their evaluations.
We additionally provide the suggested PRNO comparison on FLUX.1/Aesthetic (Figure 8, Table 11). PRNO's best tested Aesthetic mean is 6.786, whereas Muon reaches 7.986 with comparable or higher means on all three held-out rewards. Adding PRNO leaves the conclusion unchanged: Muon achieves a better reward–quality trade-off in this comparison.