- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes NoiseAR, a method that learns a prompt-conditioned initial noise prior for diffusion models. Instead of sampling noise from a standard Gaussian distribution, NoiseAR uses an autoregressive model to generate noise patches sequentially. The model predicts the mean and variance of each patch based on previous patches and text conditions. It is trained using noise samples obtained through a Weak-to-Strong inversion procedure. The probabilistic formulation also allows further optimization through DPO and GRPO using image-level feedback. Experiments across several diffusion models and benchmarks demonstrate improvements in image quality and text-image alignment.
Critical strengths
-
Interesting research direction. The paper explores learning a conditional initial noise distribution rather than modifying the denoising process. This offers an alternative approach to improving controllable image generation without changing the pretrained diffusion model.
-
Flexible probabilistic formulation. NoiseAR uses autoregressive modeling to capture spatial dependencies between noise patches. Its explicit probability distribution also supports preference-based and reinforcement learning methods such as DPO and GRPO, making the framework flexible for further optimization.
-
Encouraging experimental results. The paper evaluates NoiseAR on multiple diffusion models and benchmarks, including SDXL, DreamShaper, Hunyuan-DiT, and Qwen-Image. The results show improvements over standard Gaussian initialization and Golden Noise on several image quality and alignment metrics. The additional cross-model experiments and reward-based fine-tuning results further demonstrate the potential of the approach.
Critical weaknesses
-
Insufficient ablation of the autoregressive design. The main contribution of the paper is learning a conditional initial noise prior using an autoregressive model. However, the ablation studies mainly focus on patch size and network depth. There is no direct comparison with simpler alternatives, such as independent patch-wise Gaussian modeling or non-autoregressive conditional models. Therefore, it remains unclear whether the performance improvements come from autoregressive modeling or simply from learning a prompt-conditioned noise distribution. This weakens the justification for the core architectural design.
-
Limited comparisons with existing initial noise optimization methods. The experiments mainly compare NoiseAR with standard Gaussian initialization and Golden Noise. However, several relevant methods, such as InitNO and ReNO, are discussed in the related work but not included in the experiments. A broader comparison would help establish the advantages of NoiseAR in generation quality, computational efficiency, and generalization. Without these comparisons, it is difficult to fully assess its effectiveness relative to existing approaches.
Questions for authors
How does NoiseAR maintain compatibility with the Gaussian prior assumed by pretrained diffusion models? Since NoiseAR learns a prompt-conditioned initial noise distribution, the generated noise may deviate from the standard Gaussian distribution used during diffusion model training. Could the authors analyze the statistical properties of the learned noise, including its mean, variance, and distributional differences from a standard Gaussian? It would also be helpful to clarify whether such deviations affect generation diversity, sample quality, or generalization across diffusion models.