- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes a method that use the Hu's model as a backbone to estimate true image directly (instead of estimate noise) for diffusion model. It proposed to replace their transformer's token mixer and channel mixer with Volterra series. They also provide a dimension approximation rate for the optimal denoiser for the data on the manifold.
Critical strengths
It is new to use Volterra series in transformer to approximate true images for the diffusion model.
Critical weaknesses
- The paper uses flow-matching method, however, it substantially discusses the existence of approximation for the score , which is not needed for the flow-matching method. Also, the approximation rate proof is not novel enough. It follows from classical polynomial approximation/Stone-Weierstrass arguments and Tweedie’s formula has been substantially discussed.
- I feel the role of the manifold in the paper is quite limited. Especially when compared to this paper (not cited): Z. Zhang et al. Diffusion Model for Manifold Data: Score Decomposition, Curvature, and Statistical Complexity, https://arxiv.org/abs/2603.20645 Another relevant reference that is not cited is: M Chen, et. al. Score Approximation, Estimation and Distribution Recovery of Diffusion Models on Low-Dimensional Data, ICLR 2023, https://arxiv.org/abs/2302.07194
Questions for authors
For the diffusion model, the training step runs only for one randomly selected , the paper claims that their method is not an "analogy with sequence modeling." So, what is the different from the classical image denoising?
2 comments
Dear Reviewer,
We sincerely appreciate your time and valuable feedback. We have carefully addressed your concerns through detailed clarifications and additional information in our rebuttal.
As the discussion period is approaching its end, we would be grateful if you could take a moment to review our responses and let us know whether your concerns have been adequately addressed.
Thank you again for your time.
Response to 2PJP
Thank you for the review and the references.
W1. "The paper uses flow-matching method, however, it substantially discusses the existence of approximation for the score, which is not needed for the flow-matching method."
We agree that a score approximation is not needed, and the paper does not use one. The analysis is about the flow-matching minimizer itself.
We make this explicit at the start of Section 3.
W2. "Also, the approximation rate proof is not novel enough. It follows from classical polynomial approximation/Stone-Weierstrass arguments and Tweedie's formula has been substantially discussed."
Agreed, and the paper credits these tools. The new results are what is built on top of them.
W3. "I feel the role of the manifold in the paper is quite limited." (with reference to Zhang et al., 2026, and Chen et al., 2023)
Thank you, both papers are now cited. They study a complementary question, and the connection to our analysis is direct.
Q. "For the diffusion model, the training step runs only for one randomly selected [t]... So, what is the different from the classical image denoising?"
Each training step is a classical denoising problem. That is exactly why we derive the architecture from denoising theory rather than from sequence modeling.