- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The author measure relational geometry of the representation across different layer, and diffusion steps for image generative model. In particular, for latent state at each layer, the author construct the gram matrix and measure the cosine similarity between two layer’s gram matrix, and sum over across all layer and diffusion steps.
Critical strengths
The problem the author attempts to study is important: understand how representation of latent state evolve in the network or diffusion process. The result of high consistency leads to generation result with high inception score is interesting, but more analysis is needed, see weakness.
Critical weaknesses
- The writing is terrible. I felt like the whole piece is an AI generated report. Starting from the abstract, the author kept mentioning technical terms that doesn’t appear to be in any other literature, like “pathway” or “pathway consistency.” This is really tiring. Because of this, I recommend rejection of the paper. I think the author should withdraw this paper and rewrite the paper. And I do not think the rebuttal will change my decision.
- High pathway consistency result in higher inception score is an interesting phenomena. However, I don’t think this implies higher generation quality claimed by the author. High inception score just means the image generated by model can be more easily classified as a particular class, and this definition is consistent with the author’s visualization: high consistency pathway result in an imagenet like bird, while low consistency result in a bird with complicated background. Why is complicated background is a bad thing? I felt high inception score is kinda a bad thing because it reduce generation diversity. I think the author should frame their result as challenging the inception score as a generation quality metric, not that they improve the generation performance.
- More mechanistic analysis of low pathway consistency example is necesssary. What happened when the model generate a low pathway consistency? It means the representation keeps changing in the network, I think that actually means the network put in more effort to generate/refine that example, so what happened in the network, is it that the network start with proposal, and then refuse it in later layer, like the network start with parrot, and background of ocean, then change the ocean to sky because its not consistent with parrot. I think the low pathway consistency will be the interesting part for analyssi.
Questions for authors
N/A