- Rating
- 1
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This submission explores the application of diffusion models to weight generation for vision models (CNN and ViT). The authors explore the influence of dataset composition and architecture of the generative model on the generated samples. Potentially most interestingly, they compare average performance across sampled weights with a top-1 metric, concluding that high performance might be driven by tail events rather than the bulk of the distribution.
While the contributions that the authors claim to make are interesting, I found the manuscript exceedingly hard to parse to the extent that it impacts my ability to verify the soundness of the results (e.g., due to many undefined terms and insufficient explanations in the main text). As I was, despite repeated efforts, not able to convince myself that this paper makes a significant and sound contribution, I cannot champion this paper and recommend rejection.
The research questions that the authors ask are interesting and the contributions (as listed in the abstract and contribution section) could be impactful for the weight space learning community. Especially, the result that reported accuracy in weight generation might be driven by tail events is interesting.
I found the paper extremely hard to parse to the extent that I am unable to thoroughly verify critical parts of it. It took significant effort to understand the experimental setup and evaluation in detail. This is partially due to the large number of undefined terms throughout the manuscript, and partially due to a writing style that aims to be overly concise.
I do not have any questions to the authors that would materially affect my assessment of their work.
Critical strengths
The research questions that the authors ask are interesting and the contributions (as listed in the abstract and contribution section) could be impactful for the weight space learning community. Especially, the result that reported accuracy in weight generation might be driven by tail events is interesting.
Critical weaknesses
I found the paper extremely hard to parse to the extent that I am unable to thoroughly verify critical parts of it. It took significant effort to understand the experimental setup and evaluation in detail. This is partially due to the large number of undefined terms throughout the manuscript, and partially due to a writing style that aims to be overly concise.
Questions for authors
I do not have any questions to the authors that would materially affect my assessment of their work.