- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
This paper investigates the timestep weighting problem in diffusion classifiers. The authors find that task-specific weighting can outperform uniform weighting, while sample-specific weighting can further outperform a single shared weighting scheme. The authors also attempt to explain these observations through theoretical analysis.
Critical strengths
Both the experimental and theoretical analyses appear to be reasonably solid. I also find the research question meaningful for gaining a better understanding of diffusion classifiers.
Critical weaknesses
-
My biggest concern with this paper is that it still requires substantial editing, rewriting, and restructuring. I am not convinced that the current manuscript has undergone sufficiently careful revision and reorganization of the initial AI-assisted drafts (this is further supported by the authors' AI use statement). At least for me, the paper is very difficult to read, with many expressions and formulations that are unnecessarily complicated, uncommon, or difficult to follow. I believe the authors need to put considerably more effort into rewriting the manuscript so that it can provide clear and meaningful insights to the broader machine learning community, rather than merely presenting a collection of technically detailed results.
-
Another significant issue with the presentation is that nearly every paragraph in the experimental sections of the main text refers to results or discussions in the appendices. As a result, I do not find the main paper sufficiently self-contained. Moreover, the appendices span more than 50 pages and contain a large number of additional experiments, including failed or inconclusive exploratory studies, experiments only loosely related to the main research questions, and overly detailed implementation and verification records (e.g., the extensive descriptions of code versions, hashes, random seeds, execution environments, and verification procedures in Appendix Q). I do not think the manuscript in its current form is well suited to a conference with a nine-page main-text limit. The authors should carefully reconsider the organization and presentation of the entire paper, identify the most important contributions, and substantially streamline the remaining material.
-
Regarding the technical content, one potential concern is that the paper does not establish a convincing connection between its theoretical and empirical analyses. Most of the attempts in the appendices to validate the Gaussian assumptions for real diffusion models or connect the Gaussian theory to the observed behavior were unsuccessful. Furthermore, I feel that the connection to diffusion models is not particularly strong in some parts of the paper. The empirical analysis can largely be viewed as a general classifier aggregation problem, while many of the theoretical results are derived under assumptions or relaxations that are not specific to diffusion models. However, I would like to emphasize that this is not my primary concern with the paper. Even though there is a gap between the theory and actual diffusion models, I still believe that this type of analysis is meaningful and can potentially provide useful insights into the behavior and limitations of diffusion classifiers.
Finally, I would like to reserve my judgment on the novelty and significance of the paper's contributions to some extent. As discussed above, the presentation makes it difficult for me to fully identify and appreciate the key insights of this work. I do not rule out the possibility that the paper contains more substantial contributions than the current writing is able to convey.
Questions for authors
I do not have any further questions for the authors. My only request is that the manuscript, at least from my perspective, would benefit greatly from more substantial human revision and editing to improve its readability and clarity.