- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes GTSR for training diffusion models on long-tailed datasets. GTSR aims to preserve tail-class semantics and prevent semantic drift toward other classes by penalizing the normal displacement of generated samples from the target tail-class subspace. The paper also presents theoretical analyses of rebalancing strategies and provides geometric motivation for the proposed regularization. Experiments are conducted on CIFAR-10, CIFAR-100, and Tiny-ImageNet.
Critical strengths
The proposed regularization method appears intuitively effective in improving the quality of tail-class samples, although several issues with the evaluation need to be addressed. Overall, the paper is reasonably clear and understandable.
Critical weaknesses
-
My major concern is the reported FID scores. I noticed unusually low FID scores on CIFAR-10, including tail-class, head-class, and overall FID. In particular, the overall FID of the vanilla DDPM reported in this paper is 1.44, which is highly unexpected, considering that the original DDPM achieves an FID of around 3.0 on balanced CIFAR-10. More importantly, the models in this paper are trained on severely long-tailed datasets. The reported FID is even substantially lower than that achieved by the original EDM trained on balanced CIFAR-10. Another related observation is that the vanilla DDPM results reported in this paper on CIFAR-10 and CIFAR-100 (1.44 / 3.78) are significantly better than those reported in the CORAL paper (6.17 / 7.70). How exactly are the FID scores computed in this work? I find these results particularly concerning, as they substantially outperform established baselines trained on balanced datasets. I believe the authors must carefully investigate and explain these discrepancies, especially the FID evaluation protocol.
-
Even setting aside the concerns about FID computation, I find the cFID results reported in the main text somewhat misleading. According to the description in the paper, the reported metric should be , which should be explicitly indicated in the tables. Moreover, I do not think comparing only against competing methods such as CORAL and CCUA provides a sufficiently comprehensive evaluation. A method could potentially improve tail-class generation quality at the expense of head-class performance. Therefore, I believe overall FID should also be reported for all competing methods, as is commonly done in prior work.
-
I am not sure why the authors maintain the memory banks and class prototypes through dynamic updates. It seems that these quantities could be precomputed before training. In particular, since the proposed regularization is applied only to tail classes, which contain relatively few training samples, such precomputation should be straightforward. Both the clean training samples and the feature extractor are fixed, so I do not see a clear necessity for dynamically updating these quantities. Could the authors clarify the motivation and benefits of this design choice?
-
The theoretical analyses in Section 3 also appear rather elementary. Sections 3.1 and 3.2 do not seem to provide much new insight. In particular, regarding Section 3.2, I question whether adjusting the class-label sampling distribution at inference time to increase the frequency of tail-class outputs is a practically meaningful or commonly adopted strategy. Section 3.3, on the other hand, essentially establishes that if the initial point is sufficiently close to the data manifold and the normal component of the trajectory velocity is controlled, then the trajectory remains close to the manifold over a finite time interval. While the authors use this result to motivate the proposed regularization, the actual regularizer is applied to the denoised sample rather than the normal component of the trajectory velocity. The connection between these two quantities is unclear, and the theoretical result does not seem to directly justify the proposed regularization.
Questions for authors
I hope the authors can carefully address the concerns regarding the experimental evaluation. In particular, the unusually low FID scores require a thorough explanation. A more comprehensive comparison with existing methods would also be appreciated. Although I also have concerns about the theoretical analysis, I do not consider them the primary issues that need to be addressed at this stage. My main concern is the validity and reliability of the experimental results.