- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes Epistemic GAN, a framework that incorporates Dempster–Shafer evidence theory into generative adversarial networks to improve diversity in generation. The discriminator is modified to predict separate belief values for real and fake samples, allowing the remaining belief mass to represent uncertainty or ignorance. The generator is also redesigned into two stages, where Dirichlet distributions are used to sample interval representations before producing the final images. The authors introduce corresponding loss terms to balance diversity and precision. Experiments on CelebA, CIFAR-10, and Food-101 show improvements in both FID and Vendi Score over a standard DCGAN baseline.
Critical strengths
- The idea of introducing evidential uncertainty into GAN training is interesting. Rather than addressing mode collapse solely through architectural changes or regularization, the paper explores whether explicitly representing uncertainty could help improve generation diversity. I find this perspective worth investigating, particularly the attempt to incorporate belief functions into both the generator and discriminator.
- The empirical results are encouraging, although still preliminary. The method consistently improves FID and Vendi Score over the standard GAN baseline across three datasets. I also appreciate the additional ablation studies and computational overhead analysis, which help provide insight into the different components and their practical costs.
Critical weaknesses
-
I am not fully convinced that the proposed framework actually captures meaningful epistemic uncertainty, or that the improvements can be attributed to the evidential formulation.
My main concern is the gap between the theoretical motivation and what the proposed objectives actually encourage. For the discriminator, the additional belief outputs allow an "ignorance" gap in principle. However, considering the discriminator loss as written, its pointwise optimum for a fixed generator appears to satisfy , effectively eliminating this gap. The additional parameterization may still affect training dynamics, but the paper does not provide evidence showing when meaningful ignorance emerges or how it benefits optimization.
I have a similar concern about the generator. The Dirichlet-based interval sampling introduces additional stochasticity, but it remains unclear why this should be interpreted as epistemic uncertainty rather than simply another form of noise injection. In particular, the paper does not demonstrate that the predicted uncertainty reflects meaningful properties of the generated samples or that it is responsible for improved mode coverage.
There also seems to be an inconsistency in the generator loss: the Dirichlet variance term has a positive coefficient, even though the text states that the objective encourages higher variance. Under the usual loss minimization convention, this term would have the opposite effect. I think this needs clarification, as it directly concerns the proposed diversity mechanism.
Overall, these issues make it difficult to assess whether the evidential interpretation is an essential contribution of the method or mainly an alternative interpretation of a stochastic GAN architecture. -
The experimental evidence is not yet sufficient to support the broader claims about improving generation diversity and mitigating mode collapse.
The experiments rely almost entirely on comparisons with DCGAN, which is a rather old and relatively weak baseline. I understand the motivation for keeping the backbone fixed to isolate the proposed changes, but this alone does not establish whether the approach offers meaningful advantages over existing techniques for improving GAN diversity. The models are also trained for only five epochs, making it difficult to determine whether the observed improvements persist after convergence.
The ablation studies are useful, but they do not completely resolve this concern. For example, the full model achieves neither the best FID nor the highest Vendi Score among the architectural variants in Table 5. More importantly, the paper does not sufficiently disentangle the benefits of evidential modeling from those of additional stochasticity or changes in generator capacity.
I am also hesitant to interpret higher Vendi Scores as direct evidence of reduced mode collapse. Increased sample diversity does not necessarily imply better coverage of the target distribution. More direct evaluations of mode coverage, together with stronger baselines and statistical variation across runs, would make the conclusions substantially more convincing.
Questions for authors
-
Could the authors clarify the relationship between the proposed discriminator objective and the standard GAN objective? In particular, the pointwise optimal discriminator appears to satisfy , leaving no ignorance mass. Is this interpretation correct? If so, is the intended benefit primarily related to transient optimization dynamics? It would be helpful to see empirical evidence, such as how the ignorance mass evolves during training and whether it leads to different or more useful gradient signals.
-
How can we distinguish the benefits of epistemic uncertainty modeling from those of simply introducing additional stochasticity? For example, would a generator with a conventional stochastic bottleneck or noise injection, but without the proposed belief-theoretic interpretation, achieve similar improvements? Also, could the authors clarify the sign of the Dirichlet variance term in the generator loss? As written, minimizing the objective seems to discourage rather than encourage variance.
-
Could the authors provide more direct evidence that the method improves mode coverage? While the Vendi Score is a useful measure of diversity, it does not necessarily indicate whether previously missing modes are recovered. An explicit mode coverage analysis, or an examination of how the predicted uncertainty relates to sample diversity, would help establish the claimed mechanism.
-
How robust are the improvements to longer training and stronger baselines? Since all models are trained for only five epochs, I wonder whether the performance differences would remain after convergence. Comparisons with other diversity-oriented GAN objectives, preferably under matched model capacity, would also help establish the practical value of the proposed framework. Additionally, reporting the mean and standard deviation of FID and Vendi Score across multiple runs would make the relatively modest improvements easier to assess.