- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper adapts frozen generative models by reweighting samples to approximately match target feature averages while maximizing the entropy of the weights. They impose a minimum effective sample size and derive a Lambert-W solution. They evaluate reweighting on image and text generators and show learned twisted sequential Monte Carlo sampling on a CIFAR-10 diffusion model.
Critical strengths
The paper combines approximate entropy balancing with an explicit ESS constraint, equivalent to a lower bound on Renyi-2 entropy, which the second part is an interesting addition.
They also connect the fitted density ratio to learned twisted Monte Carlo sampling for sequential generation.
Critical weaknesses
-
The core theoretical ingredients are well established, including entropy balancing and the Lambert-W solution for entropy-plus-quadratic objectives under moment constraints. The explicit ESS constraint is interesting, but the novelty beyond combining these ingredients is unclear to me.
-
I am not yet convinced of the method's practical usefulness. The method matches averages of selected per-sample features, and it is unclear whether this linear combination can capture the aspects of the target distribution that matter in practice. Weight entropy and ESS do not account for similarity between samples, so distributing weight across many nearly identical samples can yield high entropy and ESS without meaningful semantic diversity.
-
The experimental scope is limited. In particular, sequential sampling is demonstrated only on a CIFAR-10 brightness task, so its usefulness for more complex image and text generation remains unclear. Moreover, the improvements in Table 2 over the stronger baselines seem marginal.
Questions for authors
-
Could you justify the choice of ESS as the coverage criterion and explain how its minimum should be chosen in practice?
-
What practical applications would benefit from this method? Like could the method target generative precision/density, and what effect would this have on recall/diversity?
Dear Reviewers, The authors have now submitted their responses to the reviews. There is only a limited amount of time left for you to review their replies and provide any further comments.
Your feedback is crucial to ensure that the review process proceeds smoothly. We would greatly appreciate it if you could share your reactions before the discussion period closes.
Thank you very much for your work. Best regards.