- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
PONDER trains a policy to choose which positions a frozen masked generator should fill or remove for later regeneration. Training uses terminal rewards and group-normalized policy gradients.
Critical strengths
1 The problem in this paper is clear, and paper is well motivated.
2 Freezing the generator clarifies PONDER’s contribution: Better inference decisions improve results without changing the generator.
3 Strong Sudoku results and ablations show that both generation order and learned revision locations are important
Critical weaknesses
1 typo: line 129 and 65 miss references.
2 The overall accuracy in the Sudoku input ablation is about 96.49% (table 5), while it is 98.2% (table1) in the main experiment. What settings are different between them?
3 Limited discussion of related work. The paper does not discuss its connection to InCoDe [1], which also learns an adaptive order for selecting informative semantic queries or image patches.
[1] InCoDe: Interpretable Compressed Descriptions For Image Generation
Questions for authors
See weaknesses
2 comments
Thank you for your clarification and for addressing my concerns.
Thank you for your constructive feedback. We incorporated it into our manuscript. If our answers are satisfying, we kindly ask to consider raising your score.
Q1. Missing references (lines 65 and 129)
Thank you, both are fixed in the revision: line 65 now cites GLM-Image and line 129 Hong et al. (ICLR 2026).
Q2. Sudoku input ablation (Table 5, 96.49%) vs. main table (Table 1, 98.2%)
Thank you for pointing out this inconsistency. The experiments in Table 5 were comparing sudoku policies after only 25k training iterations, whereas the policy in our main table was trained for 50k steps. We will update Table 5 with the numbers after 50k training steps.
Q3. Relation to InCoDe
Thank you for the pointer. We added a short discussion in the revised related work section. Both InCoDe and PONDER make a sequence of sample dependent choices for image generation, but for different purposes. InCoDe compresses an existing image into a short, human-readable description. From a fixed set of yes or no questions about the image (e.g., “is there a window?”), it learns which question to ask next, choosing at each step the one whose answer which is most informative about the remaining answers. A fine-tuned diffusion model then generates images that match these answers. The order thus decides which information about a given image to observe. The answers are read off that image or set by a user, and are not revised. PONDER has no image to observe. It decides in which order a frozen generator creates the image, and since the generator’s outputs can be wrong, it also learns which already generated patches to discard and regenerate. It is trained with reinforcement learning on the quality of the finished image (or the correctness of a Sudoku), not on information gain.