- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper considers how to achieve a desired output for a generative model by steering it, and it contrasts approaches based on "telling" (adjusting parameters) versus "showing" (providing examples). It gives analytical bounds for these two approaches, and it applies the approaches to images and crystals.
Critical strengths
The task of steering a generative model toward desired outputs is an important issue. The paper provides a formalism that might be promising for this task.
Critical weaknesses
The paper appears to have been compressed to fit the page limit to an extent that details needed for evaluating it have been completely left out. In particular, despite the repeated invocation of crystals, the actual task involving crystals is never precisely stated, making it impossible to decide whether the method is producing novel gains. Similarly, the concept of a "bin" is defined too tersely and cryptically to make it possible to follow the analysis. It might be possible to explain this lack of specifics from the first 9 pages, but there was no upper limt on the number of pages of appendix, and therefore no reason why the appendix is terse and cryptic as well.
The paper omits a lot of closely related work, including
Brooks, T., Holynski, A., and Efros, A. A. Instructpix2pix: Learning to follow image editing instructions. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 18392–18402, 2023.
Deckers, N., Peters, J., and Potthast, M. Manipulating embeddings of stable diffusion prompts. arXiv preprint arXiv:2308.12059, 2023.
Hertz, A., Mokady, R., Tenenbaum, J., Aberman, K., Pritch, Y., and Cohen-Or, D. Prompt-to- prompt image editing with cross attention control. arXiv preprint arXiv:2208.01626, 2022.
onen, K., Jentzsch, S., Diallo, D., Schütt, P., Bensch, O., Baff, R. E., Opitz, D., and Hecking, T. Style vectors for steering generative large language model. arXiv preprint arXiv:2402.01618, 2024.
Liu, S., Wang, C., Lu, J., Nie, W., Wang, H., Li, Z., Zhou, B., and Tang, J. Unsupervised discovery of steerable factors when graph deep generative models are entangled. Transactions on Machine Learning Research, 2024
Vafa, K., et al, "What's producible may not be reachable: Measuring the steerability of generative models." Advances in Neural Information Processing Systems 38 (2026): 56383-56420.
Some of these paper explicitly define the task of "steering" and also contrast adjusting instructions versus providing examples.
Questions for authors
Can you provide the full details on how you're defining "bins" and using them in the analysis?
Can you provide the full details on the task involving crystals, and how it relates to prior results on this task?
How does your paper relate to the work mentioned earlier in this review, and in what ways does it go beyond it?
3 comments
Thank you for these clarifications and additions. I have raised my score.
Thank You
Thank You
Summary: We defined "bin" concretely at its first use (Introduction and §3), substantially expanded the crystal task/model appendix with the structure-quality-vs-steerability distinction and two new benchmark comparisons against published crystal generators, and added six related-work citations with specific positioning — including a full differentiation from the closest prior work (Vafa et al., 2025) in a new appendix.
Response to Reviewer Au7V
We thank the reviewer for a close reading and for the related-work pointers — several of these (especially Vafa et al., 2025) are genuinely useful context we had missed, and the review has improved the paper. We have revised accordingly; all changes are in the updated PDF.
Defining "bins." We agree the term was under-defined. The Introduction now defines a bin inline at first use ("picks one bin to generate into: a group of outputs that all share that value"), and §3's formal treatment now grounds the definition concretely where the notation is introduced ("all outputs sharing one label, e.g. every image π calls 'golden retriever,' or every crystal built from the same element set") rather than relying on the notation table alone, which previously just restated the symbol.
The crystal task. We expanded Appendix D into "The crystal task and model," which now states the task precisely: the conditioning format, the generation order, and — most importantly — the distinction between structure quality (SUN/MSUN: is the output viable materials chemistry at all) and steerability (did the output have the property that was requested), which are different axes that can diverge. We also added a "Prior results, in context" subsection with two benchmark comparisons against published crystal generators (CrystaLLM, OMatG, ADiT, MatterGen, CDVAE), showing our generator is competitive, not a deliberately weak baseline, and that exemplar choice alone moves output quality by about as much as switching to a different published architecture does — the basis for judging whether §4's crystal results reflect a real effect rather than an artifact of a weak generator.
Related work. We read all six papers and added them with specific positioning, not just citations: four (InstructPix2Pix, Prompt-to-Prompt, Deckers et al., GraphCG) are further telling/knob examples now in §2's Controllable-generation paragraph; style vectors (Konen et al., 2024) are discussed as an interesting boundary case — derived from exemplars but still a single per-output push, hence telling by our definition (Appendix H). Vafa et al. (2025) is the closest prior work: they find the same telling/showing asymmetry we predict, but empirically, by user study. §2 now states this, and Appendix H gives the full differentiation — our contribution is a data-side quantity, computable before a model or user study exists, that predicts the size and direction of that gap in advance, including when telling wins instead.
We hope these changes address the reviewer's concerns, and we're happy to expand further on any of the three points.