- Rating
- 3
- Confidence
- 4
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper introduces OxiGen, a generative diffusion model for inorganic crystalline materials that explicitly represents oxidation states and enforces global charge neutrality by construction. This is achieved through a structured output layer that uses dynamic programming over a finite-state automaton. The authors show that OxiGen's approach substantially improves oxidation-state fidelity and maintains high compositional validity under band-gap conditioning. The rate of generated S.U.N. structures is also slightly increased through the structured sampling, which overall yields very competitive performance of OxiGen in the de novo generation task.
Critical strengths
- The explicit representation of oxidation states and the structured output layer for exact charge-neutral inference is clearly motivated for generating inorganic crystalline materials, proven to be highly effective, and general enough so that it should be able to be incorporated in other generative models.
Critical weaknesses
- The authors state that the design of the structured output layer is general enough that it can be incorporated into other generative models for inorganic crystalline materials. To increase the significance of this work, this should be shown explicitly for one example.
- A comparison against using classifier-free guidance on global charge neutrality is missing.
Questions for authors
- Within the MatterGen framework, it should be straightforward to use classifier-free guidance on global charge neutrality as an alternative approach to OxiGen's approach. How does the performance compare?
- Could the authors show for one other generative model that their approach works there too?
- For the results in Figure 3, what is the rate of (meta-)stability and uniqueness of the generated structures at each target band gap? I assume these metrics are also significantly higher than the ones of MatterGen?
3 comments
Additional Experiments for OMatG
As requested, we have implemented our approach for OMatG [1], which uses discrete flow matching [2,3] rather than the masked discrete diffusion process [4] used by OxiGen. As with OxiGen, we replace the element representation with a species representation and apply the structured output layer to the denoiser predictions at each sampling step. The results are summarised in the table below. Similarly to OxiGen, introducing the species representation alone results in a small improvement in oxidation-state fidelity, while structured sampling leads to more substantial improvements, with compositional validity and oxidation-state frequency score closely matching the MP-20-OS reference values. The S.U.N. rate is largely consistent across OMatG variants and lower than for OxiGen. These results demonstrate the benefits of our approach for another generative model with a different discrete process. We will update the manuscript with these additional results. We thank the reviewer again for their suggestions and would be happy to answer any further questions.
Table: De novo generation results for OMatG with the species representation and structured sampling, compared with the baselines from Table 2. Results are reported as mean ± std over three independently seeded training runs for the OMatG species variants and five independently seeded training runs for the other generative models, with 10,240 generated structures per seed. MP-20-OS denotes the test set.
| Method | Comp. Val. (%) ↑ | fOS (%) ↑ | dOS ↓ | S.U.N. (%) ↑ | Ehull (eV/atom) ↓ | RMSD (Å) ↓ |
|---|---|---|---|---|---|---|
| MP-20-OS | 91.73 | 53.78 | – | – | – | – |
| MatterGen | 81.18±0.94 | 37.89±1.02 | 0.1537±0.0039 | 24.54±0.91 | 0.1799±0.0085 | 0.1747±0.0203 |
| OxiGen | 90.65±0.94 | 53.01±0.96 | 0.0911±0.0028 | 26.38±1.01 | 0.1575±0.0080 | 0.1679±0.0117 |
| OMatG | 82.32±0.48 | 43.08±0.35 | 0.1284±0.0060 | 19.03±0.78 | 0.1831±0.0030 | 0.5244±0.0278 |
| OMatG species, unconstrained | 84.82±0.41 | 45.75±0.78 | 0.1123±0.0059 | 19.06±0.23 | 0.1749±0.0043 | 0.5450±0.0078 |
| OMatG species, constrained | 91.67±0.21 | 56.22±0.37 | 0.0835±0.0022 | 19.31±0.44 | 0.1633±0.0037 | 0.5418±0.0097 |
References
[1] Philipp Höllmer, Thomas Egg, Maya Martirossyan, Eric Fuemmeler, Zeren Shui, Amit Gupta, Pawan Prakash, Adrian Roitberg, Mingjie Liu, George Karypis, Mark Transtrum, Richard Hennig, Ellad B. Tadmor, and Stefano Martiniani. Open Materials Generation with Stochastic Interpolants. In Proceedings of the 42nd International Conference on Machine Learning, volume 267, pp. 23417–23450. PMLR, July 2025. URL https://proceedings.mlr.press/v267/hollmer25a.html.
[2] Itai Gat, Tal Remez, Neta Shaul, Felix Kreuk, Ricky T. Q. Chen, Gabriel Synnaeve, Yossi Adi, and Yaron Lipman. Discrete Flow Matching. In Advances in Neural Information Processing Systems, volume 37, pp. 133345–133385. Curran Associates, Inc., 2024. doi: 10.52202/079017-4239. URL https://proceedings.neurips.cc/paper_files/paper/2024/hash/f0d629a734b56a642701bba7bc8bb3ed-Abstract-Conference.html.
[3] Andrew Campbell, Jason Yim, Regina Barzilay, Tom Rainforth, and Tommi Jaakkola. Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design. In Proceedings of the 41st International Conference on Machine Learning, volume 235, pp. 5453–5512. PMLR, July 2024. URL https://proceedings.mlr.press/v235/campbell24a.html.
[4] Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff, Aaron Gokaslan, Edgar Marroquin, Justin T. Chiu, Alexander Rush, and Volodymyr Kuleshov. Simple and Effective Masked Diffusion Language Models. In Advances in Neural Information Processing Systems, volume 37, pp. 130136–130184. Curran Associates, Inc., 2024. doi: 10.52202/079017-4135. URL https://proceedings.neurips.cc/paper_files/paper/2024/hash/eb0b13cc515724ab8015bc978fdde0ad-Abstract-Conference.html.
Thank you for your replies and clarifications, and for the additional results in the OMatG framework. My concerns have been addressed.
Response to Reviewer tFqm
Thank you for your helpful comments and suggestions. We address your questions below.
In our setting, all structures in the training dataset have charge-neutral oxidation-state assignments. Therefore, the distribution conditioned on charge neutrality would not differ from the unconditional distribution and so standard classifier-free guidance would not provide any conditioning signal. Other soft constraint/guidance approaches could potentially be adapted for charge neutrality, but these generally do not provide the same exact guarantee of charge neutrality as our structured output layer. If we misunderstood the reviewer's comment and another experiment was suggested please let us know and we would be happy to run it.
We agree that demonstrating our approach works for another generative model would provide stronger evidence for its generalisability. We have implemented our method for OMatG [1] and will report the results once the experiments are complete.
As reported in Appendix Table 14, OxiGen has a higher S.U.N. rate than MatterGen at all band gap targets, with particularly large improvements at 3-7 eV. These improvements are driven by a large increase in stability, while novelty and uniqueness moderately decrease, consistent with the typical stability-novelty tradeoff.
Table: Band-gap-conditioned generation results for target band gaps of 1, 3, 5, and 7 eV. Results are shown for a single fine-tuning seed, with 1,024 generated structures at each target.
References
[1] Philipp Höllmer, Thomas Egg, Maya Martirossyan, Eric Fuemmeler, Zeren Shui, Amit Gupta, Pawan Prakash, Adrian Roitberg, Mingjie Liu, George Karypis, Mark Transtrum, Richard Hennig, Ellad B. Tadmor, and Stefano Martiniani. Open Materials Generation with Stochastic Interpolants. In Proceedings of the 42nd International Conference on Machine Learning, volume 267, pp. 23417–23450. PMLR, July 2025. URL https://proceedings.mlr.press/v267/hollmer25a.html.