- Rating
- 3
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
In this work, the authors observe that the latent space of a crystal generation latent diffusion model gets naturally organised into clusters of similar atoms and propose a latent diffusion model that takes advantage of this fact to generate crystals with guidance towards a specified template.
Critical strengths
-
The paper has been properly proof-read and well organised, hence easy to follow.
-
The work addresses an important gap in the latent diffusion literature, which is atomic-level guidance. Although the exact atom types cannot be specified, the atomic family gives controllability on the type of atoms we want to have in the final crystal.
-
The authors have demonstrated the clustering behaviour in two different crystal datasets (MP-20 and MPTS-52) as well as the QM9 molecular dataset. This shows that this is not a dataset specific property.
-
Table 3 shows that the model is able to adhere to the target atomic family, and tables 1 and 2 show that even within a specific family of crystals, the model shows remarkable performance with respect to stability/novelty.
Critical weaknesses
-
In table 1, the templates are not generated arbitrarily, but takes from the training set, yet the stability and SUN metrics are lower than ADiT, on which this work is based upon. Can the authors justify this observation, or show some failure cases to highlight the reason behind this?
-
The medoids are currently chosen as the point closest to the (roughly stated) mean of normalized posterior means, which might lie outside a cluster. How much does this affect the performance of the model? Can the authors show an ablation where they randomly select a representative from each family and use a sharp Gaussian around them as the prior distribution? Since flow matching can map any source distribution to a target distribution, does randomly selecting such representatives affect the model's performance?
-
With the current approach, the atomic family must be known beforehand to be able to generate crystals belonging to it. A limitation towards discovery of new materials is the need for discovering novel family of crystals first, which requires domain knowledge and cannot be automated.
Questions for authors
see weaknesses
3 comments
I thank the authors for the additional experiments. Table 11 clearly shows the advantage of using medoids over random representatives or evenly spaced centers, but the elemental family distribution table does not really justify the dip in stability compared the ADiT. There might be novel compositions, but it can't be inferred from the elemental distributions, more so because the distribution closely follows that of the MP-20 training set. A little more investigation into what drives the novelty would be good, but overall, I maintain my score.
Thank you very much for taking the time to review our additional experiments. We appreciate your comments and suggestions, and we will further investigate.
Thank you for your valuable and constructive comments. Our responses are provided below.
Response to Weakness 1. FamilySpace uses training templates that specify the elemental families and the number of atoms from each family in a crystal, while ADiT only specifies the total number of atoms during sampling. As a result, the generated crystals may have different distributions of elemental families, which can affect the generation metrics. We analyze the generated crystals from ADiT and FamilySpace, with the results shown below.
Average atomic fraction of each elemental family per crystal
Distribution of the number of distinct elemental families per crystal
For the first table, we calculate the fraction of atoms belonging to each family within each crystal, assigning zero if the family is absent, and then average the fractions across all crystals with equal weight. The second table reports the number of distinct elemental families in each crystal. Different elements from the same family are counted as one family. These results show that ADiT and FamilySpace generate different distributions of elemental families, which may contribute to the differences in their generation metrics.
As shown in Table 1 of the revised manuscript, FamilySpace achieves a trade-off between stability and novelty. On MP-20, FamilySpace achieves a substantially higher UN rate than ADiT (69.53% vs. 30.81%), while its stability rate is lower (6.26% vs. 11.03%). Although SUN is slightly lower (1.38% vs. 1.68%), MSUN improves from 13.39% to 15.31%. These results indicate broader exploration of novel structures, but not necessarily higher stability.
Response to Weakness 2. Thank you for this suggestion. We have conducted additional ablation experiments to examine how the selection of source centers affects generation performance. The results are provided in Appendix B.4 (pages 20–21, Table 11 of the revised manuscript).
The results show that our medoid achieves the highest stability and SUN rates. Random representatives achieve comparable results in some metrics, while evenly spaced centers improve UN but reduce stability and metastability. Overall, our medoid provides a balanced choice across the evaluated metrics. Please refer to the revised manuscript for further details.
Response to Weakness 3. The elemental families are general categories based on the periodic table. By specifying predefined elemental families, FamilySpace can generate crystals containing only elements from the selected families, allowing users to control the types of materials being generated. We agree that domain knowledge can help guide more targeted exploration, as demonstrated in our application-oriented exploration experiments.
In LLM-driven automated crystal discovery, such as autonomous laboratories or agents research, the domain knowledge of LLMs may help select suitable family templates and make better use of the control capabilities of FamilySpace.
For general exploration, we can check whether the combinations of elemental families and atom counts satisfy basic chemical requirements, such as charge neutrality. In fact, other diffusion and flow matching crystal generation methods also require specifying the number of atoms during generation. FamilySpace provides additional control over the elemental families and their ratios.