- Rating
- 4
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
- The paper proposes FIRM, a fragment-based molecular generative model that decomposes molecular generation into molecular interface (coarse structure) design followed by fragment identity selection. Interface Flow first generates a typed interface, and Conditional Realization Flow then generates a molecule from a fragment bank constructed from the training set.
- With the modeling strategies described above, FIRM circumvents the practical difficulty of determining fragment-fragment connections and selecting fragments by factorizing the whole process into two steps, which improves performance and aligns well with recent work.
- For this two-step generative model, the paper analyzes whether the first-stage generation of the interface reduces uncertainty in the second-stage realization, showing each component’s contribution to molecular generation performance. The paper also analyzes the generation order of the components.
- The paper reports molecular generation results on multiple benchmarks (MOSES, NPGen, GuacaMol, and ZINC250K).
Critical strengths
- Novelty: The paper proposes a distinctive approach to fragment-based molecular generation. FIRM uses a typed interface that leaves internal fragment adjacency and atom-level attachment mappings unspecified, and separates interface generation from compatible realization rather than generating both jointly in a single process. This factorization is supported by improvements in realization prediction and generation success.
- Solid evaluation and supporting experiments are well aligned with the main claims: For this two-step generative model, the paper disentangles the informational contributions of different inputs and analyzes generation order, supporting the design choices of FIRM through interface-first, realization-first, and mixed-order comparisons (Section 5.4 and Appendix C.2). Moreover, the paper shows particularly strong improvements on NPGen, which contains large and complex molecules, achieving the best distribution-matching results among the evaluated graph-based molecular generative models. I recommend acceptance because the interface-realization decomposition offers a modeling contribution, supported by controlled analyses and strong benchmark results.
Critical weaknesses
None
Questions for authors
- New interfaces in NPGen: The proportion of molecules with interfaces not observed during training is considerably higher in the generated samples than in the test set (33.1% versus 6.2%; Figure 8). Could the authors further explain on this difference and briefly show several molecules produced from new interfaces? (Clarification request)
- Regarding the extensibility of FIRM: I agree that FIRM provides a chemically sound and effective approach to molecular generation. At the same time, an important practical consideration is whether the model can be conditioned (or rather can be optimized) on a target property, through either conditioning or guidance, while maintaining generation quality. Could the authors provide such experiments using FIRM as a base model, in comparison with several baselines when conditioned on a certain property? My question focuses on whether the FIRM framework can serve as a base model when property conditioning is required, so experiments with simple molecular properties would be sufficient. It would also be useful to explore steering the interface generation also stage or analyze how strongly the interface itself influences the chosen molecular properties. (Experiment suggestion)
6 comments
Author Response (2/2)
Comment/Question:
"... Could the authors provide such experiments using FIRM as a base model, in comparison with several baselines when conditioned on a certain property?... My question focuses on whether the FIRM framework can serve as a base model when property conditioning is required, so experiments with simple molecular properties would be sufficient.... It would also be useful to explore steering the interface generation also stage or analyze how strongly the interface itself influences the chosen molecular properties. ..."
Answer:
Thank you for suggesting property conditioning as a practical test of FIRM beyond unconditional generation. Following your suggestion, we added experiments on MOSES for logP, QED, and ring count, with comparisons against FragFM and DiGress using results taken from the original papers. We use the same target values as FragFM, selected based on its analysis of molecular property distributions in MOSES, to compare the models on the same property targets.
To test whether fragment selection alone provides property control, we condition only the realization stage and leave interface generation unconditional. The table below reports three representative targets. For each, realization conditioning reduces the mean absolute deviation (MAD) from the target while maintaining 100% validity and high uniqueness.
Conditional results use second-stage conditioning only. FCD, validity, and uniqueness refer to conditional generation; FCD uses MOSES TestSF.
| Target | Unconditioned MAD ↓ | Conditional MAD ↓ | FCD ↓ | Validity ↑ | Uniqueness ↑ |
|---|---|---|---|---|---|
| logP = 3 | 0.743 | 0.320 | 1.091 | 100% | 99.96% |
| QED = 0.6 | 0.204 | 0.120 | 2.530 | 100% | 99.94% |
| Ring count = 3 | 0.552 | 0.074 | 1.484 | 100% | 99.93% |
We compared property error and FCD with FragFM and DiGress under realization-only conditioning. Together with the results above, this comparison supports using FIRM for property-conditioned generation through fragment and attachment selection. The comparison curves are included in Appendix B.6, Figure 9 of the revised manuscript.
To assess the interface's contribution, Table 5 of the revised manuscript compares conditioning neither stage, Interface Flow only, Realization Flow only, or both. Realization-only conditioning is close to conditioning both stages for logP = 3 and QED = 0.8, whereas one-ring generation benefits substantially from conditioning both stages. These findings show that connection requirements and fragment choices can provide complementary control, with the useful combination depending on the target. Section 5.5, Figure 6 of the revised manuscript provides the property distributions, and Appendix B.6 gives the conditional implementation and training details.
Thank you for the detailed experiments.
I appreciate the authors’ additional analysis on NPGen. It strengthens the claim that FIRM generates novel molecules with property distributions similar to the test set, beyond reproducing molecules seen during training.
However, I have some concerns regarding the conditioning experiments. To the best of my knowledge, both DiGress and FragFM used classifier guidance (CG), and FragFM claims that a fragment-based model improves property control under the same guidance scheme. In that regard, I think an important point in the comparison is how well each framework can be conditioned when using the same guidance method.
The current experiments are sufficient to show that FIRM can be used for property conditioned generation, but I do not think they confirm that FIRM’s architecture itself provides better property control. I still think the first claim is also valuable in practice. However, if the paper includes the second claim, the authors should compare FIRM with other diffusion or flow models using CFG, or evaluate FIRM with CG for a more controlled comparison.
Author Response (1/2)
We thank the reviewer for recognizing the interface-realization decomposition and the controlled analyses supporting it, and for the helpful questions about unseen interfaces and property-conditioned generation. Revisions to the manuscript are highlighted in cyan. We address your comments below.
Comment/Question:
Answer:
Thank you for reading our results carefully and noting the higher unseen-interface rate on NPGen (33.1% versus 6.2%). This observation prompted a closer look at how FIRM forms new interfaces.
We found that 95.4% of generated unseen interfaces use connection structures observed in training, and their local attachment patterns are also familiar. To test whether recombining these patterns could explain the higher rate, we exchanged branches between test interfaces within five common connection structures. This changes how distant parts are combined while preserving the frequencies of local attachment patterns and neighboring pairs.
Unseen-interface rates within five common NPGen connection structures, weighted equally in the mean. The three-node structure allows no branch exchange.
The increase after exchange shows that familiar local patterns can form many more interfaces absent from training. Together with the observed overlap in connection structures, this supports recombination as a contributor to FIRM's higher rate.
To assess the resulting molecules, we compared them with NPGen test molecules whose interfaces were also unseen during training. Their distributions were similar across six properties, including NP-score, LogP, and TPSA (KS distances: 0.036 to 0.083). This supports FIRM's ability to generate new combinations with molecular properties resembling those of real, unseen combinations. The same property analysis appears in Appendix C.4, Figure 16 of the revised manuscript.
Following the reviewer’s suggestion, we randomly selected three molecules containing unseen interfaces from the molecules generated by FIRM trained on NPGen. Their local attachment patterns, connection rules, and fragment templates occur in training, while the complete interfaces and molecules do not. These examples are also included in Appendix D.2, Figure 28 of the revised manuscript.