- Rating
- 3
- Confidence
- 3
- Informativeness
- 3(+1)
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposed TreeRef-BFN, which use a tree slot representation to generate molecule size, chemical topology and 3D geometry at the same time. In this representation, Real node means a real atom and Null state means the slot is empty, so the model can decide the atom number. RingRef node is used to encode the ring closure which can not be expressed by tree. Each slot also contains element, bond type, bond length, bond angle, dihedral angle and local chirality.
The authors use a normal Transformer with BFN to generate these discrete and continuous variables together, then decode them to chemical graph and 3D coordinates. Because internal coordinates are used, the network do not need equivariant architecture.
By fixing some variables and generating others, one pretrained model can be used for 2D to 3D generation, scaffold decoration and fragment completion. But for property conditional generation, a separate model still need to be trained. In main table, the validity is 96.56% on QM9 and 82.4% on GEOM-Drugs, and the angle and dihedral distributions are very close to reference.
Critical strengths
Strengths
-
I think the unified representation is a good idea. Atom number, topology, ring and local geometry are all in one representation, so joint modeling become possible. The Null and RingRef design is simple but useful for variable size and ring structure.
-
Bond length, angle and dihedral are generated directly, and the local geometry results are good. When pairwise angle is removed, the performance drop, which also support this design.
-
Different conditional tasks can share one pretrained model only by masking variables. No need to train a special model for each task, this is convenient.
-
The ablation study is quite complete, including simplified angle representation, post hoc ring closure, model size and sampling steps. The authors also analyzed the dependence on tree serialization. The multi-view consistency training is useful for conditional generation.
Critical weaknesses
Weaknesses
-
The decoding process is complicated. Although variables are generated jointly, coordinates are still rebuilt by tree order. Incompatible angles need to be clipped or treated as degenerate, and RingRef need constrained matching. Ring closure matching do not adjust real atom positions, so it seems some closure error may remain. How large is this error in practice?
-
The conditional generation of default model is not stable. In 2D to 3D task, small model get 93.00% validity, but default large model only get 64.65%, and medium model with multi-view consistency training get 94.55%. So better unconditional generation not always means better conditional generation. Which model the authors suggest to use for these tasks?
-
Local geometry metrics are not enough. Bond length, angle and dihedral distributions close to reference can not guarantee each molecule has no clash, low energy or near equilibrium. I think more energy, force and global structure evaluation are needed.
Questions for authors
See weaknesses. Besides, the stability results are confusing to me. In main table, molecule stability of 100 step QM9 model is 92.52%. But in appendix Table 7, L model in same setting has 89.08% EDM stability and 96.19% MiDi stability. I know different metrics have different definition, but please explain which procedure or result version the main table number come from.
5 comments
Response regarding the model choice for 2D-to-3D conditional generation
2D-to-3D. The values 93.00%, 64.65%, and 94.55% are xyz2mol validity. Table 3 also reports 3D validity, with RDKit applied directly to the coordinates: 93.50% for S, 79.20% for L, and 95.30% for M-inv2. The two columns move together, and xyz2mol is the stricter one. Pretraining generates topology and geometry together. The model never sees an input in which the topology is already given and the geometry channels are still empty.
The channel-deletion experiment in the appendix asks which channel the model actually reads. We noise every channel of a validation molecule together, replace one channel by its prior, and take a single denoising step. At , removing the element or the bond barely moves the distance error: the change is below 0.004 Å for S, M, L, and M-inv2. Removing geometry raises the distance error from about 0.09 Å to about 0.16 Å, and element accuracy falls from about 0.67 to 0.21–0.26. At the split is sharper. With geometry left in place the distance error is about 0.001 Å; with geometry removed, element accuracy drops below 0.04. A second check is ordinary unconditional sampling, 32 molecules and 20 steps, with one channel reset to its prior before every network call. Blanking geometry hurts M, L, and M-inv2. Blanking the element or the bond does not. The network uses geometry to decide the discrete structure. This matches the usual relation: one geometry generally determines one topology, while one topology can take several geometries.
2D-to-3D hands the model a finished graph while the geometry still starts from the prior, the reverse of training, where geometry becomes informative first and the discrete labels follow it. In Figure 12b, blanking the geometry input throughout sampling degrades M, L, and M-inv2, while blanking the element or the bond does not, and S does not drop in the same way. During joint generation the larger models read the geometry channel when deciding the discrete structure. In 2D-to-3D that channel starts from the prior, so under Frozen conditioning validity falls from S to L. This task is pattern matching. M-inv2 is trained on several trees of the same molecule and aligns those serializations with the consistency term, so it has seen more patterns. Its xyz2mol validity is 94.55%, already above S. We therefore recommend the view-augmented model for this task. The more fundamental remedy is pretraining adapted to incomplete channels or incomplete TreeRefs. We point to this direction in the conclusion.
Changes:
- “2D-to-3D generation” in Section 4.3 reports the drop from S to L under Frozen conditioning and that M-inv2 recovers most of the loss. Table 3 reports both xyz2mol and RDKit 3D validity. The channel-deletion experiment in the appendix shows that the model uses geometry to decide the discrete structure.
- The conclusion states that future work will design pretraining better suited to incomplete channels or incomplete TreeRefs.
Response regarding the evaluations
Energy, force, and global structure. We plot the six checks in one figure in Appendix C.3, so they can be read together. The first four are pass rates. The last two are the force RMS and the energy released by relaxation. TreeRef-BFN has the highest pass rate on steric clash, aromatic-ring flatness, and double-bond flatness, and a 99.19% pass rate on the UFF energy ratio. The force RMS is the force before optimization: 21.44 kcal/mol/Å, fourth place and close to the best value of 20.39 kcal/mol/Å. After 200 steps of MMFF94 minimization, the median energy released is kcal/mol, the smallest among the compared models. The force at the start is already small, and the energy lost over those 200 steps is the smallest, so the coordinates are already near a force-field minimum. Together with the pass rates above, the generated molecules rarely place atoms on top of one another, and aromatic rings and double bonds keep the planarity they require.
Changes:
- Appendix C.3: definitions of the six checks, and the figure.
- The QM9 paragraph in Section 4.2: the summary of these results.
Stability and validity. The 92.52% in the main table is Exact molecule stability. It applies the QM9 valence table to the generated topology, so it reads the 2D bond table and not the coordinates. MiDi at 96.19%, in the same setting, also reads that bond table, with the MiDi valence table. EDM at 89.08% is the 3D measure: bonds are inferred from distances on the decoded coordinates. Validity is completed in the same way. 2D validity applies RDKit to the generated bond table. 3D validity applies RDKit to the decoded coordinates. xyz2mol infers bonds from the coordinates and then applies RDKit. In Appendix Table 7, the L model at 100 steps matches the main table on these numbers. The previous caption did not separate them. It now does.
Changes:
- The caption of Table 1 states that Exact and MiDi score the generated topology, while EDM, 3D validity, and xyz2mol score the decoded coordinates.
- Appendix C.1, Table 7 uses the same definitions and gives the L-model numbers that correspond to the main table.
Response regarding decoding error
Thank you for the questions on decoding, 2D-to-3D generation, and the evaluation metrics. We have added these points to the paper and the appendix.
Ring closure and angles. Ring closure only adds the ring bonds. It does not move the Real atoms already built. The residual is the distance from each virtual point to its matched atom, reported as the Closure column of Table 7 in Appendix C.1 and averaged over successfully decoded molecules. For the main model at 100 steps the mean is 0.089 Å. At the same budget, S and M are 0.305 Å and 0.126 Å. Raising the main model from 10 to 2,000 steps lowers this error from 0.164 Å to about 0.08 Å, with little further change after 100 steps. Relative to a bond length, the error is small.
When an atom is placed, the predicted angles sometimes cannot be realized together. The decoder applies three adjustments in a fixed order. Appendix C.2, Table 8 counts them.
The first drops the sibling angle. On a non-root atom, if a later child's angle to the parent bond is already within about 10−6 degrees of 0∘ or 180∘, the two bonds coincide and no rotation about the parent remains. The sibling angle is then meaningless, and the decoder places the atom along the parent bond. An ordinary near-linear bond, such as 179∘, is kept. This rate is 0% for the main model at every budget we tried.
The second pushes the sibling angle. From the second child of a non-root atom onward, the two angles to the parent bond fix an interval of sibling angles that can still be built. A prediction outside that interval is moved to the nearer endpoint, and both angles to the parent bond stay as predicted. The sibling angle cannot be realized in three dimensions without changing those parent angles. At 100 steps the main model pushes 4.11% of the eligible children, by 0.07∘ on average and 1.49∘ at most. The error on the parent angle is 0.00∘.
The third flattens a child into a plane. It applies only at a root with at least three children. The first two children define a plane. If no height above that plane can meet both angles from the third child to the first two, the required squared height is negative. The decoder sets the height to zero, so the third child lies in the plane and each of those two angles changes slightly. At 100 steps this happens in 17.76% of the main model's molecules, and each angle moves by about 0.03∘.
More sampling steps also reduce how often these adjustments are needed. From 10 to 2,000 steps, the main model's push rate falls from 9.29% to 3.55%, and its flattening rate falls from 24.98% to 16.27%. Each individual move remains a fraction of a degree. Relative to a bond angle, the adjustments are small.
Changes: