- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper introduces TopVAE, a 3D molecular variational autoencoder, in which the decoder can decode latent states unseen during training (termed dark areas) into valid molecules. The main idea is to incorporate chemical and structural constraints into the decoder's design and training.
Critical strengths
None.
Critical weaknesses
- The paper is hard to read; the method section (Section 4) reads like a technical report that describes the implementation with little intuition on the design choices and why the method is expected to work well. Also, mathematical objects are used throughout without a precise definition.
- The generation results are poor; Table 3 shows a 2D FCD of 1.056 (vs 0.130 for the best baselines) and a 3D FCD of 0.340 (vs 0.137). This questions the utility of the method in practical generation settings.
Questions for authors
- In Equation (5), shouldn't the allowed values for B in the second part be 1...K?
- Can the method be extended to 2D molecular graph generation?
6 comments
Reply #2
Q1. Allowed values of B in Eq. (5)
The second clause of Eq. (5) contains a typo. For edges selected by TopoBridge, Eq. (6) assigns zero probability to the no-bond class. Therefore, the correct constraint is:
A_{ij}=1 \Rightarrow B_{ij}\in\{1,\ldots,K\},\qquad K=3.$$ We have corrected Eq. (5) and the corresponding statement in Sec. 4.2 (lines 158–159). Eq. (6) and the implementation are already correct, so these corrections do not affect any experimental results. ## Q2. Can the method be extended to 2D molecular graph generation? TopVAE can generate 2D molecule graph in nature. TopVAE generates the 2D molecular graph, and generates it first. In Eq. (4) the adjacency, atom types and bond types form the 2D graph and are decoded before the coordinates, which are conditioned on that graph. Both constraint modules are defined on the graph alone, TopoBridge on the adjacency and ChemCO on the bond types. The 2D block of Tables 3 and 4 scores the bond graph TopVAE+DiT itself predicts, not one re-inferred from its coordinates (Appendix C.7).Thank you for the clarifications!
Could you explain the difference between the FCD values posted here and the ones in the paper? For example, here you report 0.1935 2D FCD for TopVAE+DiT, while in the paper it is 1.056 (Table 4 in the current PDF).
Reply #1
We thank the reviewer for this feedback.
W1. Design intuition and mathematical clarity
We will revise Section 4 to better explain our design intuition and clarify the mathematical definitions.
Our central intuition is to construct molecules from topology to geometry: connectivity → chemical validity → 3D structure. Rather than relying solely on independent atom-pair predictions, we incorporate molecular-level structural constraints into the decoder.
First, ensure connectivity (TopoBridge). A meaningful molecular structure requires a connected graph. TopoBridge establishes connected topology before downstream predictions, preventing fragmented molecular graphs.
Second, ensure chemical validity (ChemCO). Connectivity alone does not guarantee chemically valid bonds. ChemCO refines bond assignments according to chemical constraints, including valence limits and bond compatibility, while preserving the decoder's preferences.
Finally, predict 3D geometry. The decoder directly predicts atomic coordinates, using the learned molecular representation and topology-aware decoding.
Why this design works. Pairwise reconstruction losses cannot directly enforce global molecular properties such as connectivity and valence consistency. TopoBridge and ChemCO introduce these structural priors, while training through TopoBridge and distilling ChemCO corrections via AGCL help the decoder learn more robust predictions beyond the training posterior.
Revision. We will reorganize Section 4 around this design intuition, clarify the mathematical formulation of each module, add a worked decoding example, and provide a complete notation table in Appendix A.
W2. FCD comparison and practical generation utility
We thank the reviewer for raising this concern. We clarify two important points.
First, the reported FCD values are not directly comparable because they use different reference sets. Table 3 quotes JODO's published FCD results, which use a different reference set from ours. Since FCD depends on the reference distribution, these values should not be directly compared. Moreover, JODO's GEOM-Drugs code generates random test splits without a fixed seed (code), making the original split difficult to reconstruct from code alone.
Similarly, UDM-3D's published FCD (0.130) was directly quoted from its paper, as noted in Table 3. We can not reproduce this result, and the authors have not released pretrained checkpoints (https://github.com/lyc0930/UAE-3D/issues/4); an independent reproduction also reported substantial discrepancies (https://github.com/lyc0930/UAE-3D/issues/2).
We therefore retrained UAE+UDM from the official code and recomputed FCD using a unified reference set consistent with UDM-3D. Under this fair comparison, TopVAE+DiT achieves comparable QM9 2D FCD to UAE+UDM (0.194 vs. 0.196) and FCD3D to JODO (0.216 vs. 0.209). We will clarify these evaluation differences in the revised paper.
Table A. QM9 FCD under different reference sets (lower is better). 10,000 samples per model. TopVAE+DiT and UAE+UDM: mean ± sd over three seeds; JODO: released samples. FCD3D is computed with hydrogens removed from both generated and reference molecules.
Second, practical generation extends beyond in-distribution FCD, particularly to atom-size extrapolation. Prior work highlights this importance: DiGress achieves only 2.6%, 2.2%, and 0.0% valid-and-unique molecules at +5, +10, and +20 atoms beyond its training maximum (Vignac et al., ICLR 2023, Table 7), while real molecular design may require molecules exceeding 100 atoms (Reidenbach et al., 2025, arXiv:2505.18392).
Our results directly demonstrate this utility. On GEOM-Drugs zero-shot scaffold expansion, TopVAE+DiT more than doubles UAE+UDM's average joint completion rate (11.1% vs. 5.0%, Table 2). At +80 and +100 atoms, TopVAE achieves 97.5% sanitizability, while UAE+UDM produces no sanitizable molecules (Appendix N).
TopVAE achieves competitive generation quality under a consistent evaluation protocol, while offering substantially stronger generalization to molecular sizes beyond the training distribution.