- Rating
- 2
- Confidence
- 2(−1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(−1)
Read review
Paper summary
This paper proposes GX-TGVAE, a latent-space molecular generation framework that aims to faithfully represent existing molecules, enable controllable exploration directions, and ultimately improve the discovery of high-value molecules. Specifically, the framework combines constraint-masked graph generation with Geometry-Guided Exploration and an ES + Massive Harvest extension. The paper demonstrates strong reconstruction and structural reach performance on MOSES. It also provides extensive mechanistic and empirical analyses, showing the effectiveness of property-guided exploration and identifying a sampling-mass bottleneck in OOD molecular discovery. The proposed ES + Massive Harvest extension further improves novel-hit yield under the specified evaluation-time budget. However, although the experiments support the practical usefulness of the proposed components, they do not sufficiently establish the distinct methodological contributions or underlying mechanisms of each component. Consequently, despite the promising results, the framework appears to rely heavily on combining multiple existing techniques, without sufficiently clear evidence isolating the contributions of its key innovations.
Critical strengths
The paper provides an interesting perspective on molecular OOD exploration by distinguishing representation fidelity, directional control, and sampling-mass allocation as complementary factors. In particular, the identification of the sampling-mass bottleneck offers a useful insight into the limitations of the original exploration strategy. The experimental evaluation is extensive, covering reconstruction, structural reach, directional controls, and OOD discovery. The authors also provide meaningful mechanistic and empirical analyses, with promising results on several metrics, while carefully acknowledging the limitations of their methods and findings.
Critical weaknesses
- Unclear narrative and insufficient methodological positioning.
Although the paper provides detailed analyses, the Abstract and Introduction do not clearly connect its main contributions. The Related Work section also insufficiently discusses existing latent-space molecular optimization methods, making it difficult to assess the novelty of the proposed geometric exploration.
- Limited novelty and insufficient isolation of key contributions.
The framework combines several established techniques, and the existing ablations do not fully establish their independent contributions. In particular, the geometric experiments do not sufficiently distinguish the benefits of tangent/normal geometry from general gradient projection effects. Moreover, while ES + Massive Harvest improves upon the original sampler, which underperforms MOOD, the effects of ES and the Harvest selector are not adequately isolated. The comparison also lacks matched end-to-end computational budgets, limiting claims of practical efficiency. For example, TanNorm and TanNormES use different neighborhood sizes (50 vs. 256), making it difficult to isolate the effect of ES itself (Appendix I.1).
Questions for authors
-
What is the unique contribution of the proposed tangent/normal geometry to OOD molecular discovery? Although the directional controls show promising results, could the authors further clarify whether the improvements arise from meaningful local latent geometry rather than general gradient projection? Would similar gains be achieved using random or fixed subspaces?
-
Which components are primarily responsible for the final improvements in novel-hit discovery? Could the authors provide more controlled ablations to isolate the contributions of ES, the Harvest selector, and sampling-budget reallocation? In particular, is geometry-guided exploration still necessary when ES and Massive Harvest are applied?
-
What is the central methodological contribution that unifies the three proposed design axes? Could the authors clarify how these components form a coherent research contribution rather than a collection of separate improvements?
8 comments
Author Response to F9Se (2/5): Q3 — Unifying Contribution
Second, we used this generative foundation to analyze the capabilities and limitations of geometric OOD exploration.
We examined how directional manipulation in latent space affects the structural OOD of generated molecules and external docking utility.
We observed that local direction selection affects generated structures and external utility, and that, in deep OOD regions, the extrapolative accuracy of surrogate predictions does not necessarily align with the usefulness of the directional information supplied by their gradients.
In other words, we experimentally confirmed that useful directional information can persist even in extrapolative regions where predicted values break down.
We also analyzed reaching deep OOD regions, supplying candidates to those regions at sufficient frequency, and obtaining useful candidates there as distinct exploration capabilities.
Third, we analyzed the bottleneck limiting discovery efficiency and intervened to improve it.
In the comparison with MOOD, we decomposed Novel Hit Ratio into screening-pass yield and conditional hit efficiency.
GX-TGVAE's base sampler had relatively high hit efficiency after screening, but a low rate of supplying candidates to the screening-pass set, limiting the number of hits discovered under a finite evaluation budget.
This screening-pass sampling-mass problem is distinct from the sampling density and conditional utility within structural OOD bands analyzed earlier.
Based on this diagnosis, we introduced ES to select candidate exploration directions and Harvest to select promising neighborhoods and allocate evaluation resources, and evaluated their respective contributions through additional controls.
The three axes therefore do not form a collection of independent technical improvements. They constitute a connected study of building a generative foundation that enables exploration of unknown structures, scientifically analyzing its capabilities and limitations, and intervening on the identified bottleneck in discovery efficiency.
The central architectural contribution is the information interface connecting molecule-level continuous latent representations to constrained primitive construction. Geometry, ES, and Harvest are exploration methods for progressively examining and improving directional control and discovery efficiency on this foundation.
Author Response to F9Se (3/5): Q3 — Related Work
We also clarified the positioning relative to existing VAE latent optimization and geometric exploration in the revised manuscript.
Bayesian optimization and optimization using property-predictor gradients have already been studied in molecular VAE latent spaces. To address unstable generation far from the training distribution, prior work has proposed validity-constrained search, decoder-uncertainty guidance, and regularization that discourages departure from the latent distribution.
Nevertheless, an important bottleneck in conventional VAE latent optimization is that decoder generation can become unstable in latent regions far from the training distribution, making invalid molecular structures more likely.
To address this problem, prior studies have proposed constraining latent exploration to regions near the training data or where the decoder is reliable, or using decoder uncertainty to avoid uncertain regions.
Thus, there is a tension between advancing exploration and maintaining the validity of generated structures; one research direction has addressed this by restricting exploration to reliable latent regions.
To clarify this positioning, we expanded Section 2 (Related Work) of the revised manuscript, with relevant references, to discuss Bayesian optimization in VAE latent spaces, gradient-based optimization, validity-constrained search, decoder-uncertainty guidance, and regularization that discourages deviation from the latent distribution.
In contrast, we sought to address this problem through the generative architecture so that extrapolation into unknown regions could be pursued actively.
Specifically, we integrated whole-molecule continuous latent representations and chemically constrained primitive graph construction into a single Graph-to-Graph VAE.
This allows exploration to move freely beyond the training distribution in continuous latent space while applying known chemical constraints to the current partial graph at each step of discrete molecular construction.
Rather than avoiding structural breakdown by restricting the range of latent exploration, we separate continuous exploration from discrete construction rules to establish a foundation for generating legal structures even at extrapolated latent points.
An important advance is that establishing this generative foundation allows active latent extrapolation beyond the training distribution to be treated as an explicit exploration strategy for molecular generation.
We then examined Geometry-Guided Exploration, which uses the local geometry of learned molecular representations to control exploration directions rather than leaving extrapolation to random vector movements.
Specifically, we estimate local subspaces of the latent distribution and project property gradients into those subspaces to construct exploration directions toward unobserved regions using learned information.
We further evaluated the effects of geometric direction selection on structural OOD reach and external utility through controls using random directions, gradients in the full active space, and equal-rank random subspaces.
The distinction of our work is therefore not simply vector manipulation or property optimization in a VAE latent space.
It lies in addressing unstable structure generation in OOD regions—a problem in conventional latent optimization—by separating continuous latent exploration from chemically constrained discrete construction, enabling active geometric extrapolative exploration on that foundation, and systematically evaluating its usefulness.
Author Response to F9Se (1/5): Q3 — Generative Foundation
Response to Reviewer F9Se
We thank the reviewer for the careful review and for recognizing our analysis of OOD exploration, particularly the treatment of representation fidelity, directional control, and sampling-mass allocation as distinct elements.
We understand the central concerns to be clarifying the methodological contribution that unifies the three research axes and experimentally separating the contributions of Geometry, ES, and Harvest.
In response, we clarified the overall research logic and conducted additional direct controls involving equal-rank subspaces, matched ES, the Learned selector, and Geometry-after-Harvest.
Below, we address the unifying contribution in Q3, Geometry's specific role in Q1, and the contributions of ES, Harvest, and evaluation-budget allocation in Q2.
Q3. What is the central methodological contribution that unifies the three research axes?
The central objective unifying this work is to establish a generative foundation for directionally controlled exploration of unobserved structures using existing molecular knowledge, and scientifically evaluate its exploration capabilities and discovery efficiency.
The three research axes are organized as successive stages of design and validation toward this objective.
First, we developed GX-TGVAE as a generative foundation for exploring unknown structures.
Existing molecular VAEs face the problem that decoder generation can become unstable in latent regions far from the training distribution, producing invalid structures.
Constrained primitive graph generators such as GraphXForm can maintain chemical legality during construction. On their own, however, they do not constitute a Graph-to-Graph VAE that represents entire molecules in continuous latent coordinates and explores by manipulating those coordinates.
We connect whole-molecule continuous latent representations with chemically constrained primitive construction, separating the freedom of continuous latent exploration from the legality of discrete construction.
To do so, we integrate latent conditioning from an empty graph, information delivery to each construction stage through latent tokens and a persistent global construction token, and reconstruction learning through canonical construction traces into one coherent generative architecture.
The important point is not merely assembling existing techniques, but establishing an information interface and training configuration that connects whole-molecule latent information to constrained sequential construction, enabling molecule-specific reconstruction and latent-space manipulation.
We validate this foundation through latent-intervention controls, high reconstruction fidelity, observed Validity and Connected Validity, and reach into unseen structures.