- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper addresses the problem of expanding the generable set of pretrained models under black-box verifier feedback. It proposes EXPANSE, which separates exploration from generator updates using occupancy-guided probing and rejection-aware training. Experiments on synthetic benchmarks and QM9 show improved coverage of valid regions and promising results in molecular validity and novelty compared with the evaluated baselines.
Critical strengths
-
The paper addresses an important problem in generative scientific discovery by separating exploration from generator updates. The motivation is clear and the proposed framework is well structured.
-
EXPANSE achieves substantial improvements over ActFlow in the 2D benchmark, particularly in discovering disconnected valid regions. The ablation studies provide useful evidence for the roles of seed perturbation, directed exploration, and replay separation.
-
The reachability analysis provides a useful geometric interpretation of the exploration process. The paper is generally well written and discusses several limitations of the proposed approach.
Critical weaknesses
-
The paper presents EXPANSE as a general framework for generable set expansion in generative scientific discovery. However, the proposed one-step formulation is mainly evaluated on a 2D synthetic benchmark, while the QM9 experiments use a few-step sampler. Evaluation of the one-step approach on more complex design tasks would strengthen the empirical support for the main claim.
-
The exploration mechanism relies on occupancy-guided probing to discover unexplored regions. While the paper provides ablations on individual components, it lacks comparisons with exploration baselines such as random perturbation or distance-based novelty search. Such comparisons would help clarify the specific benefit of the proposed occupancy guidance.
Questions for authors
Please refer to the above weaknesses.
3 comments
Follow-up for Reviewer daCH: new results since our rebuttal
Dear Reviewer daCH, thank you for your review. Our rebuttal added the two exploration baselines you named (random perturbation and kNN novelty), where occupancy ascent covers 80.5% of the disconnected component at Δ=2 against 59.8% and 10.4%. Since then we have posted three further results that bear on your points.
Generalisation without retuning. At held-out gaps Δ=1.5 and 2.5, with every setting frozen, EXPANSE leads ActFlow by 15 to 21 points of total coverage (Welch p=0.016 to 0.037) and reaches the disconnected component 3 to 10 times sooner.
Beyond ActFlow. Against Variational Search Distributions and Generative Bayesian Optimization as evaluated, both stay at 3.0% coverage when started from the pretrained model, against 90 to 93% for EXPANSE. With a uniform prior, VSD keeps pace only while the design space is small enough to sample, and EXPANSE holds 88.5 to 90.2% as the space grows 64-fold in area.
QM9. A factorial over the probe and the rejection mixture shows the two working as a pair: together they give the highest discovery per valid molecule of the three arms and a 5.8× smaller seed spread than consolidation alone. EXPANSE finds 6.3× and 13.4× as many valid new clusters as ActFlow at four and 100 steps.
Full tables are in our replies to mA4z and QiLn. If any concern remains, we would be grateful to hear it during the discussion period so we can respond with evidence.
Thank you for the authors’ response and the additional experiments. The newly added random perturbation and kNN novelty-search baselines have alleviated my earlier concern about the insufficient comparison of exploration mechanisms. However, with respect to the effectiveness of the single-step method on complex tasks, the response still does not provide sufficient evidence. The validation of single-step generation remains limited to 2D generation experiments. although the additional QM9 experiments strengthen the empirical support for the framework on complex tasks, since they employ a four-step sampler, the applicability of the single-step generation capability emphasized in the paper to complex tasks remains to be verified. Therefore, I maintain my original score.
Rebuttal response for Reviewer daCH
Thank you for the detailed review. We have addressed each point with new experiments, and uploaded the revised version of the paper with new text marked in blue.
Beyond the 2D benchmark. The one-step results are on ActFlow's released benchmark, where coverage is exact, now swept over gaps 0 to 6 (Table 6). The same two stages carry to molecules. On QM9 a four-step EXPANSE sampler finds 6.3× as many valid new clusters as ActFlow at four steps, 13.4× as many as ActFlow at 100 steps and 2.2× as many as the frozen teacher under equal compute (Table 7). Its count keeps growing while ActFlow's four-step count falls.
Table 6. Larger gaps and the coverage force. Coverage (%) at α=1 with ρ=Δ+0.5, which uses the gap and is not available in practice. EXPANSE has five seeds at Δ=4 and 6 and three at Δ=3 and 5. ActFlow has three seeds.
Table 7. QM9 at 4 NFE under 16k NFE per cell, α=1. Entries are centers at τ=0.2 / new centers at cutoff 0.4 / validity (%), mean ± sample standard deviation over four seeds for EXPANSE and Rec-F and three for ActFlow. The frozen teacher at 4 NFE has 174 / 645 / 27.9. The two 100-NFE rows draw 160 molecules per cell.
Exploration baselines. We added both baselines you named at the same seed scale and travel budget. At gap 2 occupancy ascent covers 80.5% of the component against 59.8% for random perturbation and 10.4% for distance-based novelty, with less than half the seed spread. At gaps 0 and 1 the three agree, so occupancy guidance pays exactly where reach is hard (Sec. 4.3, Table 4).
Table 4. Probe direction at Δ=2. The base method has no coverage force. It uses five seeds, α=1, τ=0.05, and the same σ0 and ρ in every row.
Theory. The geometric analysis you found useful now proves upper and lower probability bounds on reaching a region, and it predicts the measured queries in the component (747 against 755 at gap 2, Table C).
Table C. Capture mass against logged queries, Δ=2, coverage force, five seeds (Appendix B.1, Fig. 9). These are Monte Carlo consistency checks, not certified bounds.
Verifying these numbers. Each table here regenerates from the supplementary zip with one command:
python -m drift.dump_numbers controlsfor Table 4,forcefor Table 6,qm9for Table 7 andpython -m drift.capture --plotfor Table C. The occupancy probe also helps outside our loop: on ActFlow's own sampler it raises total coverage by 8 to 28 points, while random seed perturbation alone on the same sampler gives 62.9 and 58.3 total and 29.4 and 0.0 component coverage at gaps 1 and 2.Please let us know if any further experiments or clarification are required during the discussion period or before the camera ready version. We will be happy to discuss and perform further experiments.