- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes MolDAS, an LLM-based framework for multi-objective molecular optimization under limited oracle budgets. The main idea is dual-sided adaptive sampling: selecting informative input molecules based on diversity and reward dispersion, and selecting low-probability generated candidates for expensive oracle evaluation. The framework further combines high-value replay with auxiliary SFT, adaptive reward weighting, and a simulator-to-oracle two-stage training procedure. Experiments based on a DrugR-initialized LLaMA-3 8B model show improvements over vanilla GRPO, especially in the oracle stage.
Critical strengths
-
The paper addresses an important practical bottleneck in LLM-based molecular optimization: how to allocate expensive oracle feedback. Treating both input selection and output evaluation as part of the feedback-allocation problem is a sensible and useful formulation.
-
The method is relatively comprehensive. In particular, the combination of adaptive sampling, replay, dynamic objective weighting, strict canonical-molecule budget accounting, and simulator-to-oracle adaptation forms a coherent training pipeline. The improvement over vanilla GRPO in the oracle stage is also substantial.
Critical weaknesses
- The central claim is oracle-efficient optimization, but the experimental evidence does not directly characterize efficiency as a function of oracle calls. The paper does not clearly report the actual Stage-2 oracle-call cap or the number of distinct oracle queries used by each method, and the main curves use RL steps rather than oracle calls on the x-axis. Stage 2 also only compares MolDAS against vanilla GRPO. As a result, it is difficult to determine whether the improvement comes specifically from better oracle allocation rather than the additional training components.
- The main experiments appear to be based on single runs. No standard deviations, confidence intervals, or multi-seed results are reported. This is particularly important because GRPO training and the proposed adaptive sampling procedure are both stochastic, while the Stage-1 improvement over GRPO is only about 3.7%. Without repeated runs, it is difficult to assess the robustness of this gain. A secondary concern is that DFRL-Mol and Genetic GFN are adapted into the authors’ common LLM framework rather than evaluated in their original formulations. This makes the comparison useful as a controlled ablation of mechanisms, but somewhat weaker as a direct comparison against prior methods.
Questions for authors
-
What is the exact high-fidelity oracle budget in Stage 2? Could the authors report optimization score versus cumulative distinct oracle calls, together with the total number of oracle queries used by MolDAS and each baseline? This would directly validate the main oracle-efficiency claim.
-
Could the authors provide multi-seed results for the main MolDAS versus GRPO comparison, including mean and standard deviation? In particular, is the 3.7% Stage-1 improvement consistent across seeds?
-
Can the authors clarify the Stage-1/Stage-2 evaluation of DFRL-Mol? The discussion appears to refer to its ADMETLab-oracle performance, while the main table only lists DFRL-Mol under Stage 1. A complete budget-matched Stage-2 comparison would strengthen the paper considerably.
5 comments
Additional Response to Q1.
In our earlier response (Section 1, "Oracle consumption and performance versus calls"), we noted that oracle calls scale linearly with training steps and that the revision would plot optimization score against cumulative distinct oracle calls rather than RL steps. We have now completed these curves, and the figure will be added to the revision as Figure 4 (Appendix A.6, "Checkpoint performance versus oracle consumption").
The figure plots the Stage-2 Opt. Score of MolDAS and vanilla GRPO against cumulative distinct oracle calls. Because cumulative calls grow linearly with RL steps, the horizontal axis measures training progress by actual query overhead.
MolDAS reaches a higher Opt. Score than vanilla GRPO at fewer cumulative calls, peaking at 0.33539 before 1,000 cumulative calls, while vanilla GRPO reaches its peak of 0.29337 only after about 1,700. At matched cumulative consumption MolDAS is already ahead, so the advantage is not an artifact of early stopping. MolDAS also terminates at 1,467 calls against 2,291 for vanilla GRPO, a 36.0% reduction, with calls counted over distinct canonical structures as before.
Gentle reminder regarding our responses
This is a gentle reminder that we have uploaded the revised manuscript and our detailed responses.
Given that the discussion phase will close soon, could you please let us know if our revisions have alleviated your concerns? We remain available to clarify any remaining points before the deadline.
Best regards, The Authors
Response 1
Summary. We thank the reviewer for the constructive questions. We report actual oracle consumption, performance against cumulative calls, and means and standard deviations across three training seeds. We also provide Stage 2 results for both additional baselines and clarify their adaptations.
1. Oracle consumption and performance versus calls
We thank the reviewer for this request, which targets the central efficiency claim directly. All Stage 2 experiments run under a common training cap of 2,880 distinct canonical structures per run. Calls are counted over distinct canonical structures across training steps; cache hits cost nothing, and final test evaluation queries are counted separately. The table below reports the total distinct oracle calls for MolDAS and each baseline:
MolDAS uses 36.0 fewer calls than vanilla GRPO, 28.1 fewer than the adapted DFRL Mol, and 31.9 fewer than the adapted Genetic GFN. In our runs, oracle calls scale linearly with training steps. The revision will therefore plot optimization score against cumulative distinct oracle calls rather than RL steps.
2. Results across three training seeds
We appreciate the reviewer's suggestion to report results across multiple seeds. We repeated MolDAS and vanilla GRPO with three training seeds per method in each stage. The table below reports mean ± standard deviation.
In Stage 1, mean Opt. Score improves by 0.0078, and mean F1 improves by 0.0355. The positive average difference therefore persists across repeated training, with a magnitude that differs from the original 3.7 comparison. In Stage 2, mean Opt. Score improves by 12.8 and mean F1 by 19.4. The means are higher in both stages, and the standard deviations quantify the variability across training seeds.
3. Stage 2 baseline coverage and adaptation
We thank the reviewer for pointing out this problem. The original DFRL Mol entry was listed under Stage 1. We now provide explicit Stage 2 results for both additional baselines. The table below reports mean ± standard deviation together with the corresponding oracle consumption:
These results extend the oracle-stage evaluation beyond vanilla GRPO. Explicit stage labels distinguish them from the original Stage 1 entry, and the reported consumption makes the oracle cost visible alongside performance. Across both metrics, MolDAS reaches a higher Opt. Score and F1 than either adapted baseline while using fewer oracle calls (1,467 against 2,039 and 2,153).