- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper focuses on using a fragment-based method for LLM-based molecular optimization. The LLM reasons about edits at the level of functional groups, but generates molecules token by token, and the generated molecule is evaluated by an oracle as a whole for a single reward. The paper uses MacFrag to build a fragment library and stores the editing history in a structured memory. Rather than using only the final reward after editing, the paper uses Monte Carlo Shapley values to estimate the contribution of each fragment edit and assigns token-level credit accordingly. Experiments are conducted on the PMO benchmark.
Critical strengths
- The paper focuses on the credit assignment problem in molecular editing. Since functional groups are closely related to specific chemical properties, assigning credit to fragment edits rather than to the whole molecule may improve GRPO training and the resulting policy.
Critical weaknesses
-
The motivation is not well verified. The paper claims a mismatch among reasoning at the functional-group level, generation at the token level, and rewards at the whole-molecule level. However, Figure 1 only measures whether generated molecules follow the intended edit strategy, which is at most the gap between reasoning and generation. This is a different problem and cannot support the paper's claim.
-
The proposed credit assignment is not clearly connected to the claimed mismatch. Assigning the same advantage to all tokens is a general credit-assignment issue in GRPO, which would exist even without the mismatch, and the paper does not show that standard GRPO fails because of it. Moreover, the benefit of FA-GRPO is only weakly supported by Table 2, which uses a single backbone and reports no variance.
Questions for authors
-
Compared with common fragment decomposition methods such as BRICS, what is the advantage of MacFrag, and why is it chosen?
-
Why does FragThinker (GPT-4) perform better than MOLLEO? Do both use the same LLM backbone and initial molecule pool?
-
Does the model generate an explicit reasoning process before the edit? If so, Eq. 7 appears to assign the molecule-level advantage to all reasoning tokens. Does this mean the reasoning that motivates an edit receives no fragment-level credit?