- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies symbolic regression based on genetic programming, focusing on the inefficiency caused by conventional stochastic mutation and crossover operations. It proposes GESR, a gene-editing symbolic regression framework that uses multimodal BERT models conditioned on symbolic expressions and regression data to guide mutation and crossover, and reports that the resulting guided search achieves competitive or improved predictive performance while producing more compact expressions and improving search efficiency across the evaluated tasks.
Critical strengths
1.The paper uses BERT to guide mutation and crossover in GP, rather than relying entirely on random operations, and this idea is easy to understand.
2.The experiments provide relatively comprehensive coverage.
Critical weaknesses
1.The novelty and research-gap positioning are not sufficiently established. The paper is motivated by the claim that conventional GP relies on unguided random mutation and crossover, and presents learning-guided “gene editing” as the proposed solution. However, this framing is too broad. The paper’s own Related Work section acknowledges methods such as PGGP, Transformer-GP, and TSGP that already use Transformer-based priors or semantic models to guide mutation or evolutionary search. Therefore, replacing random genetic operations with informed neural guidance does not, by itself, constitute a new research gap.
2.Closely related work is missing. The paper motivates GESR by arguing that conventional GP relies on unguided random mutation and crossover and proposes data-driven guidance for these genetic operators. However, the manuscript does not discuss the recent RSSP work, Symbolic Regression with Physics-Informed Residual and Structural Sensitivity Pruning (IEEE TEVC, 2026), which similarly replaces unguided evolutionary operations with sensitivity-informed mutation, crossover, and pruning. Although RSSP focuses primarily on physics-informed symbolic regression and therefore may not constitute a directly comparable baseline for all benchmarks, it appears highly relevant conceptually. The authors should discuss this work and more clearly distinguish the novelty of BERT-guided “gene editing” from existing informed genetic-operator strategies.
3.The Introduction would benefit from a more technical and problem-driven formulation. The repeated “God” and “Hands of God” analogies are unnecessarily informal and, more importantly, obscure the actual learning problem. The proposed BERT modules are learned proposal policies trained from fitness-oriented symbolic-editing pairs, rather than agents possessing privileged knowledge of beneficial genetic operations. A more precise formulation of the underlying learning problem would substantially improve the scientific presentation.
4.The overall presentation and scientific argumentation require substantial improvement. The contribution statements do not establish a clear hierarchy between terminological novelty and substantive methodological novelty. The Methodology reads more like a description of a sequence of modules than a mechanism-driven argument organized around the core difficulty. The method section also makes performance claims before they are empirically established, thereby blurring the distinction between design intent and experimental conclusion. In addition, the theoretical section is presented as providing a justification for the proposed mechanism, while it is more accurately a conditional analysis whose conclusions depend on assumptions that are not themselves derived. The manuscript should more carefully distinguish assumptions from derived guarantees. Finally, several claims appear broader than what is directly supported by the experiments, resulting in noticeable scope inflation.
Questions for authors
1.Can the authors directly measure, on held-out symbolic regression problems, how often BERT-guided mutation and crossover produce fitness-improving offspring compared with their random counterparts, together with appropriate uncertainty estimates? It would also be helpful to report the distribution of fitness improvements produced by the guided and random operators.
2.The manuscript states that, after generating the training data, the authors compare them against the test datasets and remove training expressions with matching preorder traversals in order to mitigate data leakage. Could the authors clarify exactly what information from the benchmark test sets is accessed during this procedure and whether the pretrained models used in the reported experiments were constructed with knowledge of the final evaluation benchmarks?
3.The paper states that the comparisons are performed under controlled conditions, but the description primarily specifies common input ranges, constraints, and population sizes. Could the authors clarify whether the methods are also matched in terms of total fitness evaluations, number of generations, constant-optimization calls, computational hardware, and overall search budget?
4 comments
Author Response to Reviewer Comments(Critical Weaknesses-3~4 and Questions For Authors-1)
Critical Weaknesses-3
Dear Reviewer,
We sincerely thank you for this constructive suggestion. We agree that the analogies of "God" and "Hands of God" were overly informal and did not accurately characterize the learning problem investigated in this work. Therefore, we have removed these analogies and revised the Introduction to present GESR in a more precise and problem-driven manner.
Specifically, we now formulate genetic editing as a data-conditioned proposal learning task, aiming to learn editing policies from fitness-oriented symbolic editing examples. The two multimodal BERT models do not possess privileged knowledge of which genetic operations will necessarily improve fitness. Instead, they learn to assign higher probabilities to potentially beneficial edits based on expression structures and input-output observations.
More specifically, the mutation model predicts suitable replacement symbols at selected positions, while the crossover model jointly processes two parent expressions to predict the corresponding subtree crossover points. These learned proposal policies are designed to increase the probability of fitness-improving genetic operations while preserving the exploratory nature of GP.
Furthermore, we have revised the research motivation and contribution statements to emphasize that the core novelty of GESR lies in explicitly learning fine-grained mutation and crossover decisions, rather than simply incorporating neural guidance into genetic programming.
We sincerely appreciate the reviewer's valuable feedback, which has helped improve the technical clarity and scientific rigor of our manuscript.
Critical Weaknesses-4
We sincerely thank the reviewer for the constructive feedback. We agree that the original manuscript could more clearly distinguish methodological contributions, design objectives, theoretical assumptions, and empirical conclusions. We have revised the manuscript accordingly.
First, we have reorganized the contributions to emphasize the substantive methodological novelty of GESR, particularly the explicit learning of fine-grained mutation and crossover decisions, rather than the terminology of "gene editing."
Second, we have refined the Methodology to provide a more problem-driven explanation, clarifying how the two multimodal BERT models learn data-conditioned editing policies from fitness-oriented training examples. We have also revised premature performance claims to distinguish intended benefits from experimentally demonstrated improvements.
Third, we acknowledge that our theoretical results are conditional on specific assumptions rather than unconditional performance guarantees. We have clarified these assumptions and the scope of the derived conclusions.
Finally, we have revised overly broad statements to ensure that our conclusions remain consistent with the evaluated benchmarks and experimental evidence.
We appreciate the reviewer's suggestions, which have helped improve the clarity and scientific rigor of our manuscript.
Questions For Authors-1
Dear Reviewer,
We sincerely thank you for your valuable suggestion. We agree that directly comparing the probability of fitness improvement between BERT-guided and random genetic operations provides a more direct evaluation of the effectiveness of our proposed gene-editing mechanism. Following your suggestion, we conducted additional experiments to quantify these improvements.
Specifically, we randomly sampled 100 test expressions and generated the corresponding datasets . For each test expression, we independently evaluated mutation and crossover operations.
1. Mutation Experiment
For each test expression , we first randomly generated an expression and calculated its fitness . We then randomly mutated one symbol in to obtain expression , with fitness . Next, we applied the BERT-guided mutation model to the same expression to generate expression , with fitness .
We compared the fitness improvements achieved by random mutation and BERT-guided mutation, using as the reference. Each test expression was evaluated 10 times, resulting in 1,000 mutation trials for each strategy.
Author Response to Reviewer Comments(Questions For Authors-1~3)
2. Crossover Experiment
Similarly, for each test expression , we randomly generated two parent expressions and , with fitness values and , respectively.
We first performed random crossover to generate two offspring expressions and , with fitness values and . We then compared the maximum offspring fitness with the maximum parent fitness:
For comparison, we applied the BERT-guided crossover model to the same parent expressions and , generating offspring and , with fitness values and . We similarly evaluated whether:
Each test expression was evaluated 10 times, resulting in 1,000 crossover trials for each strategy.
3. Experimental Results
The experimental results are summarized below:
| Genetic Operation | Random (%) | BERT-Guided (%) |
|---|---|---|
| Mutation | 48.7 | 82.3 |
| Crossover | 50.9 | 71.7 |
The results show that BERT-guided mutation and crossover achieve higher probabilities of fitness improvement than their random counterparts under the evaluated experimental settings. Specifically, the probability increases by 33.6 percentage points for mutation and 20.8 percentage points for crossover.
These additional experiments have been incorporated into Appendix D.7, "Effectiveness of BERT-Guided Genetic Operations" (Page 33) of the revised manuscript.
We sincerely appreciate your constructive suggestion, which has helped us provide more direct empirical evidence supporting the effectiveness of the proposed gene-editing mechanism.
Questions For Authors-2
Dear Reviewer,
We sincerely thank you for raising this important concern. We would like to clarify that we explicitly check for potential overlap between the training and test sets during the training data generation process.
Specifically, whenever a new training sample is generated, we compare its expression representation, encoded as a preorder traversal sequence, against all expressions in the test set. If an identical sequence is detected, the generated training sample is immediately discarded.
This procedure is designed to prevent exact expression-level overlap between the training and test sets, thereby minimizing the risk of data leakage and ensuring a more reliable evaluation of the model's generalization ability.
We sincerely appreciate your careful review and valuable feedback.
Questions For Authors-3
Dear Reviewer,
We sincerely thank you for your valuable comments. We would like to clarify that all methods were evaluated under identical conditions in terms of fitness evaluation, the number of constant optimization calls, computational hardware, and the overall search budget.
Regarding the number of evolutionary generations, since different methods exhibit different optimization behaviors, we adopted the same stopping criteria and maximum number of iterations for all methods. However, the actual number of evolutionary generations required to optimize each test instance may vary across algorithms.
We agree with your insightful observation that the actual number of evolutionary generations is also an important evaluation metric, as it may more directly reflect the effectiveness of the proposed gene-editing mechanism than execution time alone.
Therefore, following your suggestion, we conducted additional experiments using the same datasets and stopping criteria as those in the Inference Time Test and recorded the actual number of evolutionary generations required by each algorithm.
The corresponding results have been incorporated into Section 4.4, "Evolutionary Generation Analysis" (Page 9) of the revised manuscript. We kindly invite you to review these additional results.
We sincerely appreciate your constructive suggestion, which has helped us provide a more comprehensive evaluation of GESR.
If you have any further questions or concerns, we sincerely encourage you to share them with us. We would be more than happy to continue the discussion and provide any additional clarifications.
If our responses have adequately addressed your concerns, we would be sincerely grateful if you could reconsider your evaluation and consider raising your score.
Thank you once again for your valuable time and constructive feedback. We wish you all the best!
Thank you for the detailed responses and revisions. The clarifications are helpful, and some of my concerns have been addressed. However, I still have reservations about whether the revisions sufficiently resolve the main concerns regarding the methodology and experimental validation. Overall, although the manuscript has improved, I am not fully convinced by the current responses. I will therefore maintain my original assessment.
Author Response to Reviewer Comments(Critical Weaknesses-1~2)
Dear Reviewer,
We sincerely thank you for your careful review and valuable comments. For your convenience, we have highlighted the revisions made in response to your comments in orange. Please note that some revisions overlap with those requested by other reviewers and may therefore be highlighted in different colors. The updated PDF has been uploaded for your review.
Critical Weaknesses-1
We sincerely thank the reviewer for this insightful comment. We agree that learning-guided evolutionary search is not an entirely new research direction, as existing methods such as PGGP, Transformer-GP, and TSGP have already demonstrated the effectiveness of incorporating learned structural priors or semantic guidance into genetic programming. We acknowledge that the motivation presented in the original manuscript was overly broad and did not sufficiently distinguish GESR from these existing approaches.
However, the core novelty of GESR does not lie in being the first to introduce neural guidance into genetic programming, but rather in explicitly learning fine-grained genetic editing decisions, particularly the selection of crossover points. Existing approaches primarily leverage learned structural priors or semantic representations to guide expression initialization, mutation, or offspring generation. In contrast, GESR directly models specific editing decisions within conventional genetic operations.
Specifically, GESR employs two specially designed multimodal BERT models. The mutation model predicts which symbol should replace a selected symbol based on the expression structure and input-output observations. More importantly, the crossover model jointly considers two parent expressions and the corresponding data to explicitly predict the crossover points for subtree exchange. This enables GESR to learn not only how to modify an expression but also where genetic information should be exchanged between two parent expressions.
Therefore, the research gap addressed by GESR is not the absence of learning guidance in existing genetic programming methods, but rather the relatively limited exploration of explicit, data-conditioned learning of fine-grained mutation and crossover decisions.
In the revised manuscript, we have expanded the discussion of these related approaches in the Introduction, refined our novelty claims, and clarified the distinction between model-guided expression generation and the direct prediction of genetic editing decisions. Furthermore, we have added direct experimental comparisons between GESR and the aforementioned baselines (Table 7, Page 28).
We sincerely appreciate the reviewer's constructive feedback, which has helped us more accurately position the methodological contributions of GESR within the existing literature.
Critical Weaknesses-2
Dear Reviewer,
We sincerely thank you for bringing this highly relevant work to our attention. We acknowledge that RSSP and GESR share similar research objectives, as both aim to improve random genetic operations in genetic programming by incorporating additional guidance. We also recognize that the original manuscript overlooked this important study, and we have added the corresponding discussion to the Related Work section of the revised manuscript.
However, GESR and RSSP differ in their guidance mechanisms and the granularity of genetic editing decisions. Specifically, RSSP employs physical residual sensitivity and structural sensitivity to guide subtree mutation, crossover, and pruning, primarily targeting symbolic regression problems involving differential equations. In contrast, GESR employs two multimodal BERT models to explicitly learn genetic editing decisions from input-output observations and expression structures. The mutation model predicts suitable symbol replacements, while the crossover model directly predicts crossover points in two parent expressions.
Furthermore, RSSP relies on physical priors and sensitivity evaluations, whereas GESR does not require predefined governing differential equations or the construction of physics-informed neural network surrogate models. Therefore, GESR can be applied to more general data-driven symbolic regression tasks.
We have expanded the discussion of RSSP in the revised manuscript and further clarified that the novelty of GESR does not lie in being the first to introduce guided genetic operations, but rather in explicitly learning fine-grained mutation and crossover decisions through multimodal BERT models, particularly the direct prediction of crossover points.
We sincerely appreciate the reviewer's valuable suggestion, which has helped us more accurately position the contributions of GESR relative to existing research.