- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes STRIDE for discovering interpretable equations from observational data. The system uses training-data hints and high-performing equations from previous iterations to guide candidate generation, separates linear from nonlinear parameters during fitting, revises equations through a critic and an executor, and retains diverse high-scoring candidates based on structural similarity. The authors evaluate prediction error, out-of-domain performance, and ground-truth term coverage using two language-model backbones on the original LLM-SR tasks and a selected subset of LSR-Synth, with ablations examining the role of each component. The paper also includes a supplementary experiment on training the critic.
Critical strengths
The full search pipeline demonstrates practical effectiveness across multiple tasks and two language-model backbones. Revision suggestions are implemented as executable equations, which are then refitted and scored; retained candidates subsequently guide further generation. The main experiments show favorable predictive and out-of-domain performance on oscillator, chemical-reaction, and biological population tasks, while the ablations and augmented LLM-SR controls also support the value of combining these components. Although the evidence is limited to the selected benchmarks, these results indicate practical value that warrants further investigation.
Critical weaknesses
-
The paper’s contributions beyond prior work remain insufficiently clear. Many reflective agent methods across different fields already have models propose candidates, critique them, and revise them accordingly; equation-discovery methods have also combined data analysis with repeated evaluation, as in DoLQ[1]: a model proposes equations → a program fits their parameters → feedback is provided based on the results → revision and search continue. STRIDE brings these steps together into one system, which has value; however, while the existing experiments support the usefulness of these designs, the authors should clarify how they differ substantively from prior methods and how much of the improvement comes from targeted repair versus more thorough parameter fitting and additional computation.
-
The central motivation lacks direct experimental validation. Figure 1 presents “promising structures being discarded because parameter fitting fails,” “nearly correct equations not being repaired,” and “redundancy in the experience library limiting search” as the main problems, but the figure is only schematic. Comparisons of fitting methods and ablation experiments show that the relevant modules are useful, but they do not directly quantify how often these failures occur or how many of them the corresponding modules actually correct. The LLM-SR controls augmented with mixed fitting and data hints in Figure 5 are helpful; further comparisons are needed to determine whether critic-guided repair outperforms simply generating more candidates under the same computational budget. Otherwise, it is difficult to distinguish the benefits of targeted feedback from those of additional search.
-
The evidence for structural recovery is insufficient to support strong claims about scientific discovery. STC (Symbolic Term Coverage) in Table 2 measures only the fraction of ground-truth terms recovered; it does not adequately reflect whether the predicted expression contains additional incorrect terms, nor does it establish that the entire equation structure is correct. The paper does not report whole-equation symbolic accuracy and does not sufficiently specify the rules for splitting equations into terms, matching equivalent terms, or aggregating results across tasks. Moreover, the experiments use only a small number of tasks from the original LLM-SR work and a subset of LSR-Synth selected using the authors’ difficulty ranking, whose weights and implementation are not fully specified. The current results should be described more cautiously as improvements in prediction and partial structural recovery. Symbolic Accuracy (SA) is itself an important metric in LLM-SRBench.
-
The structural judgments in the data hints lack sufficient justification. Statistics such as the mean and standard deviation can be calculated directly, but they do not by themselves establish whether the true equation requires a constant term or exhibits odd or even symmetry. For multivariate data in particular, testing symmetry requires holding the other variables fixed and explaining how the output after reversing the sign of the variable under examination is obtained or estimated. The paper does not sufficiently specify the calculations or thresholds underlying these judgments, making it difficult to assess when the hints are trustworthy. I am also concerned about the reliability of odd/even symmetry hints for complex multivariate relationships. Such relationships do not necessarily exhibit clear symmetry with respect to individual variables, and approximate symmetry observed in the data may hold only within the sampled range. The authors should explain how these properties are tested using observational data and analyze how inaccurate hints affect the search results.
-
My concern regarding “dominant terms” is that the contribution of one term depends on the other candidate terms: different features or terms may substitute for one another, and their coefficients may change depending on the combination, making their effects difficult to disentangle. Indeed, I believe this coupling is difficult to disentangle, and sparse regression alone does not automatically eliminate its effects.
Refs: [1] S ong, S. K., Shin, B. G., & Lee, J. Y. (2026). Discovering Ordinary Differential Equations with LLM-Based Qualitative and Quantitative Evaluation. Proceedings of ICML 2026, PMLR, 306, 115029–115067.
Questions for authors
Same with the Weaknesses.
2 comments
Thank you for clarifying the differences from DoLQ and adding the repair comparison. In my view, the overall methodological advance is still modest. My overall rating remains unchanged.
Follow-up on the Discussion
Dear Reviewer,
As the discussion period comes to a close, we wanted to follow up on the evidence you requested for the failure modes in Figure 1. Our replies report a comparison with DoLQ, a fixed-skeleton fitting analysis, a matched-budget comparison of repair strategies, and a memory-coverage ablation. We also clarify term precision and whole-equation equivalence, how the benchmark tasks were selected, and how to interpret the data-derived hints when features are correlated.
Thank you for taking another look at our responses. We would be glad to discuss any points that remain open. If the additional evidence resolves your main concerns, we would appreciate your reconsidering your rating in light of it.
Best regards,
The authors of Submission 7853