- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes CRISO, a multi-agent framework for symbolic regression. CRISO combines LLM-based hypothesis generation, AST-based hypothesis evaluation, and a global knowledge distillation mechanism that extracts reusable scientific statements from the best-performing equation and shares them across agents. Experiments on ten scientific regression tasks demonstrate strong predictive performance, including improved out-of-distribution generalization on six benchmarks.
Critical strengths
1, Strong empirical performance. CRISO achieves strong results across ten symbolic regression tasks spanning physics, chemistry, and biology, outperforming several competitive baselines, including LLM-SR, FunctionEvolve, and STRIDE. The paper additionally evaluates out-of-distribution generalization on six tasks with known ground truth equations.
2, No task-specific LLM fine-tuning required. CRISO operates with frozen backbone LLMs. The authors also provide ablation studies and experiments with different backbone LLMs to support the effectiveness and generalizability of the framework.
3, A useful real-world benchmark. The NOMC dataset provides a valuable real-world evaluation setting for LLM-based symbolic regression, reducing the risk of data leakage during pretraining.
Critical weaknesses
1, Insufficient differentiation from existing methods. First, It is unclear how CRISO's multi-agent framework fundamentally differs from the multi-island and multi-population approaches employed by LLM-SR[1] and LaSR[2], respectively. Both prior methods already incorporate multiple independently evolving search populations, along with mechanisms for information exchange. Second, the accumulation and reuse of knowledge have already been explored in recent works, such as LaSR[2]'s concept library, RESTART[3]'s structure library, and DrSR[4]'s idea library. The paper should more explicitly discuss how CRISO differs from these approaches to better establish its methodological novelty.
2, Insufficient justification for excluding LLM-SRBench[5]. Although the authors briefly discuss the differences between their evaluation datasets and LLM-SRBench, which also includes a physics-related subset. LLM-SRBench is specifically designed to evaluate symbolic regression beyond LLM memorization with total 239 tasks. Additional experiments on LLM-SRBench, or a more detailed justification for its exclusion, would strengthen the empirical evaluation.
3, Lack of symbolic accuracy evaluation. The paper reports WMAPE and L2 relative error and provides comparisons of selected discovered equations. However, these evaluations mainly measure predictive accuracy and equation complexity rather than whether the underlying symbolic structures are correctly recovered. Since six tasks have known ground-truth equations, the authors could additionally report symbolic accuracy or other commonly used evaluation metrics, such as in LLM-SRBench, to provide a more comprehensive evaluation of equation discovery performance.
Minor:
1, The ablation studies do not isolate the contribution of cumulative knowledge accumulation.
2, Authors report N/A results due to unresolved runtime errors, but the paper does not provide sufficient details about these failures or the attempts made to resolve them. This lack of clarification raises concerns about the fairness of the baseline comparisons.
[1] Shojaee, P., Meidani, K., Gupta, S., Barati Farimani, A., and Reddy, C. K. (2025). LLM-SR: Scientific Equation Discovery via Programming with Large Language Models. ICLR 2025.
[2] Grayeli, A., Sehgal, A., Costilla-Reyes, O., Cranmer, M., and Chaudhuri, S. (2024). Symbolic Regression with a Learned Concept Library. NeurIPS 2024.
[3] Li, Y., and Pan, S. J. (2026). Robust Equation Structure Learning with Adaptive Refinement. ICLR 2026.
[4] Wang, R., Wang, B., Li, K., Zhang, Y., and Cheng, J. (2025). DrSR: LLM Based Scientific Equation Discovery with Dual Reasoning from Data and Experience. arXiv preprint arXiv:2506.04282.
[5] Shojaee, P., Nguyen, N.-H., Meidani, K., Barati Farimani, A., Doan, K. D., and Reddy, C. K. (2025). LLM-SRBench: A New Benchmark for Scientific Equation Discovery with Large Language Models. ICML 2025.
Questions for authors
See Weaknesses.