- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces HER-PDE, a scientific-agent framework for discovering open-form PDEs with unknown, nonparametric, time-invariant spatial coefficient fields. The key idea is to separate structural hypothesis generation from continuous coefficient estimation: an LLM agent constructs complete PDE expression trees, while the proposed Hypothesis Evaluation Interface (HEI) fits the spatial fields and evaluates candidates using short-horizon prediction across two excitations sharing the same underlying fields.
Critical strengths
- The combination of open-form structural discovery with nonparametric spatial fields is important and technically challenging. Explicitly preserving operator scope and shared-field identity is particularly valuable and distinguishes the framework from fixed-library variable-coefficient approaches.
- The evaluation includes 35 environments and 105 runs, multiple search baselines, field-sharing ablations, sealed prediction, field recovery, noise and morphology shifts, and a real-data case study. The improvement over matched controls is substantial: 70/105 exact recoveries versus 39/105 for typed evolution and 27/105 for the Flat Agent.
Critical weaknesses
- The discovery space is still substantially constrained by HEI. Although described as “open-form,” practical discovery is limited to the evaluator’s supported evolution class, including scalar autonomous dynamics, specified derivative support, time-invariant coefficient fields, and affine field dependence. Thus, the framework does not yet establish that the approach generalizes to broader PDE systems, time-varying fields, coupled states, or more general field interactions.
- The contribution of individual Agent-design components is not isolated. The Flat Agent ablation simultaneously removes the phase transition, minimum-hypothesis requirement, raw-data freeze, global/local search instructions, and score-cadence reminders. Consequently, the large 70/105 vs. 27/105 improvement establishes the effectiveness of the controller as a whole, but does not reveal which components are responsible for the gain. This weakens the mechanistic evidence for the proposed agent design.
Questions for authors
Could you please explain or address the weaknesses raised above?
2 comments
(2/2)
W2:
The contribution of individual Agent-design components is not isolated. The Flat Agent ablation simultaneously removes the phase transition, minimum-hypothesis requirement, raw-data freeze, global/local search instructions, and score-cadence reminders. Consequently, the large 70/105 vs. 27/105 improvement establishes the effectiveness of the controller as a whole, but does not reveal which components are responsible for the gain. This weakens the mechanistic evidence for the proposed agent design.
A:
The same HEI supports HER-PDE, Flat and typed evolution, letting us study how different controllers organize hypothesis testing.
The original Flat comparison measures the controller as a whole. We therefore ran four variants, each removing one mechanism while retaining the others: seven families, the first environment of each, and three runs per environment, giving 84 additional runs. Full HER-PDE and original Flat below are the corresponding 21-run subsets of the primary benchmark. We also added 21 matched-evaluation Flat runs, described below.
| Controller | Exact recovery | Mean HEI evaluations |
|---|---|---|
| Full HER-PDE | 16/21 | 31.05 |
| Without minimum-hypothesis requirement | 14/21 | 30.81 |
| Without raw-data freeze | 10/21 | 19.29 |
| Without global/local search guidance | 11/21 | 23.29 |
| Without score reminders | 15/21 | 28.57 |
| Flat Agent, original | 7/21 | 15.43 |
| Flat Agent, matched HEI count | 12/21 | 31.05 |
The four component ablations retain the same data, HEI, language, model request settings and budget ceilings: 36 exploration turns, two selection turns and 96 HEI evaluations. They retain the phase schedule; removing the minimum-hypothesis requirement keeps the turn-16 checkpoint. Appendix C.3, pp. 30–31, and Table 19 report this component study. The additional matched-evaluation control is reported here.
The controller affects both how extensively the Agent tests hypotheses and how it uses their feedback. Under the same 96-evaluation ceiling, HER-PDE used 31.05 evaluations per run, versus 15.43 for Flat. Sustaining this search is itself part of the controller's contribution. To examine recovery at the same evaluation count, we required each new Flat run to reach its paired HER-PDE run's actual count, also using that count as its cap. These quotas ranged from 8 to 61. Flat received the same observations, DSL, HEI and model request settings, plus a remaining-budget counter. It freely analyzed data and revised candidates, without HER-PDE's two-phase schedule or global/local guidance. We allowed up to 128 exploration turns, followed by two selection turns, to give Flat enough opportunity to reach its quota.
All 21 runs reached their exact quotas and submitted a final equation: 652 HEI evaluations for each method, averaging 31.05 per run. Matched-count Flat recovered 12/21 structures (57.1%), up from the original 7/21, while HER-PDE recovered 16/21 (76.2%). These results support two complementary contributions of the combined controller: sustaining more hypothesis testing within the available budget, and achieving higher recovery at matched evaluation counts. The latter advantage is 19.0 percentage points on this subset.
Across the full benchmark, HER-PDE recovers 70/105 structures versus Flat's 27/105 with the same HEI. The new controls strengthen the evidence for individual design choices and the combined controller at matched evaluation counts.
We sincerely appreciate the time and care you have devoted to reviewing our work. Your feedback has helped us strengthen both the paper and its supporting evidence. If our clarifications and additional results have addressed your main concerns, we would be very grateful if you would consider revisiting your assessment and score. Should any concerns remain, we would sincerely welcome the opportunity to discuss them further.
(1/2)
W1:
A:
Thank you for your thoughtful comments and valuable ablation suggestions. We have added the comparisons you suggested and explain below how we have clarified the scope of our work.
We appreciate you pointing out that “open-form” could be read more broadly than the class HEI currently evaluates. We apologize that the original manuscript did not make this distinction clear enough.
Open-form search composes differential operators, nonlinear state functions and unknown spatial fields without a predefined term library. HEI evaluates scalar autonomous evolution equations with time-invariant fields entering affinely, including through their derivatives.
This class includes important physical models. For example, ut=∇⋅(D(x,y)∇u) describes source-free heat conduction in heterogeneous materials with uniform volumetric heat capacity, or groundwater flow with uniform storage. The field D represents spatially varying thermal or hydraulic diffusivity. Replacing the flux divergence by D(x,y)Δu removes the contribution from spatial variation in D, changing the conservation law. Searching field placement therefore addresses a physical modeling choice.
Nonlinear reaction terms also describe biological growth. In our measured bacterial growth–migration case (Section 4.4, Figure 3), the Agent proposed ut=βuxx+a(x)u−u2. Here diffusion represents migration between wells, a(x) describes spatially varying growth under antibiotic exposure, and −u2 represents density-dependent inhibition. This connects equation discovery to an interpretable model of measured population dynamics.
Although we do not claim generalization to broader PDE systems, coupled states, time-varying fields or non-affine field interactions in the present study, your question highlights valuable directions for extending our framework. We thank you for bringing these directions into focus and plan to pursue them in future work. We have added Appendix K, “Future work” (p. 48), outlining extensions to coupled states, evolving fields and more general field interactions.
To address your concern, we have revised the Introduction, paragraph 3 (pp. 1–2), and Section 3.1, paragraph 2 (p. 5), to explain how open-form construction relates to HEI's evaluation scope. We have also made the supported class explicit in Section 3.2's opening paragraph (p. 5), so readers can see this boundary when the evaluator is introduced. Revisions and additions are marked in green in the revised manuscript. We are grateful for your suggestion to make this distinction clearer.