- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes MechSim, a multi-agent framework that constructs Simulation Reasoning Graphs (SRGs) to represent simulator mechanisms, assumptions, and execution traces. LLM agents reason over these graphs to generate explanations and decision recommendations. Experiments across three domains report improvements in explanation quality and decision-making.
Critical strengths
The problem of mechanism-grounded reasoning over scientific simulators is important, and explicitly representing simulator assumptions and mechanisms is potentially useful.
Critical weaknesses
-
Limited novelty and weak baselines. The framework largely combines existing techniques (RAG, graph extraction, sensitivity analysis, and LLM verification). The main baselines are not designed for reasoning over executable simulators. A strong coding-agent (even just codex or opencode harness) baseline with equivalent simulator access, tools, and test-time compute is essential. The current coding-agent ablation is insufficiently characterized.
-
Potentially biased evaluation. The LLM judge explicitly evaluates explanations against the proposed SRGs, favoring MechSim's representation. The ablations also fail to isolate the contribution of SRGs from additional information, tool use, and verification.
-
Limited benchmark validity. The experiments focus on relatively simple simulators and synthetic oracle-based evaluations. Notably, Appendix F shows that ARIMA substantially outperforms all candidate mechanistic simulators on COVID-19 forecasting, raising concerns about the practical relevance of selecting among these models.
Questions for authors
How does MechSim compare with a strong coding agent or generic agentic harness?
2 comments
Thanks for authors' response. I still think the baselines are pooly justified and the evals are not solid enough for claiming MechSim is helpful. My score remains the same.
We thank the reviewer for the helpful comments.
Novelty. We would like to clarify that our contribution lies less in the individual components than in how they constrain LLM reasoning. MechSim represents each simulator as a Simulation Reasoning Graph and requires the LLM to reason along its paths, so that every claim cites the edges, assumptions, and evidence it rests on and can be tested by re-executing the simulator. This makes the reasoning traceable and auditable rather than free-form. The problem itself is also new: existing work uses LLMs to build, calibrate, or run simulators, and to the best of our knowledge, reasoning about the mechanisms and assumptions of executable simulators has not been studied. The SRG is a new representation as well. Unlike knowledge graphs or causal graphs extracted from text or data, it is tied to an executable simulator and brings its variables, transitions, policy bindings, assumptions, and execution traces into one schema shared across heterogeneous simulators.
Baselines. We have a similar coding-agent baseline in the paper: the variant without mechanism reasoning (Appendix C.1, Figure C.1) uses a coding agent that generates query-specific arguments, and it performs clearly worse than MechSim (0.53 vs. 0.70 in P/R@k, 4.40 vs. 2.66 in Top-k regret). We agree that a stronger coding-agent baseline is valuable, and we will add one in our revised version of the paper. However, we expect it to perform worse than MechSim for the same reason: such an agent can run simulators and cite code, but nothing checks its claims against the simulator's mechanisms.
Evaluation criteria. We respectfully disagree that our evaluation favors our method. Using LLM judges together with a smaller-scale human evaluation is the standard way to evaluate generated explanations, and our four criteria follow prior work [1, 2], with the full rubric in Appendix E.6. These criteria evaluate the explanation rather than the method: they ask whether an explanation is complete, consistent with the simulator's mechanisms, scientifically sound, and faithful to the simulation outputs.
[1] DeYoung et al. ERASER: A Benchmark to Evaluate Rationalized NLP Models. ACL 2020. [2] Liu et al. G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment. EMNLP 2023.
Thanks again for your review.