- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies when an agent should trust decisions proposed by a learned world model. They propose Dual-Frontier, which accepts a proposal only when its predicted gain exceeds bounds on model error and estimation uncertainty. The authors analyze failure attribution and decision reliability, then evaluate the rule in controlled environments and tool-use benchmarks.
Critical strengths
1.The paper addresses a relevant question: when should an agent trust its world model? The focus on decision quality, rather than prediction accuracy alone, is well motivated.
2.I find the main idea intuitive. The method weighs the predicted benefit of a proposed change against model error and estimation uncertainty. This gives a clear rationale for accepting some proposals and deferring others.
3.The evaluation includes both controlled experiments and public tool-use benchmarks. The ablations and analysis of harmful revisions are useful.
Critical weaknesses
1.Section 3 introduces the environment tuple with little explanation of its components. The details of are not included in the main text. The estimator in Eq. (3) is not explicitly introduced, and in Eq. (4) lacks a local definition. Before Eq. (5), is only described as a learned value. Appendix A supplies several definitions, but the main text should introduce the objects needed to follow the results.
2.The theoretical contribution appears limited, particularly in Theorem 1. Its construction changes an untried action while leaving the deployed observations identical. Once this is established, the lower bound follows directly from the triangle inequality. This is a useful illustration of missing information, but it is not a substantial technical result by itself. Theorem 2 likewise follows from Bellman telescoping and a total-variation bound. The paper should distinguish its new contributions or insights from these direct consequences and explain what the combined framework adds beyond them.
3.The paper clearly states the admission rule, but the practical construction of the bound is not fully specified. For example, it remains unclear how the reliability signals are combined into an error estimate. Since this estimate directly affects which proposals are accepted, these missing details make the method difficult to reproduce from the paper alone.
Minor Comments
-
The abstract sentence beginning “Calibrated gates and simultaneous confidence sequences support adaptive evidence reuse...” is difficult to interpret without the later definitions. Please state what evidence is reused, what event is controlled, and what the verification bounds measure.
-
The bibliography needs a consistency check. The GLM-5 entry contains a very long author list, while the Llama 3 entry uses et al. Please check the bibliography style and clean these entries.
Questions for authors
What are the specific differences between addressing the attribution of action advantages in the context of LLMs versus in other models?
Furthermore, how are these differences reflected in the design presented in this paper?
Dear authors and reviewers,
The author-reviewer discussion period closes on November 18 (AoE). Please engage in response periods so that we have our issues discussed thoroughly.
AC