- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper introduces a proactive tool-using agent that must decide not only whether it is uncertain, but also whether that uncertainty should be resolved by the user or by the world. Its core idea is presented in the phrase “A proactive agent must determine not only whether it is uncertain, but also whether that uncertainty should be resolved by the user or by the world. We refer to this problem as uncertainty routing.” The proposed PROUR framework has two parts: The Decomposer samples several plausible interpretations of the user’s goal from the interaction history, evaluates the next-action distribution with the history, and splits action uncertainty into two source-aligned components (AU from user and EU from world). Calibrated thresholds on these two quantities route the agent to ACT, CLARIFY or VERIFY. To make routing determines where to look and what to ask, a mode-conditioned Query Generator is trained using DAPO. On τ -bench, the method improves success over clarification-only and verification-only baselines with fewer interaction steps.
Critical strengths
- The motivation is convincing. Through the example of Figure 1, authors show that treating clarification and verification as two answers to the same question is a useful way.
- I also liked the idea that ambiguity can be measured through disagreement between next-action distributions across plausible interpretations of the user’s goal. Thus, high AU indicates userside ambiguity that should be resolved through CLARIFY.
- Experiments section is well-structured. All baselines are reimplemented on the same backbone. The ablations are also well chosen.
Critical weaknesses
- To me, the core insight seems not new. The idea of “Some missing information can only come from the user while other information can be obtained from the environment” is already present in prior work such as Ask-before-Plan (2024). Ambig-SWE (2026) makes the distinction explicit by separating information recoverable from the codebase from information only the user can provide. From Assumptions to Actions (2026) chooses between communicating and acting based on assumptions about both the environment and the partner. What PROUR adds is making this choice at every step from an uncertainty estimate. The related work should clarify the similarities and differences with these approaches, and the claim to “identify uncertainty routing as a fundamental problem for tool-using agents” should be toned down.
- The decomposition itself follows the input clarification view of “Decomposing Uncertainty for Large Language Models through Input Clarification Ensembling, 2024”. This means the decomposition itself is not a methodological contribution. What is new in this part is only the reading of each term as an information source.
- I don’t agree with the assumption that “high EU should mean missing world-side evidence”. The entropy over next actions under a fixed interpretation can be high for reasons unrelated to the world. For example, when the user ask for “the latest option after 6 pm”, retrieving the reservation first or searching flights first are both correct (so the entropy is high although nothing is missing). Conversely, if the sampled interpretations all make the same assumption, AU stays low even when the goal is ambiguous. Authors must clarify this with appropriate experiments.
- The mode-conditioned information-gain objective is essentially that of IG-clarifier. The paper states that “We generalize the belief-update estimator and group-relative DAPO optimization of Deng et al. (2026) to the mode-conditioned source and target”, IG-clarifier also uses the same small Qwen backbone and a strict user simulator. So, calling it mode-conditioned does not change much. The only addition is a second reward target.
- I am not sure VERIFY is really a separate source. Paper states that “ACT may itself include ordinary tool calls”, and the verifier uses the same read-only tools the agent already has. So it is hard to tell whether the gains come from routing or simply from extra tool use.
Questions for authors
Q1. I would like to see whether high-EU steps are ones where the verifier returns decision-changing evidence rather than “insufficient evidence”. Also, what happens when the missing piece is a user-held fact that the interpretation does not specify (e.g., which payment method to use for the fare difference)? Such step would raise EU and be routed to VERIFY, although only the user can resolve it. Q2. In Hou et al. (2024), the expected conditional entropy reflects what the model itself does not know. Why should this term be read as evidence retrievable from the world, rather than as the model’s own uncertainty about the task or the presence of several valid actions? Q3. Apart from adding the reference next action as a second target, what is conceptually new in the mode-conditioned information-gain objective compared to IG-clarifier? Q4. How does uncertainty routing differ in approach from prior work that already separates information only the user can provide from information obtainable from the environment, or that chooses between communicating and acting by expected utility?
11 comments
Response to Reviewer jrj5 (2/4)
[W3/Q1] On user-side information that AU could miss
A missing user-held fact raises AU, not EU, in most cases, so PROUR asks the user (Q1). Goal interpretations are sampled independently (L200–201). When the user has not said how to pay, different interpretations assume different payment methods, so their next actions differ. That disagreement is AU. We built 160 steps where the next action needs a choice only the user can make: 50 payment-method cases (your example) and 110 other choices and preferences.
Table R2. When only the user holds the missing fact (n = 160).
| Outcome | Base agent | LLM Router | PROUR |
|---|---|---|---|
| Asked the user right away | 71.3% | 62.5% | 81.9% |
| Routed to VERIFY first, then asked | – | 21.9% | 12.5% |
| Acted on a guessed value | 28.7% | 15.6% | 5.6% |
The base agent has no VERIFY route; its own lookups before asking count in the first row. PROUR sends 110 of the 160 cases straight to CLARIFY, and in 21 more the agent's own reply asks the user (81.9%). The case you describe, routing to VERIFY, occurs in 20 cases (12.5%) and corrects itself: the verifier answers "insufficient evidence" or lists the options on file, the interpretations then disagree, and PROUR asks the user within two steps.
Interpretations that share one assumption (W3). We agree that this failure exists, and measured it on 120 annotated ambiguous steps.
Table R3. Ambiguous steps (n = 120).
| The 5 goal interpretations | Steps | Routed to CLARIFY | Shared assumption correct |
|---|---|---|---|
| Differ | 104 (87%) | 84 (81%) | – |
| All make the same assumption | 16 (13%) | 1 (6%) | 10 of 16 |
As you predicted, PROUR rarely clarifies when all interpretations agree, but their shared assumption is usually correct, and a wrong assumption occurs in 6 of 120 steps (5%). With K = 10, the share of agreeing steps falls from 13% to 6%.
[W5] On whether the gain is only extra tool use
It is not. With the same verifier, tools and trained query generator, changing only when verification happens removes almost all of the gain, even though the controls make more tool calls. You are right that VERIFY uses the same read-only tools as ACT (L180–183). It differs in when it acts (only when EU is high) and in what it asks (a query trained to identify the next action, answered with a cited tool result, computation or policy quote; L1363–1371). Clarify-only is PROUR with VERIFY branch disabled.
Table R4. Who decides when to verify (τ-bench, 3 seeds).
| Trigger | Success (%) | Verify turns / episode | Tool calls / episode | Gain over Clarify-only |
|---|---|---|---|---|
| None (Clarify-only) | 25.15 | 0 | 8.9 | – |
| Random steps, count matched to PROUR | 25.61 | 4.79 | 12.6 | +0.46 |
| The task agent (verifier offered as a tool) | 25.32 | 6.90 | 14.8 | +0.17 |
| PROUR: when EU above its threshold | 28.17 | 4.79 | 10.3 | +3.02 |
The controls keep only 15% and 6% of PROUR's gain, and the paired 95% CIs of their difference from PROUR exclude zero ([−5.1, −0.1] and [−5.4, −0.3]). The random control makes as many verifier calls as PROUR, so the gain is not an effect of extra model calls either. More verification does not help either: lowering the EU threshold from 0.20 to 0.15 raises verification from 4.79 to 7.60 turns per episode and lowers success from 28.17% to 25.18% (Fig. 8). VERIFY is also more than tool calls: 54% of VERIFY turns make none (Table R5).
What VERIFY returns (W5/Q2). We classified every VERIFY turn by the evidence its answer cites, and re-ran the agent without that turn.
Table R5. What VERIFY returns.
| Evidence cited by the verifier | Share of VERIFY turns | New tool call? | Next action changed |
|---|---|---|---|
| State lookup not yet in the history | 38% | Yes | 41% |
| Policy check (quotes the domain policy) | 22% | No | 36% |
| Computation over existing observations | 21% | No | 44% |
| Subgoal-completion check | 11% | No | 29% |
| Insufficient evidence | 8% | – | 3% |
54% of VERIFY turns make no tool call, yet they change the next action about as often as new lookups do (29–44% vs 41%). Unlike Table R1, this column also counts read-only lookups, hence 36% on average rather than 27%. §3.1 now states that VERIFY is a separate channel, opened only when EU is high, whose answer must cite a state lookup, a policy check, a computation or a subgoal check.
Response to Reviewer jrj5 (3/4)
[W1/Q4] On prior work that separates user-side from environment-side information
Thanks for helping us better position our work with three related works (Ask-before-Plan, Ambig-SWE, and From Assumptions to Actions), which separate information only the user has from information in the environment. We removed the "fundamental problem" claim and added all three to Related Work. As you note, PROUR's addition is a per-step choice made from an uncertainty estimate. We reframed our claim as: measuring the source from the agent's own action distribution routes more reliably than judging it.
Ask-before-Plan assigns the two sources to fixed stages: execution agents query the environment at every turn, a fine-tuned clarification agent decides whether to ask the user, and planning starts after the dialogue ends. PROUR chooses at each step among the user, the world, or neither, interleaved with actions that change state. On the same backbone, success rises from 23.60% to 28.17% and steps fall from 23.50 to 21.33 (Table 1).
Ambig-SWE finds that LLMs struggle to judge whether an input is underspecified merely through prompting, as our prompted LLM Router shows. On 240 held-out airline steps, with thresholds frozen on retail (Fig. 7). The accuracy gap is significant (McNemar p < 0.001).
| PROUR | LLM Router | |
|---|---|---|
| Routing accuracy | 73.8% | 53.8% |
| Macro-F1 | 74.04 | 54.24 |
| Unnecessary user questions (ACT or VERIFY steps sent to CLARIFY) | 9 | 27 |
| User-side steps sent to VERIFY | 6 | 18 |
PCE (Q4) picks between communication and physical actions by expected gain minus cost, so it must enumerate assumptions and estimate a gain and a cost for each action. PROUR needs no utility model: it splits next-action uncertainty into a user part and a world part, and learns what to ask. PCE targets embodied planning with a partner, and τ-bench defines no per-action gain or cost, so we compare with the closest expected-utility method for tool-using agents, SAGE-Agent (expected value of perfect information): 21.13% vs 28.17% on τ-bench and 23.95% vs 29.00% on τ³-bench (Tables 1 and 4). A cost term like PCE's could be added to our thresholds, so the approaches are complementary.
[W2] On the decomposition of Hou et al.
Although both Hou et al. and our work use the conditional mutual-information identity [1] for decomposition, applying it to the tool-using agent is not a trivial and straightfoward adaptation. It requires re-inferring the interpretations from the multi-turn history at every step and scoring schema-validated tool calls on a shared candidate set (Appendix A.2.3), but we do not claim this as conceptual novelty. The difference is how the epistemic term is used. Hou et al. use the aleatoric term to trigger clarification (their §3.6), attribute the epistemic term to knowledge the model lacks, and do not query for it. For a tool-using agent, much of that missing knowledge is environment state that read-only tools can retrieve, so PROUR routes it to verification. Clarify-only routes on AU alone, the closest analogue of Hou et al.'s usage, and reaches 25.15% vs 28.17% on τ-bench and 24.83% vs 29.00% on τ³-bench (Tables 1 and 4). This reading of EU fails when several next actions are equally valid; Table R1 (part 1/4) shows that this case covers 13% of high-EU steps and has no detectable effect on success.
References
[1] Cover, T. M. and Thomas, J. A. Elements of Information Theory. Wiley-Interscience, 2nd edition, 2006.
Response to Reviewer jrj5 (1/4)
Thank you for the constructive review: we ran the experiments you asked for (W3, W5, Q1, Q2; new Tables R1–R5, with R1 and R4 added to Appendix A.6 of the revised PDF as Tables 13 and 14) and narrowed our novelty claims as you suggested (W1, W2, W4, Q3, Q4).
[W3/Q2/Q1] On reading high EU as missing world-side evidence.
Sorry for the confusion. Indeed, high EU does not only involve missing world-side evidence. To clarify your concern, we measured what high-EU steps need. At 72% of them, world-side evidence is missing: a lookup, a policy check or a calculation decides the next action. Only 13% are cases with several valid actions, and verifying there makes no detectable difference to success.
We labeled 400 VERIFY steps from PROUR's τ-bench runs by what each step needed. GPT-5.5 labeled every step and an author checked every label, both without seeing the replay results; a second author labeled 100 steps independently (Cohen's κ = 0.79). We then replayed each step with and without the verification. Success is measured on the episodes replayed from each sampled step (3 runs per branch).
Table R1. What high-EU (VERIFY) steps need (n = 400).
Several valid actions (W3). These steps are rare, and verifying there changes success by 0.5 points, which is not significant. The verifier is read-only (L287–289), and in 80% of these steps its lookup is one of the valid actions. In your example ("the latest option after 6 pm"), retrieving the reservation and searching flights are both lookups: the verifier does one, and the agent goes straight to the other. In most of these steps, the verification replaces a step rather than adding one.
The model's own uncertainty (Q2). Our definition of world-side uncertainty already includes most of it. In the taxonomy of Appendix A.1 (Table 5; L718–719), about a third of the epistemic events are tool-argument verification (2,356), calculation verification (1,751) and plan-completion verification (1,243). There the model is unsure about its own arguments, arithmetic or progress. A grounded check resolves this, and the user cannot. Table R5 (part 2/4) shows what VERIFY returns in evaluation. 38% retrieve state not yet in the history. The other 54% re-check evidence already in the history: they quote the policy, recompute a value or check subgoal completion, but it is not free reflection: the verifier must cite a tool result, a policy quote or a computation with its inputs, or answer "insufficient evidence" (L1363–1371). Either way, the user cannot supply it. We route it to VERIFY because a grounded check resolves most of the uncertainty and the user cannot (Tables R1 and R5); “world-side” in the paper means exactly this (L195–197), which is broader than "retrieved by a new tool call".
Decision-changing evidence (Q1). The verifier answers "insufficient evidence" in only 8% of VERIFY steps, consistent with Table 11. Its answer changes the agent's next decision in 27% of steps (33% where evidence is missing). Skipping the verification lowers the success of the replayed episodes by 8.2 points.
We revised §3.2 (L229–233) to say that high EU mostly reflects missing world-side evidence, in the sense defined above, and that part of EU cannot be reduced by any source (several valid actions).