- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes HiCARE, a world-model-guided framework for hierarchical self-correction in LLM agents. The method organizes agent decisions into multiple repair scopes and uses a world model to evaluate counterfactual alternatives before execution. A controller selects repairs by balancing predicted improvement against intervention cost, while execution feedback updates prediction reliability and reusable repair memory. Experiments on DiscoveryWorld and τ-Knowledge report improvements in task completion and environment interaction efficiency.
Critical strengths
- The problem formulation is clear and meaningful.
The paper identifies an important distinction between predicting potential failure and determining the appropriate scope of correction. The proposed hierarchical intervention framework directly addresses this problem.
- The method is coherent and reports promising results.
HiCARE integrates world-model prediction, cost-sensitive repair selection, and feedback adaptation into a unified framework. The reported improvements across both evaluated environments are encouraging.
Critical weaknesses
- The central contribution of adaptive hierarchical repair is not adequately validated.
Although adaptive repair-scope selection is the paper's main innovation, the experiments lack direct comparisons with fixed-scope repair strategies under matched conditions. Consequently, it remains unclear whether the improvements come from hierarchical intervention itself or simply from additional world-model-guided deliberation.
- The predefined intervention structure and world-model assumptions are insufficiently examined.
The decision hierarchy, admissible repair candidates, and intervention costs are specified in advance, with limited justification or sensitivity analysis. Moreover, the theoretical guarantee assumes bounded world-model errors without establishing whether this assumption holds in practice.
- The experimental coverage and efficiency analysis remain limited.
The evaluation focuses on one DiscoveryWorld task setting and a 21-task subset of τ-Knowledge. More importantly, efficiency is assessed mainly through environment interactions, without adequately accounting for the additional computational cost of counterfactual simulations and iterative repairs.
Questions for authors
-
Can the authors directly compare adaptive hierarchical repair against fixed-scope repair strategies under the same world model, candidate budget, and inference budget? This is my primary concern. If adaptive scope selection demonstrates a clear and consistent advantage over fixed-scope correction, I would be willing to reconsider my rating.
-
How are the repair hierarchy, candidate interventions, and disruption costs determined, and how sensitive are the results to these design choices?
-
What is the additional computational overhead of hierarchical counterfactual evaluation, and how is the reliability of the world-model predictions validated?
The additional experiments improve the empirical evidence, but the current results do not yet sufficiently isolate the benefits of adaptive hierarchical repair from the choice of comparison strategies, nor directly establish the reliability of world-model-guided counterfactual selection across repair scopes.