- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
DuoGate combines action verification with selective learning from execution feedback. It checks proposed actions against available evidence and uses detected failures to guide recovery. It also uses task outcomes and correction feedback to decide which experiences to retain. Before any resulting guidance is added to the playbook for future prompts, it is screened to reduce the risk of carrying mistakes forward. The evaluation covers AppWorld, τ²-bench, and Terminal-Bench, with ablations on action control and context updates.
Critical strengths
-
The paper addresses a practical agent failure: claiming task completion without executing the required actions. It combines runtime verification with reusable guidance, and shows consistent gains across multiple models and benchmarks.
-
The ablations examine both learning-opportunity selection and guidance screening. The explanation studies offer useful insights into what drives the gains, while the reporting acknowledges limitations in statistical evidence and trajectory analysis.
Critical weaknesses
-
Incremental novelty is unclear. DuoGate builds on ACE’s reflection and curation, but lacks a matched comparison isolating the gains from its specific coupling of action control and learning. Its advance over ACE[1] and related work such as MPR[2] remains insufficiently established. MPR uses frozen memory at inference, so the concern is the additional value of DuoGate’s online coupling rather than equivalence between the methods.
-
Limited evidence for diagnostic gains and generalization. Original feedback yields only marginal gains over generic verification (0.40 pp in task completion and 0.59 pp in scenario completion; Table 13). Fixed task ordering and related AppWorld variants also leave order sensitivity and broader transfer untested.
[1] Zhang et al. Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models. Section 3. https://arxiv.org/html/2510.04618v1 [2] Wu and Qu. Meta-Policy Reflexion: Reusable Reflective Memory and Rule Admissibility for Resource-Efficient LLM Agents. Sections 3.2–3.5. https://arxiv.org/html/2509.03990v1
Questions for authors
What is the incremental benefit of DuoGate’s coupling over the same action controller with standard ACE learning, and how does it advance beyond ACE [1] and MPR [2]?
Given the small gap between Original and Generic feedback, what evidence supports the added value of detailed correction diagnoses and the generalizability of learned guidance?