- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes Minimum Sufficient Repair Chains for recovering failed tool-agent trajectories. It combines rollback boundaries, typed repair operators, a structured process verifier, and a learned candidate ranker to select low-cost verified repairs. Experiments on MedAgentBench evaluate repair success, candidate selection, and component ablations using stored replay outcomes.
Critical strengths
The motivation is reasonable: correcting one action may leave other errors unresolved, so preserving partial progress across multiple repairs can be useful. The paper provides repeated execution results and component ablations, with detailed artifacts that help inspect the reported findings.
Critical weaknesses
-
The methodological novelty and generality remain limited. Although the ablations support the usefulness of individual components, the framework mainly combines rollback, typed repair, ranking, and verification. Its reliance on task-specific rules for retrieval, calculation, and transactions leaves its applicability to new tasks unclear.
-
The experimental evaluation is far from sufficient. Experiments are limited to MedAgentBench, without validation in other stateful tool environments. Comparisons with relevant recovery methods, such as GA-Rollback and AgentRewind, are also missing, leaving the generality and advantages of the method unclear.
Questions for authors
See weaknesses.
Given the lack of further discussion with the authors, my original concerns remain unresolved. Therefore, I will keep my score unchanged.