- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies how agents can learn when a previously successful procedure remains applicable and when it needs to be replaced as the environment changes. The proposed CEA organizes contrasts between successful, failed, controlled-success, and recovery executions to identify the relevant contextual factor and recover its state-to-procedure mapping. Experiments on APPLYBOUNDARY, three model backbones, and three documented system changes show better knowledge recovery, but no downstream selection improvement over the strongest control.
Critical strengths
The paper addresses an important issue in experience reuse: past success does not establish applicability after the environment changes. Separating factor identification from procedure-mapping recovery provides a useful framework for evaluating what an agent actually learned, and this is the contribution I find most compelling.
Critical weaknesses
Prior work such as AutoGuide already learns state-associated guidelines from successful and failed experiences, so the paper needs to establish more clearly what is added by resolving correlated distractors and recovering explicit mappings. The appendix also lacks the complete paired prompts for CEA and B4, leaving both the main improvement and its source insufficiently transparent.
Questions for authors
- Compared with state-conditioned guidelines such as AutoGuide, what capability or operation does CEA add when both approaches receive the same controlled evidence?
- Could you provide the complete CEA and B4 inputs for the same task and identify every difference beyond the contrastive relations?
- Do the downstream findings hold without the Explanation field, and where do selection errors occur when both the factor and mapping are recovered correctly? Isolating the explanation field and locating selection errors under correctly recovered knowledge would make the claimed distinction between recovery and utilization much more convincing.