- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes FIRE, a framework that improves skill-based agents by applying reinforcement learning separately to three stages: skill selection, task execution, and reflection on failures. Experiments across multiple environments and base models demonstrate the effectiveness of the approach.
Critical strengths
- The paper addresses an important problem and proposes a logically motivated solution.
- The experimental evaluation covers a broad range of environments and base models.
Critical weaknesses
- Limited novelty. I do not see a clear methodological advance over prior work. First, the formulation of skill-based agents is widely used in existing work on agent skills and memory, and does not appear novel. Second, the select–execute–reflect pipeline is also common in research on agentic systems and recursive self-improvement. Furthermore, separate advantage estimation and reinforcement learning for different stages have already been explored in works such as SkillMaster: Toward Autonomous Skill Mastery in LLM Agents and SkillGate: Training In-Policy Skill Selection in Long-Horizon Agents. The main contribution therefore appears to be combining a three-stage select–execute–reflect formulation with the training approaches used in SkillMaster and SkillGate. In my view, this combination alone does not constitute a sufficiently substantial contribution.
- Unclear experimental configurations and inconsistent results. My other major concern is the lack of clarity regarding the experimental settings and the consistency of the reported results. The method section primarily describes a three-channel formulation, whereas Table 2(a) reports results for a four-channel variant. It is unclear how this fourth channel is defined and which configuration is used in each experiment. Moreover, the four-channel results in Table 2(a) match those of “FIRE w/o M&R” in Table 1, rather than those of the full FIRE method. This correspondence requires explanation. Table 2(d), meanwhile, is described as reporting three-channel results. Its Skill Hit value matches that of FIRE in Table 1, but the other two metric values differ. These discrepancies make it difficult to determine which configurations are being compared and to assess the experimental evidence reliably. (If this concern can be fully resolved, I will raise my score to 2.)
Questions for authors
- Could the authors report results for the “w Mem., w/o Rev.” configuration in Table 2(d)?
- Is the Task Success value reported for the Qwen3 base model in Table 1 correct?
- How is the fourth channel defined, and which channel configuration and other settings are used in each experiment?
2 comments
Thank you for the reply. The experimental setup is now clearer, so I will raise my score to 2. The additional Reflect stage that FIRE introduces compared with SkillGate is indeed a novel contribution, although I still consider the overall novelty relatively limited.
Response to Reviewer Up1N: Clarifying FIRE’s Novelty and Experimental Consistency
We thank the reviewer for the careful assessment and for identifying ambiguities in our experimental reporting. We address the concerns below.
W1. Methodological Novelty Beyond Existing Skill-Based Agents
We agree that skill-augmented agents and the Select–Execute–Reflect pipeline are not novel by themselves. FIRE's contribution lies in failure-conditioned, stage-aware credit assignment. Unlike SkillGate's selection/execution separation or SkillMaster's task-solving/skill-editing advantages, FIRE explicitly optimizes failure-triggered recovery decisions: KEEP is rewarded by verified recovery success, while REPLACE is rewarded by improvement in skill-routing quality. FIRE further distinguishes initial and recovery execution through independently estimated advantages, while retaining failure evidence through reusable memory and persistent skill revision. In Table 2(a), separating execution advantages improves Task Success from 87.3% to 90.8% and Joint Success from 74.2% to 79.5%. We will clarify these methodological distinctions and strengthen the discussion of prior work.
W2 & Q3. Clarification of Channel Configurations and Table Consistency
We apologize for the insufficient explanation. FIRE has three semantic stages (Select, Execute, Reflect) but can use four independently estimated advantage channels by separating initial execution (Exec1) and recovery execution (Exec2). In the three-channel variant, both executions share one advantage; in the four-channel variant, they receive independently normalized advantages.
The configurations are as follows:
Consequently, Table 2(a)'s All (4-ch.) correctly matches Table 1's FIRE w/o M&R (86.9/90.8/79.5). Similarly, Table 2(d)'s full memory-and-revision configuration (95.1/89.0/85.9) differs from Table 1's full FIRE (95.1/92.2/88.0) because the optimization configurations differ. The identical Skill Hit values do not imply identical execution results.
We will explicitly document the channel assignments, component configurations, checkpoint identities, and evaluation settings to make these comparisons unambiguous.
Q1. Additional Memory-Only Ablation
Following the reviewer's suggestion, we additionally evaluated w Mem., w/o Rev. under Table 2(d)'s three-channel setting, obtaining 91.0% Skill Hit, 87.5% Task Success, and 81.0% Joint Success.
Adding skill revision improves these metrics to 95.1%, 89.0%, and 85.9%, respectively, yielding gains of +4.1, +1.5, and +4.9 percentage points. In contrast, revision without memory does not improve Joint Success (74.2% to 73.9%). These results suggest that persistent skill revision is more effective when supported by accumulated case experience. We will include the missing ablation in Table 2(d).
Q2. Correction of Qwen3 Base-Model Task Success
We thank the reviewer for identifying a reporting error in Table 1. The Qwen3 Base Model's ID Task Success of 76.0% is correct. However, its reported OOD aggregate Task Success of 4.0% is incorrect; 4.0% corresponds to the SkillEval result alone.
Following our stated evaluation protocol, the correct OOD Task Success is the macro-average of BigCodeBench (51.7%) and SkillEval (4.0%), giving 27.9%. We will correct this entry. This correction does not change FIRE's leading OOD Task Success (35.4%) among the compared methods.