- Rating
- 2
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes Agentic DAgger, a training harness that improves expert feedback and adapts training experience while retaining the standard DAgger learner update. The feedback-evolution loop refines corrective actions through iterative proposal and verification. The experience-evolution loop uses learner performance and expert–learner gap evidence to propose curriculum changes, which are evaluated through subsequent learner training. The paper evaluates the approach in closed-loop driving on NAVSafe-∞, using DrivoR as the learner and PDM-Closed as the base expert. Comparisons with IIL baselines and single-loop variants show improved driving success, with the combined system achieving further gains over successive training cycles.
Critical strengths
1. A meaningful connection between expert correction and curriculum selection.
Curriculum selection considers both where the learner struggles and whether the expert can provide useful corrections. Improved feedback can therefore make previously unproductive scenarios useful for training. This gives the two loops a clear connection and offers a practical way to address limitations in both supervision quality and training experience.
2. Empirical evidence that the two loops are complementary.
Figure 4 compares standard DAgger, each single-loop variant, and the full system. The combined approach reaches 76.78% success, compared with 65.00% for standard DAgger, and exceeds both single-loop variants. These results provide evidence that jointly adapting feedback and experience benefits the downstream learner in the evaluated driving setup.
Critical weaknesses
1. Limited methodological novelty; the contribution is mainly system integration.
The method follows the straightforward idea of improving expert feedback, selecting more useful training experience, and then updating the learner. Connecting feedback evolution with experience evolution allows curriculum selection to account for both learner performance and the expert’s ability to provide corrections. This has system-level value, but the contribution mainly lies in organizing and automating the training process, with limited methodological novelty.
2. The relative advantages of the agentic design are not sufficiently established.
The experiments support the effectiveness of feedback evolution and experience evolution. However, they do not show what advantages state-specific repair offers over using an agent to improve the base expert itself. They also do not establish whether the experience-evolution agent selects training scenarios more effectively than simple strategies. These missing comparisons, together with limited reporting of total cost, make it difficult to assess whether the gains justify the proposed design’s added complexity and computational overhead.
Questions for authors
Q1. Could using an agent to improve the base expert itself be more effective and less costly than state-specific repair?
Since the agent already diagnoses expert failures and proposes repairs, could it instead modify PDM-Closed’s program logic and retain those improvements for reuse? The current feedback-evolution loop refines corrective actions at individual interventions rather than modifying the expert program. What advantages does this choice offer over agent-driven improvements to the base expert in correction quality, downstream learner performance, runtime, and total cost?
Q2. What does the feedback-evolution loop contribute in practice, and at what cost?
The paper lacks aggregate statistics on intervention frequency, the types of failures addressed, repair success rates, and overall computational cost. This makes it difficult to assess how much useful supervision the loop provides relative to its overhead. It is also unclear how many successful repairs select candidates already in the initial menu and how many require new trajectory proposals and further search. Since candidates are generated and scored before the agent’s first proposal, this distinction matters for understanding the agent’s role.
Q3. Does the experience-evolution agent select training scenarios more effectively than simple strategies?
The current comparison mainly contrasts fixed and adaptive curricula. It does not establish whether the experience-evolution agent outperforms random scenario replacement or selection based on the expert–learner gap. With the same access to scenarios and selection constraints, and comparable total budgets, does its diagnosis and selection improve learner performance or curriculum-search efficiency beyond the benefit of changing training scenarios alone?