- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces AI4AI framework that improves a target LLM's coding capability with the three roles namely Critic, Producer, and Solver. According to the authors, AI4AI starts with synthetic data generated by a larger teacher LLM, which accounts for 100% of the training data for the first three rounds. Then, the target LLM learns to generate its own data to improve its coding capability, reducing the portion of teacher-generated data. The effectiveness of the AI4AI framework is evaluated by showing that the resulting model performs better than the best-performing baseline (Agent-R, 55.0%) by 1.2 percentage points (56.2% vs. 55.0%) on 500 coding tasks.
Critical strengths
The paper proposes an interesting framework that separates recursive self-training into three roles, namely Critic, Producer, and Solver. This provides a clear structure for failure diagnosis, task generation, and problem solving.
Critical weaknesses
The paper presents an interesting framework, but the experimental results do not sufficiently validate its key contributions or explain the factors behind the reported improvements.
1. Insufficient evidence of recursive self-improvement
The AI4AI framework heavily relies on teacher-generated data, even after cold start. In R8, 50% of the Solver training data still comes from the teacher LLM. However, the paper does not provide experiments without continued teacher assistance or a teacher-only baseline. Therefore, it is unclear whether the performance improvement comes from the student's self-improvement or continued teacher supervision.
2. Insufficient validation of the proposed three-role framework
The main contribution of this paper is the framework consisting of Critic, Producer, and Solver. However, the paper does not provide ablation studies to show whether all three roles are necessary. Although the proposed method outperforms the existing baselines, it is unclear whether the improvement actually comes from the proposed three-role design.
3. Insufficient analysis of agent and feedback dependency
The experiments are conducted using a single agent framework, OpenHands. However, the paper does not investigate how the agent framework or the information contained in execution traces affects the self-training process. It is unclear which feedback information contributes to the improvement and whether the proposed framework would work similarly with different agent frameworks.
4. Limited generalizability across LLMs
The experiments use only one teacher LLM (deepseek-ai/deepseek-v4-flash-0731) and one student LLM (Qwen3.5-4B-Base). However, the paper does not investigate whether the proposed framework works with different LLMs or model sizes. Therefore, it is unclear whether the reported improvements can be generalized to other teacher and student models.
Questions for authors
I would appreciate clarification on the following points, as additional evidence could affect my assessment.
- Is there evidence that the student LLM can continue improving without teacher assistance after cold start? Are there any results comparing AI4AI with a teacher-only baseline under a similar training budget?
- Are there any ablation results showing that all three roles are necessary? In particular, how much does the Critic contribute compared to using only Producer and Solver?
- Is there any analysis showing which information in the execution traces contributes to self-improvement? Is there any evidence that the improvements are not specific to OpenHands?
- Are there any additional results with different teacher or student LLMs, or different model sizes, that support the generalizability of the proposed framework?
- (Minor) Was there a particular reason for referring to the arXiv versions of these papers rather than their published conference versions?