- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper builds training trajectories from chains of related pull requests. It preserves earlier code changes across stages, uses simulated execution feedback when real execution is difficult, and filters patches against reference changes. It studies whether longer chains and OpenClaw-derived data improve downstream agent performance.
Critical strengths
-
Preserving changes across PR stages is a reasonable way to train agents for tasks that depend on earlier edits.
-
The evaluation covers both coding and tool-use tasks, giving a broader view beyond a single benchmark.
Critical weaknesses
-
The comparisons mainly cover Qwen3-30B-A3B and Step-3.5-Flash. Frontier reference baselines such as Claude and GLM are missing from the main comparison, and needs to justify the choice of OpenClaw as the sole agent-authored source.
-
Only 959 rollouts are retained, and the horizon study does not control tokens or compute. This is limited evidence for scaling and needs comparison with TOUCAN, APIGen-MT, and Simia.
-
The novelty is unclear. The paper should explain how its rejection sampling differs from the existing strategy and framework.
Questions for authors
See Weaknesses.