- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents EnvCraft, an automated framework that synthesizes executable sandbox environments and RL training tasks for Claw-like agents. LLMs expand 83 natural-language scenarios into environment code guided by nine interaction archetypes, and Claw environments additionally receive OpenClaw's built-in bash tools and generated skill files. Tasks are built by sampling tool chains from a bi-level tool/environment dependency graph, reverse-engineering multi-turn user intents, and generating initial states with deterministic verifiers, yielding 139 environments and 19,777 tasks. Trained with GRPO on these tasks, Qwen3-8B improves from 12.94 to 24.85 on PinchBench and from 44.06 to 55.42 on Claw-Eval. Gains also appear on BFCL-v3 and, to a smaller extent, τ²-bench.
Critical strengths
-
This paper proposes a practical framework that could truly help to address the problem of limited environments and training tasks for claw-like agents.
-
Training on the synthesized tasks gives clear gains on Claw-style benchmarks for three backbones while lowering token usage.
Critical weaknesses
-
Insufficient baselines. Every controlled comparison is between a base model and the same model after RL on EnvCraft data, which does not show that EnvCraft's environments are better than existing ones. Prior synthesis methods (EnvScaler [1], ScaleEnv [2], AWM [3], EnvFactory [4]) appear only as numbers copied from their papers under different recipes, and none is evaluated on PinchBench or Claw-Eval. At 8B, ScaleEnv, AWM and EnvFactory report 38.53, 34.40 and 33.67 on τ²-bench vs. 29.80 for EnvCraft, and EnvFactory reports 49.00 on BFCL-v3 vs. 46.25, these methods all outperform EnvCraft's results.
-
The novelty is limited. Prior work listed in Table 1 already covers the main steps of the pipeline. The Claw-specific additions are mainly the injected OpenClaw bash/file tools and the co-generated skill files. As shown in Fig. 11, the Claw gain appears only after these tools are added, while Claw environments without them score close to general tool data. The main new ingredient therefore seems to be training with the evaluation harness's own tool interface rather than the synthesis pipeline itself.
[1] Song X, Chang H, Dong G, et al. EnvScaler: Scaling tool-interactive environments for LLM agent via programmatic synthesis[C]//Findings of the Association for Computational Linguistics: ACL 2026. 2026.
[2] Tu D, Hao H, Yang H, et al. ScaleEnv: Scaling environment synthesis from scratch for generalist interactive tool-use agent training[C]//International Conference on Machine Learning. 2026.
[3] Wang Z, Xu C, Liu B, et al. Agent world model: Infinity synthetic environments for agentic reinforcement learning[J]. arXiv preprint arXiv:2602.10090, 2026.
[4] Xu M, Wang Z, Deng M, et al. EnvFactory: Scaling tool-use agents via executable environments synthesis and robust RL[J]. arXiv preprint arXiv:2605.18703, 2026.
Questions for authors
-
Can you train the same backbone under the same RL budget on EnvScaler [1] or AWM [3] data with the same OpenClaw built-in tools added, and report PinchBench and Claw-Eval results?
-
Can you clarify which parts of the pipeline are new relative to ScaleEnv [2] and EnvFactory [4], and ablate the components left to future work (interaction archetypes, intent decomposition, personas)?
-
From my experience, the reported results on these benchmark are sometimes noisy since the number of problems in the benchmark are small and the tasks are sometimes edge cases. Please report the number of tasks per benchmark and avg@k (e.g., k = 4, 8, 16).
[1] Song X, Chang H, Dong G, et al. EnvScaler: Scaling tool-interactive environments for LLM agent via programmatic synthesis[C]//Findings of the Association for Computational Linguistics: ACL 2026. 2026.
[2] Tu D, Hao H, Yang H, et al. ScaleEnv: Scaling environment synthesis from scratch for generalist interactive tool-use agent training[C]//International Conference on Machine Learning. 2026.
[3] Wang Z, Xu C, Liu B, et al. Agent world model: Infinity synthetic environments for agentic reinforcement learning[J]. arXiv preprint arXiv:2602.10090, 2026.
[4] Xu M, Wang Z, Deng M, et al. EnvFactory: Scaling tool-use agents via executable environments synthesis and robust RL[J]. arXiv preprint arXiv:2605.18703, 2026.