- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper introduces ResponsiveEnv, a method for dynamic environment selection for training LLM agents using an environment editor. The editor simplifies or hardens the training environment according to the learner’s current needs. The paper asks whether revisiting modified environments can be more beneficial as training data than training on a larger set of environments, and compares the two methods under the same learner-update budget using ALFWorld and -bench.
Critical strengths
The authors present performance gains in most cases, which justifies their method, and I find the ablation study in Section 4.1 important for understanding the nature of this gain.
Critical weaknesses
The authors compare their method to previous methods only on the ALFWorld benchmark, which is also the only benchmark used to demonstrate the ablation studies. I find this significantly weakens the paper, as it is difficult to assess the generalisability of the proposed approach.
Questions for authors
- Could the authors repeat the ablation studies with the -bench tasks? Or provide a reasonable explanation for their absence?
- The authors used 100 original worlds, but the learner, in fact, encounters many more than that during training since they are being edited. However, the presented results compare with 100 static environments. Can the authors report how many environments the learner actually sees when using ResponsiveEnv? Can the authors clarify why they think it makes more sense to compare with 100 static worlds rather than the real number of different worlds?
- The only direct comparison between different methods presented in the paper uses GPT-5.6, which makes it hard to understand the contribution of ResponsiveEnv compared to the other methods. Can the authors expand the comparison to other editor models as well?
- Table 3 presents the results for a fixed-curriculum dataset. Can the authors clarify why these results do not belong in Table 1 alongside those for the other editor modes? For instance, it seems that Gemini-Flash loses in all 3 categories to the fixed curriculum.