- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors provide a sim environment and an agentic toolbox to perform exploration for agentic robot coding, enabling search-based optimization in sim via agentic operations in Mujoco/FLASH (stage 1), and then physical/real adaptation procedure via real and sim experiments (stage 2). The agent is acting via calls to an API, adaptation during stage 2 are performed via
Stage 1 includes the LLM generating success scores and probing modifications of the policy along specific detected weakness phenomena. Stage 2 uses a real robot rollout by mimicking it in simulation, using simulation to generate improvement hypotheses, and then screen them in simulation before executing to test improvements on a real robot,
The authors test on a dual-YAM robot for three tasks, probing both sim-2-real and sim-2-sim, and checking the effect of LLM choice.
Critical strengths
- The approach enables use of real->sim->real toward practical time agentic robotics.
- Provides an important link between planning and
Critical weaknesses
- Many details are missing to make the paper reproducible or detailed enough. Examples include details on the number of steps and kinds of modifications done inside the iterations, how weaknesses are represented, and are collected throughout the algorithmic search. See the "questions" sections for a set of aspects to improve on.
Questions for authors
- The authors should probe different code-as-policies setups within sim-based planners, probe the influence within the current code-as-policies planner of modifications of the sim environment.
- Would be good to check the sensitivity of the real-to-sim part to different mixture of real vs sim strategies, and sim variations as some approaches have been attempted, and the strategy for sim->real agentic adaptation is at the core of this paper.
- Would be good to probe the weaknesses mentioned, as I assume you can get the LLM traces/code changes -- to show some insight into the CaP of stage 1.
- Another ablation that would be relevant is the choice of weakness probing->focused weakness->dataset creation, vs versions that avoid focusing, or use a simpler strategy to favor difficult scenarios.
- Simex - spell it out, is it exploration? Pls write as much.
- Can you write also wall clock time, and spell out the time for all the call and sim steps? Especially as stating "10 minutes" in the abstract may be correct but is overselling the problem/solution.
- Can you check the agent-judged success predicates, where do they succeed/fail?
- Can you add missing papers and relate to them, such as “Graphs as policy”, “Revisiting the "Push-T" Robot Manipulation Task with Agentic Robotics”,”Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents”