- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper descirbes an agentic VLM framework that maintains a library of skills. Each skill can either call a VLA or a position controller. The agentic system uses gathered experience from simulation or real world to mofidy and improve the skills that it executes. The framework is tested with GPT / codex and the pi05 VLA on the LIBERO-PRO benchmark. There are some further real-world validations over 3 pick-and-place tasks.
Critical strengths
- The authors validated the framework in real-world robotic trials.
Critical weaknesses
- This work presents a single data point: One specific VLM and one specific VLA where the proposed skill evolution leads to a small incremental improvement on one specific benchmark. There are no generalization tests over multiple VLMs, multiple VLAs, and there is no indication that these improvements span more than one benchmark. There are also no ablation studies which would provide useful insight on the design decisions of the skill evolution or guidance processes. The given ablation only shows that each of the two steps contributes to the overall improvement.
- The above weakness unfortunately leads me to the conclusion that there is no scientific insight to draw from this submission in its current form. It is an interesting reference implementation, and the demonstrated incremental improvement motivates to look more deeply into this agentic system, but it may as well be that none of this works with a new version of GPT or some other VLA.
- The title claims sim-to-real transfer, yet the method itself does not target this at all. It is simply that the abstraction of using two different checkpoints of pi05 allows for the high-level skills to transfer. It may be fair to claim "transferrable" skills, because the paper shows e.g. in Figure 5 that the evolved skills from simulation do transfer also to better success rate in real world, but the transfer itself is not achieved by the framework. Specifically, there is no indication that such transfer would work for a target real-world environment for which a suitable VLA checkpoint (trained on extensive environment specific human demonstrations) is not available. Further, it is not specified whether the 05 checkpoint used in simulation already has seen real-world training data during the VLA training (it would be surprising if it had not).
- The skill guidance process is entirely unclear to me. It assumes a diffusion based action decoding that is incompatible with the definition that skills may freely choose from a VLA call and a position controller. This step seems only relevant to the VLA part, and only a specific subsets of VLAs uses diffusion for action decoding. This raises the question how modular the skills are after all. There is also no description of the reward function itself and its allows complexity. If the agent is free here to come up with any implementation, since it seems to be called in every denoising step, it can add significant computational overhead to the action decoding and may cause impractical inference times.
- Section 3.2 appears to be critically unclear and gives me AI-writing-vibes. Examples of vague language:
- does a skill specify "how a next operation should be selected" or does it specify which operation to select next? The way it is currently formulated a skill is nothing more than a prompt that then runs another LLM to select an action
- skills are meant to generalize over "similar manipulation requirements" (line 237). It is not specified what these are, specifically as all the examples shown are pick and place. So is the entire framework one skill?
Questions for authors
- What is the inference time for a single episode? How long does it take your real robot to put one cube into one bowl?
- Is the action guidance limited to diffusion-based VLA decoders?
- What is the claimed "structured scene description" (line 215)?
- How is "observation freshness and uncertainty" measured (line 215)? Does the "uncertainty" have any probabilistic meaning? Is it processed in a probabilistic framework?