- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces LADDER, an automated framework that generates robotic manipulation demonstrations in simulation directly from natural-language instructions. The system integrates a parameterized affordance knowledge base, multi-agent task planning, randomized scene construction, and collision-free motion planning to autonomously execute tasks and collect demonstration data. Evaluation on RoboTwin 2.0 and RoboGen demonstrates that LADDER achieves higher demonstration collection success rates compared to existing baselines. In addition, policies trained on LADDER-generated demonstrations show consistent performance gains across three different architectures.
Critical strengths
-
The paper presents an automated pipeline that converts natural-language instructions into robotic demonstration trajectories by integrating task decomposition, scene construction, affordance grounding, and motion planning. It does not require task-specific reinforcement learning training for each task. Experiments show that LADDER achieves demonstration collection success rates of 94.2% on RoboTwin 2.0 and 89.5% on RoboGen, outperforming the respective baselines.
-
The generated data improves downstream policy performance. The authors use LADDER-generated demonstrations to train three robotic policies: π0.5, DP3, and X-VLA. Evaluations on RoboTwin 2.0 show improvements in the average success rates of all three policies, with π0.5 achieving gains of 6.5 and 8.4 percentage points under the Clean and Hard settings, respectively.
Critical weaknesses
-
The novelty is limited. The manipulation knowledge base, LLM-based task decomposition, multi-agent collaboration, scene randomization, geometric waypoint generation, and collision-free motion planning are all established techniques. This paper primarily integrates these components into an automated pipeline without introducing a novel planning algorithm, affordance learning method, or robot control mechanism.
-
The paper lacks sufficient ablation studies to isolate the contributions of individual components, and the baseline comparison may be confounded by the use of different end effectors in articulated-object tasks, as LADDER employs a conventional gripper while RoboGen uses a suction gripper, which could affect task difficulty and execution success.
3.Simulation improvements do not necessarily translate into better real-world performance. Although LADDER improves demonstration collection success rates and the performance of three policies on RoboTwin 2.0, its demonstrated benefits are currently limited to simulation. The paper does not establish whether these improvements transfer to real robots. Given the greater complexity of real-world environments, it remains unclear whether further optimizing simulation demonstrations beyond a reasonable level of quality leads to meaningful improvements in real-world performance. The authors should provide real-robot experiments to validate the practical significance of these optimizations.
Questions for authors
My question is the same as the issue raised in the weaknesses.