- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This submission introduces Eden, a simulation framework for robot learning that a task can be just defined once and then executed across simulation backends and on hardware. The core idea is to represent each task as serializable configuration of reusable terms. Experiments show that coding agents derive working policies faster with Eden. A learned locomotion task (quadruped backflip) is demonstrated for sim2real transfer. And data collected in Eden can be used to train manipulation policies for pick-and-place tasks.
Critical strengths
- Reducing task reimplementation across training, evaluation, real-robot deployment, etc., is important and promising.
- The proposed framework also unifies a few segmented simulation backends.
- Experiments show that it's coding agent friendly.
Critical weaknesses
- A bit unclear how does the submission fits into ICLR. The submission reads mostly like a software/programming advancement.
- It's unclear how does Eden work with more diverse and complex tasks.
- Eden is only verified on locomotion task and a simple pick-and-place task for sim2real transfer. While for locomotion tasks, sim2real transfer is a solved problem, it's unclear how does Eden can further advance manipulation tasks.
Questions for authors
How does Eden handle sim2real gaps?
Thank you for the review. We address each of your concerns below.
Hardware results. Two experiments ran on hardware:
Manipulation. The release supports manipulation in data collection, evaluation and deployment. Teleoperation devices (GELLO, Meta Quest, PICO, Wuji glove) record HDF5 demonstrations that convert to LeRobot datasets. Batched Gaussian-splat scenes render a reconstructed workcell per environment for visual policies. VLA clients, among them π0.5, GR00T and Octo, run in Eden tasks for evaluation. Deployment backends cover the Franka Panda and FR3, the XHand and the Wuji Hand, and an arm with a hand deploys as one robot. The README (in the anonymized repository, https://anonymous.4open.science/r/eden-anon-1A3B/) shows a pen-spinning policy run on a real Wuji Hand 2 with
eden deploy. The paper reports manipulation hardware trials for the UR10e only, where the VLA's own server drives the arm (§5).ICLR area. We submitted Eden to the area "infrastructure, software libraries, hardware, etc.", and ICLR has published library papers such as TorchRL (ICLR 2024). Robot-learning methods are trained and evaluated on task definitions, and Eden is infrastructure for writing and deploying them. The paper measures two costs that a learning researcher pays: writing a new task (§4.1), and running a trained policy on a robot, which in Eden needs no second implementation of its processing (§4.2).
More diverse and complex tasks. The release has 66 tasks, among them multi-clip and hand-object motion tracking, humanoid skateboarding, extreme parkour, dexterous lifting, in-hand reorientation, bimanual piano, cloth folding, cable routing and wiping with a soft sponge, plus the robosuite, LIBERO, SIMPLER and PolaRiS suites. App. H gives full specifications for twelve. Eden exposes rigid, MPM, SPH, PBD, FEM, IPC, and Mochi physics (Table 5).
Sim-to-real gap. Eden handles the gap with tools in the same configuration that defines the task:
Entity replacement removes one software cause of the gap, deployed observation and action code that differs from the code used in training. The G1 trials ran with all training-time randomization disabled (Table 4).