- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper studies how proximity-sensor representations affect the sample efficiency of learning collision avoidance. Using a simulated humanoid dodgeball task, it compares raw observations, lossy transformations, learned compression, and future-contact prediction. Under the tested policy architecture and training budget, low-dimensional sensing and simple minimum-distance features support faster learning, while adding future-contact information generally slows it down.
Critical strengths
- The paper asks what information a resource-constrained policy can actually use, rather than assuming that more detailed sensing or future predictions will always help. This is a worthwhile question for robot learning.
- The experiments cover simple transformations, learned representations, and oracle observations. Multiple seeds and learning-curve metrics provide a more informative evaluation than final success rates alone.
Critical weaknesses
- Videos of successful and failed trials would help show how quickly the robot reacts and how it avoids the ball. The static examples leave me unsure how much the task actually requires detailed spatial sensing or anticipation, which matters for interpreting the results.
- The small two-layer MLP fits the paper’s setting, but it is unclear whether low-dimensional representations are better for avoidance learning or simply easier for this network to handle. Testing a few network sizes would help clarify how much the findings depend on this choice.
- Predictions are added as extra policy inputs, so slower learning could mean either that future information adds little value or that the policy struggles to use it. Comparing different ways of incorporating predictions would help separate these explanations; otherwise, the conclusions should be limited to the current setup.
Questions for authors
- For each representation, what proportion of failures results from ball collisions versus loss of balance? How does this breakdown change during training?
- How is each observation representation normalized before entering the policy? Are PPO hyperparameters shared across representations or tuned separately?