- Rating
- 2
- Confidence
- 3(+1)
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
Physical control systems are subject to hard constraints at every manipulation step, such as strict limits on contact force and velocity, yet existing reward-driven reinforcement learning often fails to truly enforce these limits. The problem is further complicated by the fact that constraint satisfaction depends not only on the high-level predicted action but also on the low-level controller's live state during execution. To bridge this gap, the authors introduce CAP (Closed-form Action Projection), a modular layer that imposes hard, state-dependent action constraints on learned policies and world-model planners. Specifically, at each control step, CAP computes an admissible action set in closed form from the live controller state and projects the candidate action onto it, requiring neither online optimization nor a learned constraint model, and thereby provably guaranteeing constraint satisfaction. In addition, to eliminate the geometric ambiguity inherent in pure proprioception, they integrate a world model that processes environmental observations such as wrist depth during impedance control.
Critical strengths
- The paper raises a very interesting problem, namely completing manipulation tasks with safe and appropriate forces.
- Compared with other baselines, the proposed CAP-PPO/CAP-WM algorithm imposes a more reasonable constraint on force.
Critical weaknesses
- The experiments lack intuitive visualizations of the manipulation tasks.
- The proposed method is only validated in three simulation environments and has not been verified in the physical world.
- There is no analysis of why model-based methods handle better than model-free methods under relatively small force limits.
Questions for authors
- Is the proposed method also applicable to manipulation environments beyond assembly tasks?
- How is the reward function of PPO designed for each task?
- Why do model-based methods handle better than model-free methods under relatively small force limits?
- The SSR metric is defined by a manually set range, is there any justification for this, or is it set arbitrarily?
- I think the problem raised in this paper is a good one, but the tasks used for evaluation are not well suited to the proposed algorithm. I believe fragile objects such as cookies or glass test tubes should be tested to better reflect the algorithm's performance.
- Is video used as supervision during world model training?