- Rating
- 2
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
In human environments, robots often need to operate articulated objects such as microwaves and toaster ovens that rest unanchored on a surface. Opening them requires overcoming an initial opening resistance: too little pulling force leaves the door or lid closed, while too much can drag the entire object, so one arm typically pulls while the other stabilizes the object body. Existing methods either assume the object is anchored or ignore opening resistance, and thus fail to capture this coupling between opening and stabilization. To address this, the authors propose BARS-RL, a reinforcement learning framework in which a single policy allocates force between a task arm and a support arm without observing resistance or friction. Its key design is a stabilization reward that penalizes contact forces near the base-slip boundary, providing a training signal before the object body moves; training follows a curriculum organized by the resistance-to-friction ratio, progressing from an anchored object body, to an unanchored one, and finally to a mix of episodes that base friction alone can hold and those that require support.
Critical strengths
- The core physical quantity p can explain when a support arm is needed, and the ablation studies also confirm this phenomenon.
- The problem is of practical significance: for articulated objects that are not anchored in the environment, such as microwaves, refrigerators, and air fryers.
- The paper is well structured, clear, and easy to understand.
Critical weaknesses
- Currently, the results are entirely simulation-based, lacking real-robot experiments.
- The baselines are relatively simple, lacking comparison with stronger recent single-arm/dual-arm methods.
- The reward function contains many handcrafted weights, thresholds, and safety coefficients, but no sufficient sensitivity analysis has been conducted.
Questions for authors
- The simulation scenarios addressed by this method are rather idealized, making it difficult to apply them to real robots.
- The baselines selected are relatively few and do not adequately demonstrate the advantages of the method.
- Do the maximum force exerted by the support arm and the impact experienced by the object satisfy practical safety constraints?
- Is the current method sensitive to the weights of the multiple reward functions?
- How can it be explained that the version without curriculum achieves 0% on all objects?
- Are the support arms intentionally set in advance to keep each object in a fixed end-effector pose? It seems like the fixed end-effector poses might be different for manipulating different objects?
8 comments
Response to Reviewer mRm6 (2/3)
W3 / Q4:
The reward function contains many handcrafted weights, thresholds, and safety coefficients, but no sufficient sensitivity analysis has been conducted. / Is the current method sensitive to the weights of the multiple reward functions?
Response:
We agree this needed to be examined. We varied the weight and safety factor of the base-slip cost, the term we introduce, and tested whether one reward setting transfers across objects and robots.
-
Parameter sensitivity (Appendix C.3, Table 6): We used the mini fridge, the object with the lowest success rate and the largest drop without , and retrained with one parameter changed at a time (three seeds, ρ ∈ [1.25, 2.0]). Because these are separate runs, the default differs from Table 1 (62.2% vs. 68.4%).
Setting Success rate Default ( = 0.04, = 0.7) 62.2 ± 6.1 × 0.5 59.4 ± 14.6 × 2 57.2 ± 11.2 = 0.5 69.0 ± 4.5 = 0.8 62.6 ± 3.6 Three of the four variants are within 5.0 points of the default, which is within its seed standard deviation (6.1). is 6.8 points higher, so the default is not tuned to the best value; all reported results use the default. Changing mainly increases seed-to-seed variability.
-
Reuse across objects and robots: The same weights and thresholds (Tables 10 and 11) were used for all five simulated objects without per-object tuning, and the real-world policies used the same reward with only the robot model replaced (Section 5.2).
Q3:
Do the maximum force exerted by the support arm and the impact experienced by the object satisfy practical safety constraints?
Response:
The setup limits loads through a force-command limit, torque-aware initialization, and distributed contact. The commanded pressing force is limited to 40 N in training and deployment (Appendix D.1), and the initialization selects a support pose whose joint torques stay below 90% of their limits under this load. Reward penalties discourage excess grip and off-axis force, and the four flat fingers spread the support load.
Force logs were available for 13 real-world trials (10 microwave and 3 air fryer; Appendix E). The commanded pressing force stayed within 40 N. The force estimated from joint torques averaged 13–31 N per trial and peaked at 48.4 N, exceeding 40 N for at most 0.33 s, and the 80 N safety stop was never triggered. The commanded force dropped to about 5 N after latch release, and no appliance damage was observed.
These estimates are logged at 30 Hz and do not resolve millisecond-scale impact peaks, so we do not claim a direct measurement of impacts.
(Continued in the next comment.)
Response to Reviewer mRm6 (3/3)
Q5:
How can it be explained that the version without curriculum achieves 0% on all objects?
Response:
We added a termination breakdown of training without the curriculum on the mini fridge (Appendix C.1, Figure 8). Success stays at zero for all plotted seeds, and each seed fails in a distinct way: excessive body displacement (seed 6), time-outs (seed 5), or an increasing fraction of simulation divergence (seed 4). In the last case, since every step incurs a time penalty and the success bonus is never obtained, ending an episode early yields a higher return, and the policy learns to terminate early.
Training directly on the final distribution requires discovering pulling and pressing at the same time; until both occur, pulling only drags the body and the closure never releases, so no success signal arrives. The curriculum separates the skills: anchored opening, then unanchored opening that base friction can support, then support-dependent episodes (Section 4.3), with success-gated stage transitions (Table 13).
Q6:
Are the support arms intentionally set in advance to keep each object in a fixed end-effector pose? It seems like the fixed end-effector poses might be different for manipulating different objects?
Response:
The initial support pose is now selected by a geometry-based algorithm with common rules and parameters across objects and robots, without manual specification (Appendix D.1). It combines analytical reachability and force-feasibility analysis with geometric checks, so the pose adapts to each object's geometry.
This pose defines only the starting contact. The support hand starts without pressing, and the policy then commands both a relative pose and a wrench target (Appendix D.2), so the stabilization location and force are controlled by the learned policy through feedback.
We hope these results address your concerns. If they resolve the questions about real-robot validation, baselines, and sensitivity, we would be grateful if you would reconsider your assessment. If any concern remains, please let us know and we will address it during the discussion period.
Response to Reviewer mRm6 (1/3)
We thank the reviewer for recognizing that the ratio ρ explains when a support arm is needed and that the problem has practical significance. The reviewer's concerns were the lack of real-robot experiments, the baselines, and reward sensitivity. We have addressed each with new experiments; all changes in the revised PDF are marked in red.
Summary of changes
What we see as the main insight is that a single quantity, ρ, predicts when support becomes necessary across objects with different mass, friction, and joint type (Figure 7), and organizing training by ρ outperforms organizing it by resistance alone (Table 3).
W1 / Q1:
Response:
W2 / Q2:
Response:
To our knowledge, no prior RL method addresses this coupled setting, so we added ACT, Diffusion Policy, and the acting-and-stabilizing bimanual method VoxAct-B, each with and without wrist F/T (Table 1; details in Appendix D.7). Average success (%):
For ρ ≥ 1.25, BARS-RL exceeds the best baseline by 38.4 points. Single-arm RL leads for ρ < 1.25, where one arm suffices, but drops to 29.5% when the body is dragged before release.
(Continued in the next comment.)