- Rating
- 2
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 2
- Soundness
- 3
Read review
Paper summary
This paper proposes SC-PPO, a modification of PPO for navigation under action execution errors. It combines parameter- and action-space secant corrections with a revision-gap monitor for controlling policy updates. Experiments on BARN report modest improvements under execution disturbances while preserving nominal performance, alongside a qualitative demonstration on a humanoid robot.
Critical strengths
- The paper addresses the mismatch between commanded and executed actions, a practical source of navigation failures in constrained spaces.
- The evaluation covers persistent biases and random action noise, uses five training seeds and matched interaction budgets, and includes component ablations.
Critical weaknesses
- The results show gains under the tested disturbances, but do not establish that reduced action sensitivity explains them. Validating the Q-head’s predicted return changes against actual outcomes under small action perturbations, together with matched analyses of trajectories, speeds, and corrective behavior, would help distinguish this mechanism from general improvements in policy learning.
- The paper reports deployment without retraining, but does not sufficiently describe the simulated execution dynamics, including control response, delays, and velocity tracking errors, or their correspondence to the humanoid’s locomotion controller. Missing details on calibration and interface adaptation limit reproducibility and make the transfer conditions difficult to assess.
Questions for authors
- Does the goal in Fig. 2 represent the final destination or an externally generated waypoint/subgoal? If the system uses a global planner, what information does it provide to the policy, and how are route selection and local obstacle avoidance divided between these modules?
- How many episodes were evaluated per test map and disturbance condition? Based on existing evaluations, could the authors provide results for each training seed and uncertainty estimates for SC-PPO’s performance gains over PPO and SAM+PPO?
2 comments
Response to Rebuttal of Submission779
Thanks for acknowledging this concern. The proposed checks of Q-head predictions against actual return changes, together with examples comparing paths, speeds, and corrective actions under the same conditions, would help explain whether the robustness results come from reduced action sensitivity. Since these analyses have not been provided yet, I’m keeping my original assessment.
Response to Reviewer pPBE
We thank the reviewer for the constructive suggestions. Several of them, such as validating the Q-head's predicted return changes against actual outcomes, are part of our revision plan.
Mechanism. We agree that the paper does not show that reduced action sensitivity explains the results. Given the analysis in point 1 of the general response, we now expect the current method not to reduce curvature-level sensitivity. In the revision we will test this directly: we will compare Q-head-predicted ΔQ with Monte-Carlo Δreturn under small action perturbations, and report retention, i.e. success under faults given nominal success, together with matched statistics of trajectories, speeds and minimum clearance.
Execution dynamics and humanoid transfer. We agree that the paper lacks these details. Training and evaluation use the standard BARN Gazebo/Jackal setup. Beyond the injected test-time faults, the simulator models no additional actuation latency or velocity-tracking error. No calibration or interface adaptation to the humanoid was performed: the policy's (v,ω) command is sent directly as forward-velocity and yaw-rate targets to the onboard locomotion controller. Transfer therefore relies on the policy tolerating the humanoid's tracking error without any adaptation. We will add these details to the appendix. We will also state explicitly that the humanoid run is a qualitative demonstration and not evidence of transfer.
Q1. Goal in Fig. 2. The goal is an intermediate waypoint produced by a global planner, not the final destination. The global planner is responsible for route selection, and the policy receives the waypoint as its goal input and handles local obstacle avoidance. We will state this division explicitly in the revision.
Q2. Episodes and uncertainty. Nominal evaluation uses one deterministic episode per test map per training seed (45 maps × 5 seeds = 225 episodes), so the nominal SC-PPO vs PPO difference is a single episode. Faulted families are evaluated on the same maps at each nonzero fault level. With five seeds, the SC-PPO gains over PPO and SAM+PPO are within seed noise. The revision will use multiple perturbed start poses per map, paired per-map tests, hierarchical bootstrap CIs and per-seed tables.