- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper focus on the problem that hardware failures (e.g., actuator lockups or loss of range of motion) abruptly alter robot dynamics mid-deployment, causing policies trained under nominal dynamics to fail. Existing fault-tolerant methods either rely on fault-specific engineering, require monolithic policies to generalize across wide dynamics distributions, or optimize skill libraries for task variations rather than physical bodily faults.
The authors propose a fault-indexed skill library framework to enable sample-efficient recovery with 2 steps. First of all, specialist policies are trained via PPO for representative single-joint faults across tasks, indexed by fault descriptor (joint index and severity), producing a structured library of 60 policies across four manipulation tasks. When an upstream fault alarm identifies active joint damage, the matched fault-specific policy is retrieved. Known faults are deployed directly or fine-tuned; unseen or compound faults use candidate library policies as warm-start initializations for targeted RL fine-tuning rather than learning from scratch.
Findings in the experiments:
(1) Tested on a 7-DOF Franka Panda arm across four tasks (8-Bin Sort, Shelf Placement, and Horizontal/Vertical Wall Pick-and-Place), Joint 1 (shoulder pitch) and Joint 3 (elbow) emerge as universally critical (70%–99% failure rate drops), whereas distal joints (J0, J2, J4, J6) are consistently non-critical.
(2) Single-joint libraries generalize to unseen compound double/triple faults. Half-severity compound failures remain largely solvable (up to 100% success), while full freezing across multiple critical joints exposes severe kinematic bottlenecks. Cross-task transfer succeeds when source libraries are trained on kinematically diverse workspaces (e.g., 8-Bin transferring to Shelf).
Critical strengths
(1) The problem of fault-aware policy is interesting and practical for robotics deployment.
(2) Different from existing fault-tolerant methods, this paper propose to pre-train a library of fault-indexed skills and re-use the library during deployment, which is reasonable for the task.
(3) The extensive experiment reveals various conclusion about the proposed method.
Critical weaknesses
(1) There lacks experiments on real-world robots. Could the author provide some experiments on real ones?
(2) For the compound fault part, fine-tuning the existing policy one-by-one seems too expensive. The distance between the fault index of the learned policies and the new fault in the "fault-space" might serve as a cue to combine/select existing policy when a new fault appears.
Questions for authors
Please refer to the weakness part.
Thank you for your kind suggestions. We have answered your questions in the comments below.
1. Real-world robots
We agree that real-robot validation matters. However, our focus is simulation, and we cannot inject faults into real robot to validate sim-to-real transfer of the library due to the hardware limitations. We will state real-robot deployment as a limitation of our paper and a future work direction
2. Distance in fault space as a cue for compound faults
Following the comment, we ran a cheap test.On the Wall-H task, we fine-tuned from each of the 15 library policies on 7 compound faults (10 seeds, final checkpoint), and asked whether fault-space distance between the source policy and the compound fault predicts which source works best.
We therefore keep fine-tuning from a retrieved single-fault policy as our approach for compound faults. This test covers selecting a source policy by distance. It does not cover combining policies (for example, weight merging), which we agree is a promising direction and will list as future work. Our next step is a smarter, structured retrieval method, which will be the main focus of future work.