- Rating
- 3
- Confidence
- 1
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper propose a method to train dressing policy, which utilize a differentiable cloth simulation (DiffCloth) to get denser learning signals for model update. The simulator and real world experiments show that the policy success rate is clearly higher than baselines, while an ablation version without the learning gradient signals of differentiable simulation demonstrates the necessity of differentiable feedback from simulator clearly, solidifying the core argument of the authors.
Critical strengths
- clear evidence that demonstrates the significance and necessity of training a model for complex tasks like dressing with differentiable simulator feedback.
- strong performance across real-world and simulator environment.
- good and clear visualization of method and experiment process.
Critical weaknesses
- real-world execution is not robust and applicable, with too many annotations and demo-orientated specific designs. There are still far away from a practical dressing system.
Questions for authors
- Baseline methods are not documented enough. For example, how TD-MPC2 are employed in the task setting?
- The component of dataset is not clear, because some samples in dataset are interpolated, not independent novel poses.
- Can authors convert the real-world execution from open-looped one into close-loop system, and also get rid of the heavy annotation and designs? Will it still remain successful in real-world dressing task?
2 comments
[W1/Q3] Closed-Loop Execution and Automated Perception
We thank the reviewer for highlighting two important directions toward practical deployment: closed-loop control and automated perception.
For closed-loop execution, GwoP predicts trajectories directly from task observations, with a network forward pass and single-trajectory decoding taking only 2.60 ms on average. This provides a basis for incorporating repeated observations and trajectory updates during execution. A possible extension is to update garment and body observations online, regenerate the trajectory, and execute the updated motion. As the current solver is trained to predict complete trajectories from initial states, reliable replanning from intermediate dressing states requires further development. We therefore share the reviewer's view that closed-loop feedback is an important next step, which we also identified as a future direction in Sec. 6 of our original submission.
For automated perception, the current manual keypoint annotations and calibration procedure provide controlled, repeatable inputs for evaluating trajectory generation. These could potentially be replaced by automatic human-pose estimation, body-model fitting, and coordinate registration.
To investigate sensitivity to uncertainties introduced by perception and initialization, we have conducted two additional perturbation experiments (Appendix D.5, Tables 6–7, Figs. 10–11). The results are summarized below:
| Perturbation | Magnitude | Elbow Pass ↑ | Progress ↑ | Edge Viol. ↓ | Area Viol. ↓ |
|---|---|---|---|---|---|
| Initial Garment/Gripper Position | ≤ 4 cm | 100.0% | 65.1% | 0.0110 | 0.0232 |
| ≤ 8 cm | 93.2% | 57.6% | 0.0149 | 0.0303 | |
| Shoulder-Angle Estimation | 8° | 97.7% | 74.4% | 0.0122 | 0.0254 |
| 24° | 96.3% | 66.2% | 0.0143 | 0.0277 | |
| Elbow-Angle Estimation | 8° | 98.8% | 73.8% | 0.0121 | 0.0251 |
| 24° | 90.8% | 64.5% | 0.0147 | 0.0290 |
Position perturbations are grouped by cumulative radius; angular perturbations are grouped by exact absolute error, averaged over the evaluated perturbations of the other joint.
The initialization experiment evaluates sensitivity to variations in initial garment placement and grasp-point positions, which are relevant to uncertainties in garment localization and initialization. The angular perturbations examine inaccuracies in human arm-pose estimation. The results show that GwoP maintains high elbow-passage success under moderate perturbations, while larger errors generally lead to reduced dressing performance. These findings provide preliminary evidence of tolerance to perception and initialization uncertainties.
We appreciate the reviewer's constructive suggestions, which help clarify the next steps toward a more autonomous and practical robot-assisted dressing system.
We thank the reviewer for the encouraging assessment and for recognizing the benefits of differentiable physical feedback, simulation performance, and real-robot evaluation. We have expanded the implementation details and added experiments to clarify dataset composition and robustness.
[Q1] TD-MPC2 Implementation and Task Adaptation
Thank you for requesting further details. We have substantially expanded the TD-MPC2 implementation description in Appendix C.3.
We adapt TD-MPC2 to the DiffCloth dressing environment while retaining its implicit world model and model predictive control framework.
The main task-specific settings are as follows:
With the aligned two-gripper interface, TD-MPC2 achieves 56.2% elbow-passage success and 47.9% dressing progress. The updated comparison is reported in Sec. 5.2 (Table 1, Fig. 2), and the observation, reward, planning, and training details are documented in Appendix C.3.
[Q2] Dataset Composition and Interpolation/Extrapolation
Thank you for pointing out the need to distinguish interpolated test configurations from extrapolated ones. We have clarified the dataset construction and provided a visualization of the complete pose space in Appendix B.3 (Fig. 6).
Arm poses are parameterized by shoulder angle ϕs and elbow angle ϕe, with:
\phi_e \in {0^\circ,2^\circ,\ldots,80^\circ}.$$ This produces 1,066 distinct arm configurations. We train on 25 poses selected from a sparse 5 × 5 grid and reserve the remaining 1,041 configurations for evaluation. The held-out set is divided into: | Subset | Elbow Pass ↑ | Progress ↑ | Edge Viol. ↓ | Area Viol. ↓ | | ---------------- | ------------ | ---------- | ------------ | ---------- | | Interpolation | 100.0% | 75.8% | 0.0107 | 0.0233 | | Extrapolation | 87.5% | 71.2% | 0.0139 | 0.0276 | | **Total unseen** | **97.1%** | **74.7%** | **0.0115** | **0.0243** | These are the results of the model used in the main comparison (Seed 2). The interpolation subset consists of unseen configurations within the angular bounds of the training grid, whereas the extrapolation subset lies outside those bounds. Thus, **all 1,041 test configurations are held out, but they represent two different generalization regimes**. We additionally evaluated three independent training seeds. The average extrapolation success rate is 89.9 ± 7.5%, compared with 100.0 ± 0.0% for interpolation. The split definitions have been added to Sec. 5.1 and Appendix B.3, with the complete multi-seed results in Appendix D.4 (Table 5, Fig. 9).