- Rating
- 2(+1)
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2(+1)
Read review
Paper summary
The paper argues that with explicit PD control, fixed gains cannot meet both the force authority needed in contact (Bound 1) and the stability needed in swing (Bound 2), so the controller gives up either pose or force. It proposes ImpedanceMimic, a policy that outputs per-joint impedance and is trained with force-plate GRF and CoP rewards. On 129 participants and six activities it reports better motion and force tracking than fixed-gain PD, better motion tracking and survival than direct torque, and transfer to unseen bodies and activities. The learned gains are interpreted as an activity-specific physiological signature.
Critical strengths
The paper scales imitation with measured GRF and CoP rewards from a single walking participant to 129 participants and six activities, without a residual wrench. It also evaluates forces in detail, which most physics-based imitation work does not, and its physical-consistency metrics show where regression models produce impossible forces. I think this evaluation setup will be useful for future work.
Critical weaknesses
W1. Much of the claimed contribution seems to come from PD control itself rather than from the learned impedance, and stable or implicit PD already avoids the problems the paper sets up.
The two bounds are derived for PD applied as an explicit force (Section 3.1). Stable PD has no Bound 2, and because its torque accounts for gravity and external forces through the predicted acceleration, Bound 1 does not hold in the same form either (Tan et al., 2011). Widely used imitation controllers avoid explicit PD: DeepMimic uses stable PD and PHC uses Isaac Gym's implicit PD. It is unclear whether the analysis applies beyond explicit PD.
The generalisation results raise the same question. Unseen subjects come from the same corpus, and fixed-gain PD with the same inertia prior already survives 91.3% of their clips (Table 1), so most of the transfer seems to come from PD control plus the prior. For unseen activities, the paper attributes the failure of fixed-gain PD to instability, again a property of explicit PD, whereas PHC with implicit PD reports high success on motions outside its training set.
Because PD control and the learned gains are not separated, it is hard to tell what the method itself contributes.
W2. The comparisons are not like for like, so the advantage over the baselines is not established.
Direct torque has a higher FZr than ImpedanceMimic in Table 1, although the abstract claims the opposite. The two use different pose kernels, and removing amplitude normalisation, which is what distinguishes Torque's kernel, raises ImpedanceMimic's FZr from .80 to .85, above Torque's .83 (Table 19). Torque also has lower hip and knee torque limits and holds its torque for 10 ms, so Table 1 cannot separate the action space from these choices. Joint torques are also unresolved: ImpedanceMimic's RMSE against inverse dynamics is higher than Torque's (Table 10), and the metric is pooled over nine joints, so it does not show how well the knee, the joint behind the paper's motivation, is reproduced.
The PHC baseline appears to under-perform. PHC reports 98.9% success and 26.9 mm MPJPE on 11,313 AMASS sequences (Luo et al., 2023), but the port here has an 11.8° joint-angle error, four times that of fixed-gain PD on the same bodies. A controller that optimises only kinematic imitation should not track kinematics five times worse than ImpedanceMimic, which suggests the port does not reproduce PHC.
SimPoE and ReGAIL, the close methods that learn PD gains, are discussed but not compared. ImpedanceMimic's gains (Eq. 3) are also per-joint multipliers on base gains, so a direct comparison is needed to show what the inertia-based gains and the force reward add.
W3. The evidence does not support reading the learned gains as human impedance.
Human joint impedance is modulated largely by co-activation of antagonist muscles (Hogan, 1984). The same net torque can come with very different impedance, so kinematics and GRF alone cannot identify it. The values also differ from the cited measurements: the stance-phase stiffness rise is about one seventh of that in Rouse et al. (2014), and quiet-standing stiffness is 0.4 of the toppling stiffness, against about 0.9 in Loram & Lakie (2002). Calling them human is too strong for a stated contribution.
Tan, J., Liu, C. K., Turk, G. Stable Proportional-Derivative Controllers. IEEE CG&A 31(4):34–44, 2011.
Hogan, N. Adaptive control of mechanical impedance by coactivation of antagonist muscles. IEEE TAC 29(8):681–690, 1984.
Questions for authors
Q1 (W1). How does a fixed-gain baseline with stable PD or implicit damping, with high stiffness and adequate damping, compare on the seen, unseen and leave-one-activity-out splits? A clear lead for ImpedanceMimic there would make the contribution of the learned gains clear.
Q2 (W2). Could you compare against Torque with the same pose kernel and torque limits as the PD variants, and at a higher policy rate?
Q3 (W2). Could you report joint-torque RMSE and correlation per joint, at least for the knee and ankle?
Q4 (W2). Does the PHC port reproduce the published results in its original setting (AMASS)? If not, the PHC rows cannot support the comparison.
Q5 (W2). Could you compare with SimPoE's meta-PD and ReGAIL's gain and damping actions on the same data and reward?
Q6 (W3). The gain analysis uses only the seed-0 policy. Does the signature hold across seeds and gain ranges?
7 comments
[2/5] W1. Transfer to unseen subjects and withheld activities
We agree that survival on unseen subjects comes largely from PD control, and that the integrator explains part of the failure on withheld activities. What the learned gains add is force accuracy on unseen subjects, and the smallest loss of survival on withheld activities.
Does transfer to unseen subjects come from PD control and the prior? (W1)
Largely from PD control, yes. The unseen subjects come from the same corpus, and with stable PD or implicit damping, doubled fixed gains reach 96.2 and 96.5 % survival on them (Table 2). The prior matters little for survival. Without it, ImpedanceMimic still reaches 97.5 % survival, but its torque jerk rises 2.7-fold. Activity means on the 22 unseen subjects over 5 seeds:
| Unseen subjects | Survival (%) | Joint-angle RMSE (°) | Vertical GRF r | Torque jerk |
|---|---|---|---|---|
| Fixed-PD with the prior (Tables 1, 21) | 91.5 | 3.13 | .70 | 56.4 |
| ImpedanceMimic without the prior (Table 27) | 97.5 | 2.68 | .75 | 53.7 |
| ImpedanceMimic | 98.1 | 2.45 | .76 | 19.9 |
What the learned gains add is force accuracy. Compared with fixed gains at the same scheme and gain level, they raise the vertical force correlation on unseen subjects by .02 to .07 and the lateral one by .02 to .20 (Table 2).
Beyond the corpus, the same policies control a simulated Unitree G1 humanoid zero-shot, a body lighter and shorter (33 kg, 1.32 m) than every training participant. ImpedanceMimic reaches 82.1 % survival, against 56.9 % for Fixed-PD and 44.0 % for Torque (Table 13), and survives longer than fixed gains at the same scheme and gains in every case. Under stable PD, fixed gains reach a slightly higher vertical force correlation on the robot (.45 against .43, Table 14).
Is the failure on withheld activities a matter of stability? (W1)
In part, and the revision no longer attributes it to instability. With stable PD and implicit damping, Fixed-PD reaches 78.9 and 80.8 % survival on withheld activities instead of 69.8 % under explicit PD, and 85.8 and 83.4 % with doubled gains (Table 2).
The integrator does not explain everything, though. Every controller still loses survival when an activity is withheld from training.
| Survival, seen → withheld (%) | Explicit | Stable | Implicit |
|---|---|---|---|
| Fixed-PD, 2× | 96.2 → 83.1 | 96.6 → 85.8 | 95.8 → 83.4 |
| ImpedanceMimic | 96.9 → 89.6 | 93.8 → 83.5 | 97.2 → 92.6 |
| ImpedanceMimic, 2× | 96.9 → 90.3 | 96.3 → 88.0 | 96.8 → 90.4 |
| PHC | 93.5 → 67.2 | ||
| PHC, our reward | 93.5 → 70.2 |
Among controllers that act only through their joints, ImpedanceMimic loses the least under every scheme and at either gain level. The Discussion names two further factors, the small share of non-cyclic activities in training (16 % of clips) and subject models without arms.
PHC's high success outside its training set. This success refers to AMASS-Test, which holds out sequences from the Transitions and SSM subsets, not a whole activity. Our implementation imitates 92.2 % of these 140 motions (Table 10), but reaches only 67.2 % survival on our withheld-activity benchmark with its own reward, and 70.2 % with ours (Tables 2, 21).
[3/5] W2, Q2, Q3. Torque variants and per-joint torques
With the same pose kernel ImpedanceMimic beats Torque on every force metric, and neither the PD torque limits nor a 500 Hz policy rate improve Torque.
Torque's vertical force correlation and the abstract (W2)
You are right that Torque has the higher vertical force correlation on seen subjects (.82 against .80). §4.1 now says so, and notes that the lead comes mostly from standing, where the force stays close to body weight. On the other force metrics, which "force fidelity" in the abstract also covers, ImpedanceMimic is more accurate. Its lateral force correlation is higher on every benchmark (.70 / .65 / .57 against .62 / .53 / .47), as are its anterior–posterior force correlation and its center-of-pressure accuracy. On vertical force the two are otherwise close, with equal RMSE and correlations of .76 against .79 on unseen subjects and .72 against .71 on withheld activities. ImpedanceMimic also survives more often with half the joint-angle error (2.28 against 4.48°).
Torque with the same pose kernel, torque limits and a higher policy rate (Q2)
We ran all three (Table 22, seen subjects).
| Survival (%) | Joint-angle RMSE (°) | Vertical GRF r | Lateral GRF r | AP GRF r | |
|---|---|---|---|---|---|
| Torque | 95.4 | 4.48 | .82 | .62 | .54 |
| ImpedanceMimic with Torque's kernel | 97.6 | 2.86 | .85 | .75 | .65 |
| Torque with ImpedanceMimic's kernel | 82.8 | 44.9 | .60 | .49 | .43 |
| Torque with the PD torque limits | 82.5 | 53.4 | .09 | .04 | .06 |
| Torque at 500 Hz | 91.9 | 4.55 | .65 | .50 | .41 |
- Same pose kernel. With Torque's kernel, ImpedanceMimic beats Torque in survival, joint angles and every force metric. Torque cannot be trained with ImpedanceMimic's kernel. ImpedanceMimic keeps its own kernel because it gives a lower joint-angle error (2.28 against 2.86°) at a small cost in force accuracy, and we report both versions (Tables 22, 28).
- Same torque limits. Torque's own output scale already lies below the PD torque limits at the hip, knee and ankle for nearly all subjects (§3.2). With the PD limits, Torque fails to learn to track.
- Higher policy rate. Acting at every 2 ms physics step over the same simulated time, Torque reaches 4.55° against 4.48° at 100 Hz, so holding the torque for 10 ms is not what limits it. A torque policy has to learn the feedback that the PD law computes at every step (Peng and van de Panne, 2017).
We report the two failed variants as the outcome of the settings you requested, not as tuned baselines.
Per-joint torques (Q3)
Inverse-dynamics torques are themselves model-based estimates, and the goal of the paper is force-accurate motion imitation, so we report them for transparency and as a reference for future work. Seen subjects, 5 seeds, all six activities / without standing, RMSE in Nm/kg.
| ImpedanceMimic | Torque | Fixed-PD | Muscle | ImpedanceMimic, Torque's kernel | |
|---|---|---|---|---|---|
| Knee RMSE | .65 / .46 | .48 / .47 | .75 / .70 | .64 / .47 | .55 / .44 |
| Knee r | .62 / .74 | .61 / .73 | .50 / .60 | .57 / .69 | .63 / .76 |
| Ankle RMSE | .40 / .45 | .35 / .37 | .64 / .72 | .37 / .40 | .39 / .43 |
| Ankle r | .57 / .63 | .61 / .69 | .44 / .48 | .52 / .60 | .59 / .65 |
| 9 joints, RMSE | .62 / .57 | .54 / .58 | .74 / .78 | .59 / .55 | .56 / .55 |
Torque's lower knee error comes from standing (0.55 against 1.60 Nm/kg for ImpedanceMimic), where the reference knee rests at its 0° stop. Without standing, the pooled RMSE is equal (.57 against .58), and ImpedanceMimic matches or exceeds Torque in knee correlation. At the ankle, Torque is more accurate, mainly in jumping (.43 against .75). Unseen subjects show the same pattern.
[1/5] W1, Q1. Fixed and learned gains under stable PD and implicit damping
Dear reviewer,
Thank you for this detailed review. Your questions led to the largest additions to the revision, and every experiment you asked for is now in the manuscript or in this thread, with 5 seeds unless stated. Table and section numbers refer to the revised manuscript.
We ran the experiment you proposed in Q1. When both methods use the same integration scheme and the same gains, ImpedanceMimic tracks joint angles and all three force components better than fixed gains in every comparison, and survives longer in all but one. Stiffer fixed gains improve joint angles, but never the vertical force correlation.
Do the bounds apply beyond explicit PD? (W1)
You are right that Bound 2, the damping limit, applies only to explicit PD, and §3.1 now attributes it to explicit PD. Bound 1 still constrains fixed gains under the other two schemes. Implicit damping leaves the spring term unchanged and stable PD only evaluates it one step ahead, so a fixed stiffness still limits the available torque (App. A.2.3). We kept explicit PD as the main setting because it puts all four action spaces on the same integrator and gives the bounds in closed form, and we added the other two schemes as you suggested.
Fixed gains under stable PD and implicit damping (Q1)
We retrained Fixed-PD and ImpedanceMimic under stable PD and implicit damping, each with the nominal gains and with doubled gains, which provide the "high stiffness and adequate damping" you asked for (Table 2, App. A.2.3). Under explicit PD, only the stiffness is doubled, since doubled damping would violate Bound 2. Comparing the two methods at the same scheme and gain level gives 6 pairs (3 schemes × 2 gain levels) on 3 benchmarks, or 18 comparisons.
The one exception is survival on seen subjects at doubled gains under stable PD (96.3 against 96.6 %, within one seed sd), which is also where the margins are smallest. The lead in vertical force correlation is .06 to .13 under explicit PD, .04 to .05 under implicit damping and .01 to .04 under stable PD (Table 2). In survival, the lead under stable PD and implicit damping is small on seen subjects (at most 1.5 points) and grows away from the training data, to 2.2 to 11.8 points on withheld activities (Table 2) and 1.4 to 14.9 points on the G1 robot (Table 14).
Two further results show whether stiffer fixed gains could close the gap.
Why fixed gains fall short. Stable PD and implicit damping remove the damping limit, but not the need to change stiffness with load. Both the torque a joint can produce in contact (Bound 1) and how the load is split between the feet in double support depend on the stiffness, which fixed gains cannot adapt (§4.4). The learned gains raise the stiffness with load (§4.3), which fixed gains cannot do under any scheme.
The picture is the same under a 20 ms observation delay, without retraining. Matched fixed gains lose 1.6 to 2.1 times as much survival as the learned gains under stable PD and implicit damping, and 3.5 to 8 times as much under explicit PD (Table 24).