- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 3
Read review
Paper summary
The paper studies how the order of fitting, averaging, and projection affects learning from unreachable demonstrations. It explains competing capacity and statistical effects, proposes constrained-Bayes distillation (CBD) and command-based intialization, and compares them with existing training strategies. Its contribution is primarily an analysis of these tradeoffs on simulated experiments.
Critical strengths
The paper identifies the tradeoff in learning from unreachable targets: projecting demonstrations before training can preserve limited model capacity, but nonlinear projection can also bias the regression target. The theoretical analysis and controlled experiments explain why making training targets feasible does not necessarily improve the final predictions.
Critical weaknesses
- The presentation lacks a clear hierarchy of claims, which makes the central contribution hard to extract. The title suggests a focus on when and why the order of projection affects learning, but the experiments interleaves too many things. Projection-order effects, CBD, and command-based initialization are discussed along with a lot of rankings, exceptions, and sensitivity results without sufficiently prioritizing the takeaway. Although individual findings are listed in detail, the evidence are not synthesized into a concise interpretation of the pros and limitations of each method. Hence, it is a bit hard for the readers to follow.
- The connection between the motivating applications and validation remains uncertain. The physical-face measurements demonstrate a reachability mismatch but do not evaluate the compared training strategies or establish the projection-order bias in the setting. Hence, how this study can practically guide the real-world facial expression transfer remains unclear.
Questions for authors
- What is the central conclusion about projection order that the experiments establish? Please distinguish conclusions supported across benchmarks from observations specific to each detailed particular setting, and clarify how the command-initialization results support or complement the projection-order analysis.
- What do the physical-face measurements establish about the relevance of the proposed methods? Do your existing measurements support either capacity competition or projection-order bias in facial imitation?
- What is your actual advance over the closest prior methods?
5 comments
In the face experiment added in the Nov 13 revision, RAW had the lowest held-out error at all four widths. Among the two ways of making training labels feasible, CBD beat PTF, and the full ordering repeated with a refitted face model (Tables 2 and 37). Our contribution beyond retargeting and projection layers is to explain how the timing of projection changes what a student with limited capacity learns (§6). The command experiments then show how the same inverse can also supply a better starting point for a feasible-output student.
Before the discussion closes, could you let us know if any concerns remain after our response and the revised experiments? We would be glad to clarify them.
Response to Reviewer 8LdX
Thank you for identifying the presentation problem. We have reorganized the Introduction and Experiments around one central insight: making a demonstration feasible can save a learner's capacity while changing the target it learns. CBD addresses the target bias; command initialization is a complementary use of the same inverse. Figures 3 and 6 now make the results and their behavioural meaning easier to see.
The linear theorem isolates the capacity benefit of projecting first. On curved or bounded sets, the nonlinear analysis explains the competing effect of interchanging averaging and projection. The experiments then show when those effects matter for a finite student.
CBD improves on PTF pooled within each tested curvature of the curved benchmark and at every width on the face. PTF is never significantly the best of the three output-label orders on the curved benchmark, trajectory plant or face (Figure 3; Tables 1–2). Whether CBD also beats RAW depends on the setting: RAW takes 13 of 19 decided cells in the curved benchmark, and CBD the other six, all at the highest curvature or narrowest width (§5.1). RAW leads among the three output-label orders at every tested width on the trajectory plant and face.
The command experiments ask a closely related question: which product of an inverse solve is useful supervision? With the same inverse solve and second stage, command pretraining beats output imitation at every width and in every seed on the trajectory plant. It makes the feasible-output student the best learner at widths 8 and 16, and its advantage over compute-matched multi-start and curriculum transfers to the two-link arm (§5.2, Tables 1, 22, 24, 30).
Our face is designed to be affordable: five actuators shape its mouth, yet it has to convey human speech. We have used the humanoid robot outdoors with passers-by for over a month. This is why the distinction between feasible movements and useful training targets matters to us in practice.
The original measurements established the reachability mismatch: 86% of held-out human frames lie beyond a fitted limit (Figure 1b). The new §5.3 adds a learning comparison on real speech and an estimate of projection-order bias, which is concentrated at jaw limits (Table 34). PTF is the worst output-label order at all four widths. At the smallest width, it trails RAW by 5.5% on the first model and 7.1% after re-measuring the face (Tables 2, 37).
Across 12 utterances played twice on the robot, PTF's mean peak opening above neutral is 12% below RAW's and below CBD's in every utterance (Table 38). The capacity mechanism is established by the rank-limited analysis; the new face experiments show the learning outcome and make the effect on speech visible.
Retargeting constructs feasible demonstrations before training (Yeh et al., 2025); extrinsic regression projects an estimated conditional mean (Lin et al., 2017); differentiable projection layers incorporate feasibility into training (Grontas et al., 2026; Utkarsh et al., 2026).
Our contribution is to analyse and compare projection orders for unreachable output supervision under finite student capacity. This yields the deployment-specific capacity result, the competing projection-order bias, and controlled comparisons that separate the quality of a population target from the performance of its fitted student. CBD implements the averaging-first target, and the command-versus-output experiment identifies which product of the inverse provides the better initialization. The revised §6 states this connection directly.