- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents GenTrack, an online post-training framework that jointly adapts a text-conditioned, robot-native motion generator and a humanoid motion tracker. Generated references augment public motion data for tracker training, while execution feedback from a lagged tracker supplies rewards that update the generator through FlowGRPO. KL regularization, supervised rehearsal, and distillation limit how far the generator’s motion distribution can shift.
The framework is evaluated in simulated Unitree G1 environments using ProtoMotions and SONIC backbones. Experiments measure tracking on three fixed held-out motion splits, and generation quality using a frozen SONIC executor and a G1-specific text-motion evaluator. Comparisons include reference-only continuation, frozen-generator replay, final-generator replay, generator-only updates, and alternative objectives. Results are most favorable for the SONIC backbone, whereas the ProtoMotions backbone shows trade-offs between generator quality and tracker coverage.
Critical strengths
The evaluation separates generator improvements from tracker improvements and includes meaningful controls. Tracker evaluation uses fixed held-out references, so apparent tracking gains cannot arise solely from the generator producing easier test motions. Generator variants are evaluated with the same frozen executor, prompts, noise, and motion lengths. Within each backbone, tracker comparisons are matched on initialization and environment-transition budgets. Results are reported over five independent online training runs with confidence intervals, and trajectory-error metrics include failures. These choices make the comparisons substantially more informative than evaluating only the final generator-tracker pair.
The SONIC results and retention ablations provide concrete evidence of useful improvements. Under frozen-SONIC evaluation, the SONIC-based GenTrack generator reduces key-body error from 0.410 m to 0.325 m while maintaining retrieval performance and diversity. The tracker also lowers position errors relative to frozen- replay. Table 7 further shows that removing the retention mechanisms can improve execution metrics while degrading retrieval, FID, and diversity. This illustrates the trade-off between executability and content preservation and supports including distribution-preserving objectives.
Critical weaknesses
The benefit of mutual adaptation is inconsistent. In Table 6, generator-only training outperforms the full ProtoMotions loop on several generation metrics. For SONIC, Wild-G1 tracking success is 48.0%, barely above the 47.8% obtained with final-generator replay. A matched sequential baseline (generator refinement followed by tracker training) would better establish the value of online coupling.
Reliance on private data limits reproducibility. Wild-G1-clean supplies approximately 85% of the motions underlying the aggregate tracking errors, but its source and evaluation trajectories are unavailable. Although the evaluator code and weights are provided, the missing evaluation inputs and limited documentation of data curation and deduplication prevent independent verification of the central results.
Questions for authors
Mutual adaptation: Could you compare GenTrack with a sequential control that first refines the generator against a frozen tracker and then post-trains the tracker on the resulting references, with matched generation, scoring, and tracker-training budgets? Please also report confidence intervals for the differences between the two configurations.
Data and reproducibility: Could you provide anonymized provenance, action and duration statistics, curation thresholds, and the duplicate and near-duplicate detection procedure for the internal corpus and Wild-G1-clean? Is there an access mechanism or a set of evaluation inputs that could be released so the private-set results can be reproduced?