- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes QuanTopo, a hybrid text-to-motion generation framework that combines a discrete motion plan with continuous motion representations. The authors identify a "target–use gap" in existing hybrid models, where discrete representations are primarily learned for reconstruction without explicitly defining what information they should preserve or how they should be used during generation. To address this, QuanTopo introduces persistent homology-based trajectory supervision, plan-only reconstruction, and an anatomical MPS decoder, while using conditional flow matching to generate continuous realization latents. The method achieves FID scores of 0.027 and 0.122 on HumanML3D and KIT-ML, respectively, and reports a Seq. score of 0.804 on a prespecified subset of 180 composite-action captions from HumanML3D. The authors provide extensive ablations and controlled experiments to support their design.
Critical strengths
S1. Extensive experimental analysis.
The paper provides trajectory-summary comparisons (Table 3), capacity-matched controls (Table S9), topology-condition interventions (Table S6), plan permutation experiments (Table S15), and frozen representation probes (Table S17). These analyses help examine the roles of the proposed components from multiple perspectives.
S2. Competitive generation performance.
QuanTopo achieves strong results on HumanML3D and KIT-ML (Table 1). It also demonstrates a statistically significant improvement in composite-action sequence satisfaction over SALAD, including improved ordering accuracy on motions where both methods cover all required events (Table 5, Appendix C.2).
Critical weaknesses
W1. The contribution of topology-conditioned planning to temporal action organization is not sufficiently isolated.
-
Table 2 shows that topology modulation improves FID and R@1, but does not report Seq. or Order|Covered, which are more directly related to the paper's central motivation. The condition interventions in Tables S6 and S14 show that replacing the predicted topology descriptor with Zero, Mean, or Mismatched conditions reduces both metrics. This supports the conclusion that the trained planner uses the predicted descriptor. However, changing the condition of a model trained to rely on it does not establish that topology modulation outperforms a model trained without modulation.
-
Furthermore, the dataset-mean condition, which performs best among the alternative conditions, is not accompanied by a paired confidence interval against the predicted condition (Seq. 0.804 vs. 0.771; Order|Covered 0.904 vs. 0.884). A direct composite-action comparison with the "w/o Topology Modulation" model in Table 2 would better establish the contribution of this component.
W2. The improvement in composite-action generation is relatively modest, and qualitative verification is limited.
-
The improvement over SALAD in Seq. is +0.022 (95% CI [+0.006, +0.039]), which is statistically significant but relatively modest, based on one generated motion per caption across 180 captions (Table 5). In addition, the user study reports a Text Alignment win rate of 52.8% against SALAD, with a confidence interval that includes 50% (Appendix C.4).
-
Moreover, no supplementary videos are provided, making it difficult to directly assess whether temporal action ordering and transitions are accurately and naturally realized. Although Figures 1, 4, and S4 provide qualitative keyframes, these are insufficient to fully evaluate the temporal characteristics of the generated motions.
Questions for authors
Q1. Contribution of topology modulation.
-
Table 2 states that "w/o Topology Modulation" and QuanTopo share the same frozen Stage-A representation. Could the authors clarify whether the topology predictor's diagram loss and the soft-plan auxiliary loss are also retained during Stage B1?
-
Could the authors also report Seq., Coverage, and Order|Covered for these two models under the same composite-action evaluation protocol?
-
Additionally, a paired comparison between the Predicted and Mean conditions in Table S14 would be helpful. Seq. could be compared across all 180 captions, while Order|Covered should be evaluated on the subset where both conditions cover all required events.
Q2. Qualitative results.
- Could the authors provide full motion videos for the examples in Figures 1, 4, and S4, and, if possible, the generated outputs used in the composite-action evaluation in Table 5? These would help assess temporal action ordering and transitions, which are central to the paper's contributions.
Q3. Clarification of the unified evaluation.
- Appendix C.1 states that baselines with a single public checkpoint were reevaluated using three independent generation streams. However, several results for MoMask and MotionHiFlow in Table S3 match the previously reported values in Table 1 to three decimal places. For MotionHiFlow on KIT-ML, even the reported confidence intervals are identical. Could the authors clarify the evaluation procedure and explain these identical values? Providing the results for individual evaluation repeats would also help verify the reported paired confidence intervals.
7 comments
Part 2: effect size and full motion videos
W2. Magnitude of the SALAD comparison. Thank you for drawing attention to the size of the improvement and the text-alignment interval. We agree that the advantage over SALAD is modest.
The absolute single-output results are:
| Method | Seq. [95% CI] | Coverage [95% CI] | Order given coverage [95% CI] |
|---|---|---|---|
| ActionPlan | .769 [.740,.795] | .844 [.803,.882] | .888 [.856,.918] |
| SALAD | .782 [.759,.804] | .856 [.806,.894] | .886 [.855,.915] |
| QuanTopo | .804 [.783,.825] | .872 [.824,.911] | .904 [.875,.930] |
QuanTopo has higher completion and conditional-order point estimates, with paired intervals that include zero.
Seq. averages the fraction of satisfied precedence edges per caption. Coverage requires every requested event to appear, and conditional order evaluates the fully covered outputs. The failure decomposition in revised Table 6 and Table S18 helps explain the aggregate Seq. difference:
| Method | Missing | Overlap | Reversed |
|---|---|---|---|
| SALAD | .120 | .025 | .073 |
| QuanTopo | .112 | .028 | .056 |
These are required-edge fractions averaged over captions. The difference combines fewer missing endpoints and reversals with slightly more overlap. This locates the observed benefit in completion and event progression; the matched retraining comparison in Q1 tests the contribution of modulation under shared supervision.
Our user study uses 60 captions and 30 valid participants. For each video pair, participants judge text alignment and motion realism, with a no-preference option. The decisive win rate is W/(W+L), excluding ties from its denominator; the intervals use participant/caption cluster bootstrap. Against SALAD, the results are:
| Criterion | QuanTopo win rate [95% CI] |
|---|---|
| Text alignment | 52.8% [47.3,58.2] |
| Motion realism | 60.7% [55.5,65.8] |
The text-alignment interval includes 50%, while the motion-realism interval is above 50%. The clearer perceptual benefit is therefore motion naturalness, with text alignment close to SALAD. The event comparison also favors QuanTopo in completion and ordering point estimates.
The matched training control in Q1 provides the more direct evidence for the role of geometric modulation. Retaining the representation, auxiliary supervision and training budget while removing modulation lowers both event coverage and conditional order. This connects the component to the intended mechanism: the geometric condition helps the planner realize a complete multi-stage motion, while language and ordered tokens specify its semantic progression.
Q2. Full motion videos. Thank you for emphasizing the need to inspect action progression and transitions in the full sequences. The anonymous materials page provides the full videos; Figures S5–S8 add rendered keyframes to show action progression and coordination. We invite you to view the full clips to assess the action progression and transitions. 01_figure_videos/figure_examples contains the 32 clips for the eight captions in Figures 1, 4 and S4, with four methods per caption. 01_figure_videos/composite180_quantopo contains the 180 QuanTopo composite-motion examples. Caption lists are included, so examples can be matched to the figure descriptions and roster. 02_composite180 additionally provides the five-method comparison videos and associated event records, organized by caption.
Part 3: reevaluation and corrected Table S3
Q3. Why S3 entries matched Table 1. Thank you for checking the consistency between Tables 1 and S3 so carefully. We apologize for the error and the confusion it caused; we should have checked the assembled table more carefully. When assembling Table S3, we mistakenly entered published values in cells intended for our reevaluation results. The corrected baseline results, including SALAD, are shown below as mean±sample SD across three repeats:
| Dataset / method | FID | R@1 | Matching distance |
|---|---|---|---|
| HumanML3D / MoMask | 0.059±0.003 | 0.523±0.003 | 2.945±0.012 |
| HumanML3D / MotionHiFlow | 0.038±0.002 | 0.563±0.004 | 2.705±0.015 |
| HumanML3D / SALAD | 0.071±0.006 | 0.587±0.007 | 2.649±0.020 |
| KIT-ML / MotionHiFlow | 0.154±0.015 | 0.482±0.011 | 2.538±0.017 |
Reevaluation protocol. Within a repeat, all methods use the same record list, requested ground-truth lengths, motion evaluator and retrieval candidates. Each baseline uses its fixed public checkpoint with three independently seeded generation streams. The HumanML3D repeats each contain 4,640 records; the KIT-ML repeats each contain 704. The input lists retain the sampling and crop choices for each repeat. These shared conditions give the methods a common evaluation setting.
For a fixed-checkpoint baseline, differences between repeats reflect generation and evaluation-stream variability. The standard deviation therefore describes variation across these three repeated evaluations. FID compares generated and reference motion-embedding distributions; R@1 measures rank-1 text-to-motion retrieval; matching distance averages paired text–motion embedding distances.
Individual repeats. The scores for all three HumanML3D baselines and MotionHiFlow on KIT-ML are:
| Dataset / method | Repeat | FID | R@1 | Matching distance |
|---|---|---|---|---|
| HumanML3D / MoMask | 1 | 0.062443 | 0.525647 | 2.945664 |
| HumanML3D / MoMask | 2 | 0.056719 | 0.519828 | 2.933410 |
| HumanML3D / MoMask | 3 | 0.059135 | 0.523922 | 2.957130 |
| HumanML3D / MotionHiFlow | 1 | 0.038320 | 0.558405 | 2.721844 |
| HumanML3D / MotionHiFlow | 2 | 0.040941 | 0.562716 | 2.698353 |
| HumanML3D / MotionHiFlow | 3 | 0.035964 | 0.567026 | 2.695044 |
| HumanML3D / SALAD | 1 | 0.077890 | 0.578879 | 2.670606 |
| HumanML3D / SALAD | 2 | 0.066987 | 0.593103 | 2.631299 |
| HumanML3D / SALAD | 3 | 0.067509 | 0.587931 | 2.646237 |
| KIT-ML / MotionHiFlow | 1 | 0.157546 | 0.480114 | 2.518497 |
| KIT-ML / MotionHiFlow | 2 | 0.167593 | 0.494318 | 2.547204 |
| KIT-ML / MotionHiFlow | 3 | 0.137400 | 0.471591 | 2.548428 |
Statistical records and materials. The bootstrap scripts resample generation streams at the outer level and source-motion groups within each selected stream, using shared draws across the available baseline methods. Captions from the same source motion remain grouped. FID is recomputed from the resampled embedding distributions; retrieval hits and matching distances are aggregated from their per-record scores. The reported percentile intervals use 10,000 bootstrap replicates.
The anonymous materials page links to S3_baselines.zip. Under 03_baseline_evaluation, runs/ contains the three repeats of MoMask, MotionHiFlow and SALAD on HumanML3D, plus MotionHiFlow on KIT-ML. Each repeat includes metric summaries, per-record evaluations, motion embeddings and a generation manifest. fixed_records/ and shared_embeddings/ contain the common evaluation inputs, while results/ and statistics/ contain the aggregates and bootstrap outputs and scripts.
We appreciate the time and care you have devoted to reviewing our work. Your comments helped us clarify the modulation controls, provide fuller qualitative evidence and correct the reevaluation report. We would be glad to answer any further questions.
Part 1: topology-modulation contribution
Thank you for recognizing the experimental analysis and for asking us to isolate the contribution of topology modulation. The inference-time interventions alone left this question open. We have added a retrained control that retains the auxiliary losses and uses the same training budget. We have uploaded the revised manuscript, with the corresponding experimental additions and clarifications highlighted in blue.
Q1. What is retained in the retrained control? Within each training seed, the variants share the same frozen Stage-A encoders, codebook and decoder. Without Topology Modulation retains the diagram predictor loss (λ_z=1) and soft-plan auxiliary (λ_s=0.1/d_z, d_z=128) during Stage B1. Only the descriptor-to-logit pathway is removed: the planner uses language-only logits. The planner and realization model are trained under the ablated setting, with the same Stage-B2 budget.
The predictor loss trains the text-and-length topology head. The soft-plan auxiliary applies the plan readout to expected token embeddings, aligning the planner's distribution with the trajectory target. Keeping these losses in the control separates their supervision from the geometric logit-conditioning path. The constant-descriptor control also retains the modulation parameters and shared auxiliary losses, but supplies a caption-independent descriptor.
Training results. Your question calls for models that learn under each condition. We added retrained no-modulation and constant-descriptor controls in main-text Table 3. The same 180-caption task is evaluated for each of three checkpoints. The paired bootstrap resamples training checkpoints at the outer level and source-motion groups within checkpoints at the inner level, using identical draws for both variants. Values are mean±SD, with paired intervals for full minus variant:
Compared with the no-modulation model, the predicted condition raises Seq. by .036, Coverage by .028 and conditional order by .021. Compared with the constant condition, the differences are .032, .022 and .019. Thus the training comparison addresses both completion and ordering, and the capacity control distinguishes caption-specific conditioning from simply retaining extra modulation parameters.
For clarity, Coverage is the fraction of outputs containing all required events. Seq. first measures the fraction of satisfied required DAG edges for each caption, then averages captions. An A→B edge is satisfied only when both events occur and A ends no later than B begins. Order given coverage averages these scores over fully covered outputs. Missing endpoints therefore reduce Seq. even when the surviving events are in order.
Paired Predicted–Mean and other interventions. To assess whether caption-specific geometry helps beyond the mean descriptor, Table S22 adds the requested paired comparison. Here one checkpoint is held fixed. The planner's geometric correction is a shared response difference, ρ(a,z/scale)−ρ(a,0), added to base language logits with scaling and clipping. Here a is the AR state from text, supplied length and token prefix; ρ is the shared modulator and scale normalizes descriptor coordinates. With z=0, the correction is exactly zero. Mean uses a common training-mean descriptor; Predicted uses text and supplied duration; Mismatched uses a donor reference descriptor; Reference is an oracle diagnostic.
AR random streams and Gaussian initial states are shared across conditions. Seq. uses all 180 captions, while paired conditional order uses only the jointly covered subset:
The Predicted–Mean comparison favors the predicted descriptor in both Seq. and conditional order. Reference–Predicted measures the remaining gap under oracle geometry.
The retrained control tests whether geometric modulation improves a model that can adapt throughout training. The fixed-weight interventions test how a trained planner responds to its descriptor.
Both comparisons favor text-specific geometric conditioning: the retrained variants test its benefit during learning, and the Predicted–Mean intervention tests its benefit over a caption-independent descriptor within one trained model.