- Rating
- 3(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes Parametric Trajectory Distillation (PTD), which represents student trajectories using a displacement prediction and polynomial shape coefficients. Training matches velocities along the predicted trajectory to teacher velocities, while inference uses only the displacement prediction. The paper evaluates the method on Wan2.1-14B against PDD and on MiniMax-H3 against LightX2V Turbo.
Critical strengths
The parameterization enables inexpensive intermediate trajectory supervision without network Jacobian-vector products. The H3 results show promising improvements in diversity and naturalness while maintaining comparable visual quality. Establishing this advantage over DMD across broader settings would be a highly valuable contribution.
Critical weaknesses
-
The controlled trajectory-distillation comparison relies primarily on PDD, another ICLR 2027 submission still under review. Direct comparisons with established alternatives, including LMD and MeanFlow-based distillation, are missing. The multi-step Euler endpoint-supervision baseline is evaluated only through limited qualitative examples, leaving the practical advantage over simpler approaches unclear.
-
The paper does not sufficiently explain or validate why retaining trajectory constraints produces a better quality–diversity trade-off than distribution matching. The DMD comparison is limited to one released checkpoint on H3, whose PTD recipe also includes final-hop teacher integration. Broader controlled experiments are needed to establish the claimed advantage.
Questions for authors
-
How does PTD compare quantitatively with multi-step Euler endpoint regression, LMD, and MeanFlow-based distillation under comparable training and inference budgets?
-
What evidence shows that the gains over DMD persist across backbones and training settings, and arise from the proposed trajectory supervision?
3 comments
Reply to Reviewer rUYt (2/2)
W2 / Q2: DMD across backbones; final-hop integration. (Same protocol as in part 1/2; Δ = PTD − other.)
Second backbone. Against LightX2V's released four-step Wan2.1-T2V-14B DMD student, PTD@64 repeats the H3 pattern (first row of the next table): static and dynamic quality on par, naturalness and diversity higher (videos). VBench does not separate the two on Wan (PTD 82.92 to 84.57 across checkpoints); seed diversity confirms the gap.
| Wan2.1-14B (* significant) | dynamic | static | naturalness | diversity | VBench | seed div. (V-JEPA 2) |
|---|---|---|---|---|---|---|
| PTD@64 − LightX2V 4-step DMD student | +.11 | −.07 | +.40* | +.83* | 84.57 vs. 83.97 | .122 vs. .078 |
Final-hop integration and the adapter budget. On H3 we retrained PTD without the final-hop march (two teacher queries on every hop) and with one shared rank-128 LoRA for all steps (Turbo's adapter budget), otherwise with the paper's recipe:
| MiniMax-H3, Δ vs. LightX2V Turbo v1.1 (* significant) | dynamic | static | naturalness | diversity |
|---|---|---|---|---|
| Paper model (re-judged with the new rows) | +.11 | −.02 | +.14* | +1.30* |
| No final march (2 queries on all hops) | −.39* | −.45* | −.61* | +1.36* |
| One shared rank-128 LoRA (Turbo's budget) | +.04 | −.08* | +.09* | +1.50* |
The final-hop march supplies the last hop's fine detail (Sec. 3.2): without it PTD falls .56, .50 and .83 below its own paper model on dynamic quality, static quality and naturalness, while diversity stays the same (+.06), so the march is not the source of PTD's diversity. With Turbo's adapter budget, PTD stays more natural and far more diverse than Turbo.
Why trajectory supervision keeps diversity. Regressing the teacher velocity along the student's own path with a single-time network keeps seed diversity on both backbones (PTD − DMD: +1.30 on H3, +.83 on Wan), consistent with per-noise teacher supervision preserving the teacher's noise-to-sample coupling; reverse-KL distribution matching is mode-seeking. The two-time LMD map, trained on the same kind of trajectories, loses that diversity (PTD − LMD: +.86), which points to PTD's single-time deployed map, with its target time confined to the training-only head, as the responsible design choice. The revision states this mechanism with the LMD control.
Thank you for the detailed responses and additional experiments. The comparisons with established baselines, the additional DMD comparison on Wan2.1-14B, and the ablations on final-hop integration and shared LoRA address my concerns. Based on the rebuttal, I will raise my score from 2 to 3.
Reply to Reviewer rUYt (1/2)
Thank you for the careful review and the concrete questions. Every comparison in our two replies uses the paper's recipes and judging protocol (Sec. 4.1, App. C: four Astra axes on 100 prompts × 3 seeds); Δ = PTD − other, so a positive value favors PTD.
W1 / Q1: established alternatives at comparable budgets. PTD beats every alternative we trained with its recipe on every quality axis except LMD's naturalness, and it is the only one that keeps the seed diversity. The paper reproduces PDD, the strongest trajectory-only method reported on Wan2.1-14B, under PTD's exact setting. We add three more on Wan2.1-14B, each trained with PTD's data, updates, batch, teacher and 4-NFE inference and changing only the training target or the map (videos):