- Rating
- 4
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper presents CEPHEID, a unified framework for sparse-to-dense motion completion across different geometry families. The key idea is to decouple residual motion structure from physical scale, combining harmonic extension with a dimensionless learned residual prior and target-independent amplitude recovery. The method generalizes to unseen geometry families without requiring skeletons, registration, or cross-mesh correspondence.
Critical strengths
The problem setting is interesting and practically relevant, especially for cross-family motion completion without skeletons or predefined correspondences.
The motivation for scale decoupling is clear and supported by empirical observations.
The method shows consistent improvements over harmonic extension, including on unseen cloth and legged robot families.
The ablation studies reasonably support the importance of the main components.
Critical weaknesses
The methodological novelty is somewhat incremental, as the framework mainly combines harmonic extension, residual learning, scale normalization, and flow matching.
The baseline coverage for cross-family generalization is relatively limited.
The real-world demonstrations are mostly qualitative.
The quantitative evaluation assumes relatively clean vertex displacement observations, so robustness to realistic tracking noise is not fully demonstrated.
Questions for authors
How does the proposed amplitude recovery compare with simpler per-instance normalization strategies?
Can the authors include comparisons with more recent cross-topology or category-agnostic deformation methods?
How robust is CEPHEID to noisy, missing, or drifting point trajectories in real-world settings?
3 comments
Thanks for the detailed response. I found the paper very interesting. But I’m less familiar with this area, so I’m curious about one possible application. If I use a video generator like MiniMax to animate a rigged character, could CEPHEID help recover motion on the character’s original rig from the generated video? If so, could this be a route to text-to-motion generation for characters with arbitrary rigs?
Thank you, we are glad you found the paper interesting. Yes, CEPHEID pairs naturally with video generators such as MiniMax, because it does not require a rig. Rigging is a separate step that still relies heavily on expert work, and automatic rigging of arbitrary shapes is an active research problem; CEPHEID skips it. It completes the motion of every vertex from sparse vertex displacements, using only the mesh connectivity. In the paper, one model handles rigged characters (DT4D animals, AMASS bodies, the Franka arm) and unrigged objects (cloth, unseen in training, and the DAVIS horse from real video, Section 6).
Sparse points obtained from the generated video, for example with a point tracker, are completed into dense motion, which can then be fitted to a rig if one exists. The updated supplementary shows two unrigged characters animated from generated videos, each with about twenty sparse points: an octopus (octopus_generated_video/) and an elephant whose trunk has no bones (elephant_generated_video/). We see this as a promising route to text-to-motion for arbitrary characters.
Novelty (W1). Our contribution is a problem and a diagnosis of why learned priors fail on it: completing dense motion from sparse, unlabeled vertex displacements across geometry families, without a skeleton, registration or correspondence. Reviewer 98K5 finds the "problem formulation and motivations are clear", and Reviewer 5qQe that "the problem is useful". In this setting a prior trained on one family transfers poorly, with 7 of the 12 off-diagonal specialist cells in Table 2 at or above harmonic extension, because the residual's amplitude spans 18–39× across families at matched density and depends on the unknown target. As the reviewer notes, "the motivation for scale decoupling is clear and supported by empirical observations". Separating amplitude from the learned structure lets one model trained on DT4D, AMASS and Franka fall below harmonic extension in pooled error in all five columns, including cloth and legged robots that training never saw. The ablation in §5.4 shows that this separation carries the result: without amplitude recovery, transfer turns negative on Franka (0.020 → 0.209, harmonic 0.101) and legged robots (0.223 → 0.409, harmonic 0.247). Harmonic extension, residual learning and flow matching are known components; what is new is identifying amplitude as the obstacle to cross-family transfer and removing it.
Per-instance normalization (Q1). Table 3's "Raw observed scale" row, now a curve in Figure R1, is exactly per-instance normalization by an input statistic: ŝ = σ_obs, as in RevIN-style methods. On cloth it is above harmonic extension at every density. Amplitude recovery is within 1.4–8.1% of the target-informed oracle, which uses the ground-truth target and serves only as a reference. The needed scale is the residual's own dispersion, s = std(F − H), and s/σ_obs is not constant. At the sparsest density, s spans 37.5× across the training sources and s/σ_obs still spans 3.2× (Appendix C.1). We also measured this on the training streams (12,000 conditions). Dividing the residual by σ_obs leaves a 3.1–5.9× spread across sources at each density, and 104× over all source × density cells. With amplitude recovery the spread is 1.1–2.3× per density and 4.1× overall. The raw residual spreads 429×. We also retrained the full model with ŝ = σ_obs, with the same data, backbone and steps, and scored both models on the same conditions (50 pairs per family; all Table 3 conditions on cloth). This experiment is reported here, not in the revised PDF. Ratios are the retrained model's error divided by CEPHEID's, so values above 1 favour CEPHEID. The retrained model is 4.4% worse on held-out cloth (1.044 [1.022, 1.080]) and ties on held-out legged robots (0.988 [0.927, 1.044]). On the training families it is 6.6% worse on AMASS and 15.7% worse on Franka, and 7.1% better on DT4D. Retraining with per-instance normalization therefore does not improve transfer to the unseen families, which is the setting amplitude recovery is designed for: it is worse on cloth and level on legged robots.
More baselines and recent cross-topology methods (W2/Q2). See GC1.
Real-world demonstrations mostly qualitative (W3). See GC3 (DAVIS horse against held-out tracks, Dynamic FAUST scans) and GC2 (TAPIP3D tracker errors). On the DAVIS horse, CEPHEID is at 4.5 px against 8.7 px for harmonic extension on 51 held-out tracks, and on Dynamic FAUST it is 50.4% below harmonic extension.
Noisy, missing or drifting trajectories (W4/Q3). GC2 covers all three: tracker errors that include drift accumulated from frame 0, dropout up to 50%, persistent spatially correlated offsets, identity switches and correlated noise. With TAPIP3D tracks, CEPHEID is 28–30% below harmonic extension on three of four clips and ties on the fourth, and it stays below in all five columns with up to 50% dropout.