- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper studies shared latent spaces in motion VAEs. It finds shared backbones or priors cannot guarantee directly‑compatible latent codes. Unpaired methods enable post‑hoc recoverable matching but poor direct alignment. A small number of paired motion clips greatly improves direct compatibility, yet cross‑decoder reuse still remains imperfect. It stresses evaluating actual functions instead of just shared model structures.
Critical strengths
-
The paper untangles mixed definitions of shared latent space common in multi‑schema representation research. It draws distinct boundaries between four concepts: direct compatibility, recoverable correspondence, marginal similarity and decoder reuse. This framework fixes loose, unexamined assumptions and gives structured evaluation guidelines for future motion representation work. (86 words)
-
It uses modified HumanML3D motion datasets and a suite of diagnostic metrics including Procrustes, CCA, retrieval and decoder‑reuse tests. Experiments prove shared VAE backbone or prior cannot guarantee interoperable latents. Controlled conditions separate schema variations, producing trustworthy results for cross‑skeleton motion model developers. (84 words)
Critical weaknesses
-
All experiments rely on synthetic HumanML3D variants with ground‑truth data alignments. Real‑world motion data is noisy, unaligned and comes from different capture sources. Key results are valid mainly for the Rotations setting, while fully disjoint feature schemas require complete paired supervision. It remains unclear whether these findings translate to real‑world use cases and reduces the paper’s overall impact.
-
The paper treats decoder reuse as an important independent property but only tests one‑way B‑to‑A decoding. It does not investigate root causes behind stable cross‑decoder performance gaps, even when latents are well‑aligned. No mitigation strategies are validated. Since cross‑schema transfer hinges on decoder interoperability, a vital practical problem stays unresolved.
Questions for authors
-
Your strong direct‑compatibility result with few paired samples is shown only for the Rotations schema pair. Please explain which structural or feature‑overlap properties let Rotations work well under limited‑pair supervision. Also outline what obstacles stop this low‑pair effect from appearing for the Disjoint schema setting.
-
You see a steady B→A cross‑decoder performance gap for Anchor‑64, despite strong agreement across latent tokens. Within your controlled test environment, do you have experimental evidence to tell whether this gap comes from schema‑driven decoder bias, latent‑space manifold mismatch, or other identifiable sources?
-
Your calibration‑budget analysis shows flexible CCA delivers good retrieval results even for random encoders when plenty of paired data exists. For real‑world evaluation without ground‑truth correspondences, how should practitioners separate true learned cross‑schema structure from side‑effects caused by strong post‑hoc calibration?