- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
PhysLDM proposes a latent-diffusion paradigm for one-shot prediction of high-fidelity volumetric deformable trajectories. It introduces a holistic spatiotemporal VAE (ST-VAE) that decouples rigid motion from local deformation and removes the “staircase” artifact of standard temporal compression. A flow-matching DiT then predicts the full 64-frame latent trajectory in one pass, conditioned on the initial state. The paper also provides a systematic comparison between deterministic regression and generative diffusion under chaotic deformable dynamics, demonstrates zero-shot generalization to OOD datasets, and showcases differentiable applications including material estimation and second-order throw design.
Critical strengths
1.Strong technical contribution. The ST-VAE is well motivated: holistic temporal compression with explicit rigid/deformation decoupling is a clean solution to a real artifact in video-VAE-style compression. The reported 78× token compression with ~2.48 mm reconstruction error is impressive.
2.Insightful chaos analysis. The paper convincingly shows that GPU IPC solvers are not bit-reproducible and that chaotic deformable dynamics amplify tiny perturbations into macroscopically different outcomes. This explains why deterministic regression collapses to damped averages and why diffusion is better suited. The analysis in Appendix D is thorough and scientifically valuable.
3.Convincing empirical results. PhysLDM outperforms a capacity-matched regression model and an MGN-style AR baseline across Objaverse, GSO, and Toys4K on physics-consistency metrics and world-space error. Zero-shot ST-VAE generalization to OOD datasets and meshes beyond the training cap is solid.
Critical weaknesses
1.Main experiments are single-body. The main tables use n=1. Multi-body scenes are relegated to Appendix J and are only qualitatively shown. Real deformable simulation often involves multiple interacting objects, so this limits the immediate impact.
2.Real captured data requires fine-tuning. Zero-shot LDM prediction on real point clouds fails badly (875 mm error). The ST-VAE transfers zero-shot, but the full pipeline does not. The paper is honest about this, but it weakens the “zero-shot generalization” claim for real-world use.
3.Concurrent-work comparison is at low resolution. The comparison with Chen et al. (2026) is performed at ≤1,000 vertices because the concurrent model OOMs above that. This is fair given the memory constraint, but it does not establish superiority at native high resolution.
4.No direct comparison to the IPC solver. The training data come from StiffGIPC, but inference is compared only to neural baselines. A direct accuracy-vs-speed comparison against the ground-truth solver would strengthen the practical case.
Questions for authors
Please see weakness