- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
The paper introduces a pipeline for reconstructing the 3D geometry and motion of interacting objects from multiview videos. The method combines 4D Gaussian reconstruction with differentiable physics to estimate material and contact parameters. The authors also introduce a new dataset to evaluate their approach.
Critical strengths
The paper addresses a challenging problem using modern reconstruction and simulation techniques. The introduction of a real-world multiview collision dataset is also a potentially valuable contribution.
Critical weaknesses
- Limited novelty and unclear benefits of the proposed pipeline. The method is relatively complex and primarily combines existing techniques, notably 4D Gaussian reconstruction and differentiable physics. The authors do not convincingly demonstrate the novelty or benefits of this combination compared with simpler approaches. In particular, reconstruction and physical parameter estimation are performed sequentially rather than jointly optimized in an end-to-end differentiable framework. The experiments do not clearly establish what the additional complexity contributes.
- Limited generality. The experiments focus on interactions between two objects with prescribed, spatially homogeneous material models. It is unclear how the approach would extend to more complex scenarios involving multiple interacting bodies or heterogeneous materials, such as objects containing cavities or multiple materials. These limitations are particularly relevant when considering the applicability of the proposed reconstruction framework.
- Insufficient dataset description. The presentation of the Contact4D dataset is underwhelming. I consider the dataset potentially one of the paper’s main contributions, yet it receives very little attention. Important details about its size, diversity, material properties, and evaluation protocol are insufficiently discussed. A more comprehensive description and characterization would significantly strengthen the paper.
- Lack of physical parameter validation. The evaluation focuses primarily on reconstruction quality rather than the accuracy of the estimated physical parameters. Why not perform independent material characterization experiments and compare the recovered Young’s modulus, Poisson’s ratio, or other material parameters against measured values? Reproducing an observed trajectory does not necessarily imply that the inferred material parameters are physically accurate.
Questions for authors
Please address the concerns raised in the weaknesses, particularly the novelty and benefits of the proposed pipeline, the generality of the method, the dataset characterization, and the lack of validation against independently measured material properties.