- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper introduces PIM, a model that directly predicts the equilibrium meshes of interacting objects from their initial geometry, kinematics, and physical attributes, without generating intermediate trajectories. Its architecture combines local KNN attention for intra-object geometry, anchor-based cross-object attention for interactions, and a dual-branch decoder that separates object translation from per-vertex residual displacement. Experiments on four controlled MuJoCo scenarios involving rigid and deformable objects show lower terminal-state prediction errors than the evaluated baselines and reduced inference latency compared with autoregressive models and simulator rollouts under the reported protocols.
Critical strengths
Predicting the final configuration directly is a well-motivated problem when intermediate trajectories are not needed. The vertex-level output provides a common representation for rigid motion and local deformation, rather than restricting every object to a rigid pose. This gives the method a useful role as a terminal-state predictor, without requiring it to replace a full dynamics simulator.
The accuracy improvements are consistent across the four evaluated scenarios. PIM also outperforms the force-conditioned rollout baselines in the controlled Flat experiment, and Small-PIM retains much of this advantage at a substantially reduced parameter count. These results suggest that the approach has practical merit within the studied settings. I also appreciate the inclusion of physical-validity diagnostics rather than relying only on vertex error.
Critical weaknesses
My main concern is the gap between predicting a nearby terminal mesh and predicting a valid equilibrium state. On Flat, only 10.90% of scenes satisfy the paper’s inter-object non-penetration criterion, and contact F1 is 13.16% (Table 2). Table 14 reports an average per-scene maximum penetration of 13.967 mm, suggesting that the failures are not merely borderline cases around the 1 mm threshold. The non-penetration extension helps, but even its strongest setting reaches only 53.60% penetration-free scenes, while contact F1 falls to 11.11%. Moreover, the validity evaluation excludes the supporting plane and does not assess force balance or frictional feasibility. The authors acknowledge these limitations, but they remain consequential: lower vertex error alone does not establish that the predicted configuration is a usable approximation to static equilibrium.
I am also not convinced that the experiments establish a sufficiently substantial methodological contribution. Local attention, cross-object communication, and centroid–residual decoding form a sensible design, but the ablations mainly show that objects need to exchange information. Removing cross-object attention does not establish that the proposed FPS-anchor mechanism is better than another reasonable interaction module. The decoder ablation is more informative, although its effect is small on Bumpy and Deformable and is reported from single runs. The full-dataset comparisons use two direct predictors developed for this study, while the published rollout methods are evaluated only on controlled Flat. The direct baselines are not matched to PIM in architecture capacity or training schedule, and their inference times are absent from the runtime table. This makes it difficult to separate the benefit of PIM’s particular design from the benefit of predicting only the terminal state. The restricted evaluation—separate scenario-specific models, fixed object correspondences and mesh topologies—also provides limited evidence that the contribution extends beyond these settings.
Questions for authors
Regarding the equilibrium claim, is there evidence that predicted configurations remain approximately stationary when used to initialize the simulator? Support-plane penetration and displacement during a short settling rollout would help determine whether low geometric error corresponds to a physically usable state. This is a request for evidence supporting the current claim, rather than a suggestion to model full trajectories.
Can the authors provide a comparison with a direct terminal-state predictor matched more closely in capacity, inputs, losses, and training schedule, reporting both accuracy and latency? Replacing the FPS-anchor interaction with another cross-object mechanism under the same setup would be particularly informative. This would directly affect my assessment of how much the proposed architecture contributes beyond the terminal-prediction formulation.
For the shape-OOD experiment, can the authors report quantitative errors separately for the replaced cube? Only one object changes, and it retains the original vertex count and topology, whereas the reported vertex metric averages over the entire scene. Object-specific results would make it easier to assess the demonstrated shape transfer.