- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes RATIO, a token-based global operator for learned deformable solid simulation with contact. Specifically, nodes, mesh edges, and contact edges are pooled into separate groups of slice tokens, which interact through joint attention and are then redistributed back to nodes and edges. RATIO can be used standalone or fused with a local graph module such as MGN. Results on Cavity Grasping and Tissue Manipulation show the lowest rollout error among ten baselines, with comparable inference cost and parameter count.
Critical strengths
The idea of bringing contact relations directly into global token interaction is simple and meaningful. The baselines are comprehensive, covering local, global, and hybrid methods at comparable parameter counts. The gains are clear: standalone RATIO already beats the strongest baseline MGN-T, and RATIO+MGN reduces its error by 40% on both datasets, with similar inference time. The local-global combination study is also informative.
Critical weaknesses
- Part of the fused gain seems to come from the fusion framework itself. For example, LSM+MGN (3.89) already beats MGN-T (4.41) on CG. It would be good to state this more clearly. RATIO’s advantage over other global operators within the same framework is convincing on TM but smaller on CG.
- The evaluation is limited to two small benchmarks with rigid-deformable contact only. Larger meshes, which would test the claimed scalability, and deformable-deformable or self-contact would make the paper stronger.
Minor:
- When citing MPM in the intro, it’d be more appropriate to also cite the original MPM work by Sulsky et al. [1994] (A particle method for history-dependent materials), rather than only GIMP.
- In the 2nd paragraph of the intro, the paper attributes far-reaching deformation within one step mainly to large time steps. Another probably bigger factor is material stiffness: stiff materials propagate deformation quickly across the body. This could be mentioned.
Questions for authors
- Training is notably slower (eg. 112 vs 67 ms per step for RATIO+MGN vs MGN-T). How does total training time compare?
- Since this is a contact problem, have you checked penetration between the gripper and the body during rollouts, in addition to position RMSE?
4 comments
Response 2
Part of the gain appears to come from the fusion framework itself; RATIO’s advantage over other global operators is more convincing on TM than on CG.
Thank you for this thoughtful observation. We agree that the additional gains from fusion should be distinguished from the contribution of the RATIO operator itself.
The main contribution of this paper is a relation-aware global operator that incorporates mesh connectivity and potential point-pair contact directly into global computation. RATIO compresses node states, mesh relations, and contact relations into separate token sets, jointly updates them through global attention, and redistributes the resulting information to node and edge states. Local structural and contact information therefore participates in global interactions within RATIO itself, without requiring an additional local message-passing module. Standalone RATIO already outperforms all evaluated baselines in the revised main comparison on CG and TM (Section 4.2, Table 1), as well as all three baselines on DP and RG (Appendix G, Table 8), demonstrating the effectiveness of the operator on its own.
As described in Section 3.4 (Figure 4), the optional fusion framework couples RATIO with a local graph operator. This explores a design dimension orthogonal to RATIO’s internal relation-aware structure, allowing us to investigate how additional local propagation can further improve RATIO-based models. We regard this coupling as a useful practical strategy and agree that fusion itself can contribute substantial gains.
The fusion results in Section 4.2 (Table 2) illustrate both the potential of local–global coupling and its dependence on the operator pairing and dataset. These original single-run results are distinct from the three-run means now reported in Table 1. Within the same fusion framework using MGN, RATIO achieves errors of 2.51 on CG and 5.45 on TM, compared with 3.89 and 9.07 for LSM, respectively. Adding MGN improves standalone RATIO on CG, TM, and RG, but increases its error from 13.99 to 16.75 on DP. Adding GATv2 also increases RATIO’s error, from 4.10 to 8.37 on CG and from 7.31 to 8.39 on TM. RATIO’s advantage over other global operators is more consistent on TM, while LSM performs better with GATv2 on CG. As discussed in Section 5 (Conclusion and Limitations), when and why local and global operators complement each other remains insufficiently understood, and these mixed outcomes motivate further investigation of operator compatibility and coupling design.
Overall, the central contribution of this paper is RATIO, whose standalone performance already surpasses the evaluated baselines. Fusion offers a promising direction for extending its capabilities, while a systematic explanation of when and why such coupling is effective remains a topic for future research beyond the main focus of this paper.
Response 3
The Introduction should also cite the original MPM work by Sulsky et al. (1994), rather than only GIMP.
Thank you for suggesting this valuable reference. We have added Sulsky et al. (1994) to the MPM discussion in Section 1 of the revised manuscript.
The explanation of far-reaching deformation within one step should also acknowledge material stiffness, rather than mainly attributing it to large time steps.
Thank you for this helpful comment. We agree that material stiffness plays an important role in how rapidly mechanical disturbances propagate through a body. Our reference to “relatively large time intervals” was intended as a comparison with the small integration steps required by explicit solvers. For example, a commonly used estimate of the critical time step in explicit finite element analysis is [3]
\qquad c_d=\sqrt{\frac{E(1-\nu)}{\rho(1+\nu)(1-2\nu)}},$$ where $\ell_e$ is the characteristic element length and $c_{d,e}$ is the dilatational wave speed in element $e$. The wave-speed expression above applies to an isotropic, linear-elastic material, with Young’s modulus $E$, Poisson’s ratio $\nu$, and density $\rho$. At fixed density and Poisson’s ratio, **higher stiffness increases the wave speed and reduces the stable explicit time step** [3]. We have revised Section 1 to clarify the role of material stiffness, density, and mesh resolution in the stable time-step limits of explicit solvers. > Training is notably slower per step, and the comparison should also report total training time. Thank you for highlighting this computational trade-off and asking about the total training cost. These timings were measured on a single NVIDIA GeForce RTX 3090 GPU with 24 GB of memory. The reported per-step training time is obtained by dividing the total training time by the number of optimizer updates. As described in Appendix C, we train on CG for 400 epochs with a batch size of 13. With 600 training trajectories and 104 transitions per trajectory (Appendix A), this schedule comprises 1.92 million optimizer updates. The training times reported in Appendix D (Table 6 in the revised manuscript)—111.96 ms for RATIO+MGN and 67.31 ms for MGN-T—therefore correspond to approximately **59.7 hours and 35.9 hours**, respectively. We acknowledge that RATIO’s current implementation incurs higher training costs than several baselines. Processing irregular graph relations introduces a **memory–runtime trade-off**, particularly when graphs in the same batch have different structures and edge counts. In RATIO, world-edge counts vary across samples and frames. A direct broadcast-based aggregation materializes a large edge–token–channel tensor, whereas per-sample matrix multiplication avoids this intermediate at the cost of multiple smaller operations. During training, backpropagation through aggregation and redistribution adds computation and intermediate-storage requirements. We view this as a **broader implementation challenge in mapping variable-sized graphs into latent tokens for Transformer processing**. Even when global attention operates on a fixed token budget, aggregation into tokens and redistribution to graph entities must still accommodate irregular inputs. Possible optimization routes include **masked padding and grouped matrix multiplication**. TokenGT [4] uses padding and masks to batch variable-length node–edge sequences; applying the same batching principle to edge aggregation permits regular batched matrix multiplication, at the cost of storing and processing padded entries. Grouped matrix multiplication (grouped GEMM) [5] offers another route by jointly scheduling matrix multiplications of different sizes without padding every sample to the largest edge count. The relative benefits of these choices may depend on the dataset, particularly the distribution of graph sizes and edge counts, as well as batch size and hardware. We have added a discussion of this overhead and possible implementation optimizations to Appendix D, following Table 6. A systematic evaluation of these optimizations remains future work.Response 4
Gripper–body penetration during predicted rollouts should be evaluated alongside position RMSE.
Thank you for highlighting this contact-related aspect of the evaluation. We evaluated gripper–body penetration on the CG dataset using all 120 test trajectories, and applied the same geometric measure to the ground-truth trajectories.
We define penetration as a deformable node lying inside the solid material of a gripper. Its penetration depth is the shortest Euclidean distance to the gripper's material boundary, and is zero for nodes outside the material. The calculation uses the original gripper surface geometry, preserving its cavities and excluding internal interfaces between overlapping components. For each trajectory, we take the maximum depth over all deformable nodes and predicted states. We report the mean and maximum of these per-trajectory peak depths across the 120 test trajectories. All values are in the dataset's original coordinate units.
| Metric | GT | MGN | Transolver | MGN-T | RATIO | RATIO+MGN |
|---|---|---|---|---|---|---|
| Mean trajectory peak depth | 0.002938 | 0.002786 | 0.004188 | 0.002057 | 0.003776 | 0.003221 |
| Maximum depth | 0.008930 | 0.008221 | 0.010100 | 0.012481 | 0.014142 | 0.012530 |
First, the CG ground truth itself exhibits penetration under this geometric measure, making it an essential reference for interpreting the predictions. MGN is closest to GT in both reported summary statistics. MGN-T has the lowest mean trajectory peak depth, below the GT value, although its maximum depth remains higher than GT. RATIO and Transolver exhibit higher mean peak depths than GT. Compared with standalone RATIO, RATIO+MGN reduces both the mean peak depth and the maximum depth, bringing both statistics closer to the GT reference.
These observations are consistent with a possible benefit of local message passing for refining contact behavior. MGN directly propagates information along neighboring mesh and contact edges, which may help resolve local gripper–body interactions. RATIO incorporates these relations into global token interactions to capture deformation across the body, and the CG qualitative comparisons in Figure 5 (Section 4.2) and Figure 8 (Appendix E) illustrate improved overall shape reconstruction by RATIO-based models.
We have added the metric definition, quantitative results, and discussion to Appendix F (Table 7) of the revised manuscript.
Thank you again for your thoughtful feedback. Should you have any further questions or concerns, we would be pleased to provide clarification and continue the discussion.
[1] Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter W. Battaglia. Learning Mesh-Based Simulation with Graph Networks. In International Conference on Learning Representations, 2021.
[2] Yunzhu Li, Jiajun Wu, Russ Tedrake, Joshua B. Tenenbaum, and Antonio Torralba. Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids. In International Conference on Learning Representations, 2019.
[3] Harm Askes, Antonio Rodríguez-Ferran, and Jack Hetherington. The effects of element shape on the critical time step in explicit time integrators for elasto-dynamics. International Journal for Numerical Methods in Engineering, 101(11):809–824, 2015.
[4] Jinwoo Kim, Tien Dat Nguyen, Seonwoo Min, Sungjun Cho, Moontae Lee, Honglak Lee, and Seunghoon Hong. Pure Transformers are Powerful Graph Learners. In Advances in Neural Information Processing Systems, 2022. Official batching implementation.
[5] Babak Hejazi. Introducing Grouped GEMM APIs in cuBLAS and More Performance Updates. NVIDIA Technical Blog, 2024.
Response 1
We sincerely appreciate your thorough assessment and constructive remarks. Your feedback provides valuable guidance for improving the clarity and rigor of the manuscript. In the following, we respond to each of the points you raised.
Thank you for this constructive suggestion, which has helped us strengthen the experimental evaluation in our paper. We have added experiments on Deforming Plate (DP) [1] and Rice Grip (RG) [2]. DP features irregular tetrahedral meshes, with 400 recorded states per trajectory corresponding to 399 autoregressive prediction steps. RG uses a particle-based representation of deformable objects, extending the evaluation beyond the mesh-based settings of CG, TM, and DP.
Within the time available for rebuttal, we evaluated representative local, global, and hybrid methods—MGN, Transolver, and MGN-T—alongside RATIO-only and RATIO+MGN on these two datasets. We have also added the dataset descriptions and visualizations to Appendix G. Errors are positional RMSE (×10−3; lower is better).
As shown in the table, standalone RATIO outperforms all three evaluated baselines on both DP and RG, including the hybrid MGN-T model. This extends the favorable comparison observed on CG and TM to the two additional benchmarks. Across these new experiments, the lowest error on each dataset is achieved by a RATIO-based model, either used independently or combined with MGN.
On the other hand, the additional benefit of local–global fusion varies between datasets. Adding MGN reduces the error from 24.98 to 23.28 on RG, but increases it from 13.99 to 16.75 on DP. This illustrates that introducing a local branch does not automatically improve an already effective global operator. As discussed in Section 5 (Conclusion and Limitations), a fuller understanding of when and why local and global operators complement each other is still needed to guide fusion designs that yield more consistent improvements.
These results support the central contribution of our work: a relation-aware global operator that delivers strong prediction accuracy on its own. The performance of standalone RATIO on both new benchmarks broadens the evidence for the operator beyond CG and TM. Fusion with a local module can help the model capture additional local information, but the resulting performance benefits vary across datasets.