- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper focuses on predicting object dynamics from sparse interactions. The authors argue for the need for a representation capable of capturing how responses vary across space and actions. To this end, they introduce Generalized Passive Response (GPR) and the DROP-Op method. Evaluated on a simulated grasping benchmark, DROP-Op achieves a 31.6% reduction in mean endpoint error and a 30.9% reduction in translation-centered displacement error compared to the baseline model, ALPaCA-MSE.
Critical strengths
- The experimental setup in the paper is described in detail, and the coverage is both extensive and thorough.
- The interactive visualizations provided via the link are commendable.
Critical weaknesses
The writing and presentation of this paper are weak, with several confusing aspects:
- The term "DROP-Op" appears rather abruptly in the abstract, and the motivation is not sufficiently laid out.
- The visual presentation throughout the paper is cluttered (especially in Figure 2); the boundaries between modules are unclear, and the directions of the arrows are ambiguous.
- The contributions of the paper are not effectively articulated; while a grasping benchmark is presented as a primary contribution, there is no intuitive comparison to demonstrate its advantages over other existing approaches.
Questions for authors
- Please elaborate on the significance of the proposed method for deployment in real-world robotic experiments, and discuss the "sim-to-real" gap.
- The “Introduction” mentions several relatively recent methods (specifically those from 2026); please explain why these recent approaches were not included in the baseline comparisons.
- The paper identifies the grasping benchmark as a primary contribution; please further elaborate on the advantages of this proposed benchmark compared to existing alternatives.
- The writing and the presentation of figures in the paper are limited and require further improvement.
3 comments
Response to Reviewer YS9Q (2/3)
[Q4] What does the benchmark add to existing evaluation settings?
Critical Weakness 3: The contributions of the paper are not effectively articulated; while a grasping benchmark is presented as a primary contribution, there is no intuitive comparison to demonstrate its advantages over other existing approaches.
Question 3: The paper identifies the grasping benchmark as a primary contribution; please further elaborate on the advantages of this proposed benchmark compared to existing alternatives.
Deformable grasping provides reproducible actions while retaining the coupled effects of geometry, material layout, motion and deformation. The following comparison explains our evaluation focus:
| Related benchmark | Existing evaluation | What our protocol examines |
|---|---|---|
| DefGraspNets | Quasistatic stress and deformation prediction from meshes, supplied elastic modulus and grasp force; tests unseen grasps, moduli and objects | Displacement trajectories predicted from four observed grasps, with physical properties inferred implicitly; also varies material layout and gripper configuration |
| ACID | Dynamics prediction and manipulation from partial RGB-D observations across six plush-toy types and 78 variants | Response prediction from the same sparse point observations while object, action and gripper factors vary separately and jointly |
| DensePhysNet | Physical representations learned from sliding and collision observations, evaluated through property decoding and manipulation | Full 3D displacement trajectories and generalization to controlled geometry–material and object–gripper combinations |
We vary objects (shape, size, topology, stiffness and material layout), actions (location, angle, closure and timing), and grippers (finger count, geometry and compliance), separately and together. This tests individual shifts and unseen geometry–material and object–gripper combinations, with the same four supports, four observation times and 32 anchors for each predictor.
A model may handle a new shape and a changed material separately yet fail when both change. Our protocol reveals such differences under a common prediction target and observation budget, complementing the perception and manipulation questions addressed by the benchmarks above.
Changes in the revised manuscript: Sec. 4.1 / Fig. 3, pp. 5–6; Appendix B.1 / Tables 6–8, pp. 21–22; related benchmarks in Appendix B.6 / Table 12, p. 30. The comparison table is provided in this response.
[Q5] What do the real-data results show about sim-to-real transfer?
Question 1: Please elaborate on the significance of the proposed method for deployment in real-world robotic experiments, and discuss the "sim-to-real" gap.
We added experiments on GAUGE, using real-world textile-bending measurements across six materials. Mean EPE (mm):
| Window / training | DROP-Op | ALPaCA-MSE | Response attention |
|---|---|---|---|
| Loading / real only | 2.2565 | 2.8998 | 4.5822 |
| Loading / simulation + real | 2.1482 | 2.4249 | 3.1884 |
| Full video / real only | 4.3789 | 10.7672 | 32.6302 |
| Full video / simulation + real | 3.7501 | 10.8894 | 7.7225 |
DROP-Op's advantage persists on real measurements. Simulation pretraining followed by real-data adaptation further reduces EPE by 4.8% on loading sequences and 14.4% on full videos relative to real-only training. Both conditions use the same amount of real-data training; pretraining is additional.
The remaining sim-to-real gap concerns the learned dynamics and observations. Simulation-only transfer remains inaccurate: four supports cannot compensate for a basis that does not cover the target responses. Real-data training adapts both the shared predictor and basis. Deployment must also handle tracking errors, occlusion and changing tools or contacts. The material splits were used during development, so these marker-based results provide internal transfer validation.
We have not yet evaluated closed-loop robot manipulation. Encouraged by these results, we plan to further expand our research to real-world robotic experiments.
Changes in the revised manuscript: Sec. 4.5, p. 10; Appendix F.5, pp. 44–47, including Tables 23–27 and “Simulation-to-real gap,” p. 46; future directions in Sec. 5, p. 10.
Response to Reviewer YS9Q (3/3)
[Q6] Why were some recent methods absent, and what comparisons have been added?
Question 2: The “Introduction” mentions several relatively recent methods (specifically those from 2026); please explain why these recent approaches were not included in the baseline comparisons.
The original paper compares DISCO and EqCollide on their released tasks. Other recent methods require video, volumetric meshes or numerical solvers and must be adapted to our inputs: initial geometry, gripper commands and sparse responses.
We have completed NFF, LPWM and MAVEN grasp adaptations using the original training data, common sparse observations and the same 138-pass training budget. Mean errors on the original 46-panel confirmation set are shown below.
NFF (three seeds):
| Method | EPE (mm) | dEPE (mm) |
|---|---|---|
| NFF | 2.9279 | 2.4957 |
| DROP-Op | 0.7756 | 0.7222 |
LPWM and MAVEN(one seed) :
| Method | EPE (mm) | dEPE (mm) |
|---|---|---|
| LPWM | 3.3660 | 2.7746 |
| MAVEN | 2.5872 | 2.4475 |
| DROP-Op | 0.7768 | 0.7262 |
DROP-Op lowers mean EPE by 76.9% and 70.0% relative to LPWM and MAVEN, respectively, and has lower EPE and dEPE in all 46 panels against both adaptations. Parameter counts are comparable.
Changes in the revised manuscript: Required inputs and retained components: Appendix C.5, p. 35. Added baseline results: Appendix C.4 / Tables 18–19, pp. 34–35. External comparisons: Appendix F.4, pp. 43–44. The NFF, LPWM and MAVEN results are provided above; their insertion into Table 1 and IoU evaluation remain pending.
[Q7] How has the overall writing and experimental narrative been revised?
Critical Weakness 1: The term "DROP-Op" appears rather abruptly in the abstract, and the motivation is not sufficiently laid out.
Critical Weakness 2: The visual presentation throughout the paper is cluttered (especially in Figure 2); the boundaries between modules are unclear, and the directions of the arrows are ambiguous.
Question 4: The writing and the presentation of figures in the paper are limited and require further improvement.
The Abstract and Introduction now connect the predictive goal to the effort of physical-property estimation, the difficulty of using sparse observations, and the cost of repeated processing. They then explain how GPR and DROP-Op address these challenges and how the benchmark evaluates generalization (Q3–Q4).
Methods explains the setup, coefficient identification and training of the shared network, with definitions before use and one connecting prediction equation. Figs. 1–4 explain the task, method, generalization and predictions (Q2). Fig. 5 compares accuracy and the cost of first and repeated queries; Fig. 6 tests identification across backbones.
Experiments retain their original order: generalization and efficiency, representations, identification versus conditioning, transfer across backbones and tasks, and reuse. Table 1 reports 31.6% lower EPE and 30.9% lower dEPE than ALPaCA-MSE; Tables 2–3 examine mechanisms; reuse tests measure repeated-query savings. Physical-setting, support-selection and GAUGE studies extend these results. The completed NFF, LPWM and MAVEN comparisons are reported in Q6.
Changes in the revised manuscript: Abstract/Introduction, pp. 1–2; Methods, pp. 3–5; Secs. 4.2–4.6, pp. 7–10; added studies in Secs. 4.1–4.3, pp. 6–8, and Sec. 4.5, p. 10; Appendices B.5–B.6, C.4–C.5, D.3, F.5 and H.4–H.5. Figs. 1–6: pp. 2, 4, 6, 8, 8 and 10.
Response to Reviewer YS9Q (1/3)
We sincerely appreciate Reviewer YS9Q for the positive comments on the breadth of our experiments and the interactive visualizations. Your suggestions on motivation, presentation and comparisons have helped us clarify the contributions and strengthen the evaluation.
[Q1] What does DROP-Op mean, and what motivates it?
DROP stands for Dynamics from Responses for Object Prediction; Op denotes the operator formulation. We now introduce the goal first: understanding an unfamiliar object's physical dynamics from a few interactions to predict motion and deformation under new actions.
GPR represents action-dependent responses without separately estimating every physical property. DROP-Op identifies a finite-dimensional GPR state through a shared network that produces a base displacement prediction and a response basis, and an identification step that fits spatial coefficients from sparse observations. The coefficients are reused for new actions under the same initial configuration and gripper and contact settings.
Changes in the revised manuscript: Motivation and name in the Abstract/Introduction, pp. 1–2; two components in the Sec. 3 opening, p. 3.
[Q2] How have the figures and module connections been clarified?
We have redrawn Figs. 1–4 and revised their captions. Fig. 2 uses distinct backgrounds and direct arrows to separate the shared network, coefficient identification and prediction. Its intermediate quantities follow the Methods prediction equation.
Changes in the revised manuscript: Figs. 1–4 and captions, pp. 2, 4, 6 and 8; corresponding text in Secs. 3, 4.1 and 4.2.
[Q3] What are the main contributions?
We seek a reusable representation of an unfamiliar object's dynamics from a few interactions, enabling prediction under new actions. Each contribution addresses a difficulty in obtaining this capability.
GPR reduces reliance on explicit physical-parameter estimation. Selecting properties and estimating their spatial distributions requires modeling effort, and the appropriate parameterization may change across tasks. GPR instead describes the action-to-displacement response, capturing the combined effects of geometry, material and interaction conditions.
DROP-Op identifies and reuses the response state. Pooling sparse observations can lose spatial response information, and reprocessing them for each query adds computation. A shared network learns a base displacement prediction and response basis. Local coefficient fitting uses geometry-based evidence sharing and response-dependent regularization to retain spatial information and stabilize sparse fits. Reusing these coefficients avoids repeated identification for compatible actions.
The benchmark tests individual and combined factor shifts. Accuracy in one configuration does not establish generalization when several factors change together. We vary object, action and gripper factors separately and jointly under the same observation budget.
GPR defines what to represent, DROP-Op provides identification and reuse, and the benchmark evaluates the resulting predictive generalization.
Changes in the revised manuscript: Introduction, pp. 1–2; Secs. 3.1–3.3, pp. 3–5; Sec. 4.1 / Fig. 3, pp. 5–6.