- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper introduces ForceVid3D, a framework for generating videos conditioned on an initial image, text, and a camera-space 3D external force. The method uses a Projective 3D Force Map and Depth-Grounded Response Affinity Supervision (D-RAS). The authors also construct a dataset of approximately 60K force–video pairs and an accompanying evaluation benchmark. Experiments demonstrate strong force adherence and physical consistency in the 2D control setting, and further show the potential of camera-space 3D force control.
Critical strengths
1.The problem is practically relevant. The work extends direct force control to camera-space 3D directions and supports different types of interventions, including point forces and wind.
2.The method is clearly designed, addressing both the projection geometry of forces and the geometric context of responsive regions. The auxiliary supervision modules are removed at inference.
3.The dataset and experiments cover a broad range of physical responses and include baseline comparisons, controlled ablations, and failure case analysis. The overall results in the 2D control setting are convincing.
Critical weaknesses
1.The individual contributions of the two supervision objectives in D-RAS remain unclear. The existing ablations support the effectiveness of the joint supervision, but do not include variants using only response-affinity supervision or only relative-depth supervision, making it difficult to assess their individual contributions and complementarity.
2.The baselines are not fine-tuned on the same training data, making it difficult to disentangle the performance differences across methods from the effects of training data and other system differences. Adapting a representative baseline to the same dataset would help clarify the relative gains of the proposed method.
3.The paper does not systematically evaluate how the generated responses vary with force magnitude and duration. When force magnitude and duration are varied separately, while holding the scene and object properties fixed, do the generated responses follow the same trends as those observed in simulation?
Questions for authors
see weaknesses
4 comments
Feedback to Reviewer K4Jo
Q3: Independent magnitude–duration control experiments
A3: We test five normalized force magnitudes (0.2–1.0) and three durations (5, 9, 13 frames) in five Supported Rigid-Body scenes, with two force directions per scene. There are 15 conditions per scene–direction group and three inference seeds per condition, for 450 generated videos. Within each scene–direction–seed combination, we hold the image, prompt, force direction/location, camera, and object properties fixed.
We use SAM2.1 to measure signed endpoint displacement along the XY-projected force direction over the same 49-frame window. To reduce scene-scale dominance, the 15 conditions in each scene–direction–seed group share one maximum signed-displacement normalizer, and we average normalized responses over all 30 groups.
Mean normalized force-aligned displacement (dimensionless)
| Duration (frames) | |||||
|---|---|---|---|---|---|
| 5 | 0.333 | 0.480 | 0.580 | 0.666 | 0.730 |
| 9 | 0.449 | 0.617 | 0.673 | 0.762 | 0.862 |
| 13 | 0.546 | 0.634 | 0.788 | 0.846 | 0.965 |
The mean response increases monotonically with magnitude and duration across the evaluated grid. Figure 8 presents the three response curves and qualitative examples.
Q4: Qualitative consistency with rigid-body simulation trends
A4: The observed monotonic changes in normalized displacement follow the qualitative force–response trends expected from rigid-body simulation under fixed scene conditions. Appendix H.4 (Table 17; expanded multi-seed counterpart of main-text Table 4) additionally evaluates trajectory agreement against paired simulator references. Together, these offer complementary evidence of physically meaningful force controllability, while the sensitivity study focuses on response trends rather than exact numerical matching of simulator trajectories.
Thanks for your response and the additional experiments. They address my concerns and support my initial assessment, so I will maintain my rating of 3
Thank you very much for taking the time to review our response and consider the additional experiments. We are glad that the added analyses and clarifications have addressed your concerns. We sincerely appreciate your constructive feedback and thoughtful assessment, which have helped us further improve the paper. Thank you again for your time and consideration!
Feedback to Reviewer K4Jo
Thank you for your constructive suggestions. We have added individual D-RAS ablations, a matched-backbone retrained baseline, and a controlled force magnitude–duration study.
A1: We compare four matched variants, No D-RAS, Affinity-only, Depth-only, and Full D-RAS. Within each independent training repeat, all branches continue from the same 8K SFT initialization to 11K. Automatic results average two runs and three inference seeds per checkpoint; human ratings follow Appendix D.3.
D-RAS ablations — Appendix H.2 and H.4, Tables 15 and 17 (expanded multi-seed counterparts of main-text Tables 2 and 4, respectively)
Response-affinity supervision associates initial-frame surfaces with their subsequent force-induced responses, helping ground the response in the relevant scene content. Affinity-only achieves the highest 2D M+ IoU (82.80) and improves 3D directional adherence. Relative-depth supervision provides local front–back geometry around responsive surfaces; Depth-only improves trajectory agreement, reducing P-ADE from 0.781 to 0.726. Each objective alone improves H-Physics in both 2D and 3D over No D-RAS. Combining them achieves the best 2D H-Physics (68.00), 3D H-Physics (78.50), 3D Dir.@45 (65.67), R-Act. IoU (94.23), and P-ADE (0.714) among the four variants, while maintaining comparable 2D M+ IoU (82.28). These results support complementary benefits in response grounding, geometric coherence, and physical consistency.
A2: We retrain Force Prompting (Projected) on ForceVid3D-Dataset with Wan2.2-TI2V-5B for 15K steps, matching ForceVid3D's overall training settings. We construct 2D conditions from the camera-plane XY components of each 3D force, while retaining Force Prompting's moving Gaussian for Point and three-channel magnitude–direction encoding for Wind.
Matched 15K comparison — Appendix H.1, Table 14 (expanded multi-seed counterpart of main-text Table 1); Point + Wind (156 cases)
Point only (90 cases)
ForceVid3D improves Proj.-Resp.@45 by 21.79 points on Point + Wind and 18.71 on Point only; H-Physics improves by 14.48 and 20.00 points. M+ IoU on Point + Wind rises from 82.28 to 83.16, while visual quality remains comparable (full results in Appendix H.1, Table 14; expanded multi-seed counterpart of main-text Table 1). Figure 5 shows qualitative comparisons.