- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The authors present FoMo, a force conditioned video generation approach that consist of two stages. First, given an initial image, a 2D force, initial-velocity controls, and a prompt, FoMo predicts velocity and visibility maps. It integrates the velocities into trajectories that guide an adapted video generator to create the final video. In my opinion the paper contributions are the motion-first formulation, and the motion-focused losses, the authors validate their method with motion ablations and a human preference study, showing the preference for FoMo over Goal Force.
Critical strengths
Strengths:
1- I think that the use of an intermediate representation is a reasonable idea. Separating motion prediction from rendering provides an explicit target for learning motion direction and magnitude, keeping the appearance out of the prediction target and leaving the strong pretrained renderer to handle the visual part. This representation is well motivated with supporting ablations.
2 - Human preference for FoMo over Goal Force which was trained on the same data goes from 67.5% to 94.5% across different scenarios like collisions, rebounds, slide, roll, multi-object etc.
Critical weaknesses
Weaknesses:
1- In my opinion the paper should show whether changing the force’s direction or strength produces the expected change in motion. The paper does not systematically test different forces on the same scene, therefore the experiments do not clearly show how reliably the model follows the force inputs, in this case i think that these tests matter because the model should generate motion that follows the user’s controls, rather than simply motion that looks plausible.
2- My other doubts are in Appendix, so Appendix I explains what counts as a successful interaction, but not who judged success in this case. On the other hand, although the baseline uses the same training data, it has a different architecture and receives initial-velocity information differently. This makes it difficult to tell how much of the improvement comes from predicting motion before generating video. Together, these gaps make the reported improvements harder to assess confidently.
Questions for authors
Please refer to weaknesses too.
We thank the reviewer's positive feedback and address the questions as below:
JP1 · Does changing control direction or magnitude in the same scene produce the expected motion?
Response
Yes. Fixed-scene control edits confirm that FoMo responds consistently to changes in both control direction and magnitude (revised Fig. 5, Sec. 4.5):
JP2 · Who judged interaction success in Appendix I?
Response
Three human annotators independently evaluated whether each interaction met the success criteria in revised Appendix I. Annotators reviewed each video at 0.25× playback speed (4× slow motion) and independently reassessed clips with initial disagreements (only 3 samples) until all three agreed.
JP3 · How much of the matched-data result can be attributed to predicting motion first?
Response
Three experimental controls isolate the contribution of explicit motion prediction from backbone capacity and input interface differences (Sec. 4.2, Table 2, Appendix L):