- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents a system that extends a video filmed by a single camera and lets users change how objects move next. It builds a 3D background and records each object’s past positions and rough size. Chain-of-Motion uses a vision-language model to choose the object’s speed, direction, and whether it should stay above a certain height. Simple rules turn these choices into future paths, which guide a pretrained video generator. The authors also test the system on 55 DL3DV scenes, 38 DAVIS videos, and tasks where users edit motion through language. The results are promising, and the paper tests how different components affect performance. However, the experiments do not clearly show whether the system predicts object motion more accurately or follows motion-editing instructions better.
Critical strengths
-
A useful, editable motion representation. The shared 3D representation offers a practical way to inspect and edit object motion before expensive video synthesis. Separating object-center trajectories from appearance generation also makes the system easy to understand. The same trajectory can be rendered under different camera paths, which is a useful capability beyond giving the video generator only a text command. The paper explains the limits of coarse supports rather than treating them as detailed physical models.
-
Encouraging results with helpful ablation studies. The complete pipeline improves several reported measures across different settings. On automatic continuation, it achieves PSNR 14.921 and Flow-EPE 15.220, compared with 14.090 and 15.400 for VerseCrafter. Adding rendered trajectories to the motion description reduces FID from 60.49 to 48.76 in Table 4. Table 6 further shows that motion history and semantic context matter within this pipeline. These results support the usefulness of explicit spatial guidance, even though they do not fully isolate forecasting quality.
Critical weaknesses
1: Chain-of-Motion chooses from a few speed and direction options, and fixed rules turn these choices into future paths. It is unclear whether this is enough to predict motion that changes with the scene, such as stopping before an obstacle or responding to another moving object.
2: Chain-of-Motion needs a comparison with simpler methods. The paper does not show whether it is better than simply keeping the current speed and direction or continuing the observed turn. These alternatives should use the same scene and video generator. The speed estimate also ignores time gaps when observations are missing, which may overestimate speed during occlusion.
3: It is unclear how consistent the improvements are. The automatic continuation test uses 38 selected DAVIS videos, but the paper does not fully explain their selection or report results for each video. The Flow-EPE improvement over VerseCrafter is small, from 15.400 to 15.220. Results across individual videos and several random seeds would help show whether this gain is reliable.
4: Consistency across camera views needs a direct test. The paper shows examples from different views, but does not directly measure whether they agree on the same moving scene. The DL3DV test has no moving foreground, while the DAVIS tests use each video’s estimated camera path. Rendering the same predicted motion from several cameras would help check whether object identity and motion remain consistent.
Questions for authors
Please refer to the weakness section.