- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes an object motion editing method for videos, named TRACE, which allows users to specify the desired motion path solely in the first frame. Specifically, TRACE employs a two-stage pipeline. Stage 1 utilizes a learnable cross-view motion transformation module to convert the first-frame path into frame-aligned bounding-box trajectories. Stage 2 removes the object from its original trajectory and regenerates it along the new bounding-box trajectories predicted by Stage 1. Extensive experiments on real-world videos demonstrate the effectiveness of the proposed method.
Critical strengths
- This paper proposes a first-frame-guided object motion editing framework for videos, which simplifies the user interaction process.
- This paper provides extensive demonstration videos in the supplementary material.
Critical weaknesses
- Since the method only uses the first frame as the appearance reference for video re-synthesis, it remains unclear how the method preserves identity-specific details and generates natural non-rigid motion under large trajectory changes.
- In Stage 1, TRACE leverages a cross-view motion transformation module to predict new bounding-box trajectories. However, under large camera motion, it remains unclear how the method ensures that the predicted trajectories accurately reflect the user's guidance specified in the first frame.
- Since video resynthesis relies on the bounding-box trajectories predicted by Stage 1, the robustness of the method to large foreground objects and substantial editing regions is not sufficiently evaluated.
Questions for authors
Please refer to the Critical Weaknesses.