- Rating
- 2
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes VestEdit for inversion-free text-guided video editing. The proposed training-free correction layer is placed between velocity construction and ODE solver. There are two components in this correction layer: First, the spatial projection suppresses residuals outside the estimated editable support. Then, this spatially corrected field is redirected via a norm-preserving spectral projection called kinetic-energy-preserving projection (KE-OPM), to an attention-induced low-frequency subspace. VestEdit is analyzed on FiVE benchmark.
Critical strengths
The motivation is convincing that existing inversion-free methods only consider source-target difference and ignore cross-frame dynamics. Then the method naturally connects with this motivation by proposing spatial correction to suppress residuals and spectral correction to redirect inconsistent high-frequency motion to a low-frequency motion manifold in the temporal direction. The method looks sound.
Critical weaknesses
-
A main critical weakness is that the submission does not provide any video results even though it is a video editing paper. This is especially important since one of the main advantages of the proposed method is improving temporal aspects of the edited video (e.g,. flickering, motion). It is not possible to judge whether the temporal/motion side has improved without any video results.
-
The experiment section is weak: (i) The proposed ideas are only validated on a single backbone (Wan 2.1). How does it work on other backbones like LTX or MiniMax H3? (ii) The metrics are not defined or explained clearly. How is motion fidelity measured? What is Dist? (iii) NIQE is reported to assess visual quality (l367), however, the proposed method performs worst in terms of NIQE. (iv) Ablation study (Table 4) shows that not using the proposed spatial projection is better than using it across all metrics. Also, not using the proposed KE-OPM is better in terms of Dist. If these metrics are not reliable, visual comparisons could be provided. Otherwise, there is no empirical evidence supporting the proposed components.
[Not critical but worth noting] The overall presentation of the paper should be improved. For example, related work in the main paper doesn't give enough details. I understand that the authors are limited due to the page limit but some details from the related work in the appendix should be brought forward. I would significantly reduce the preliminaries section which is almost taking a page and bring in more details from Appendix B and C.
[Minor] Fig 5 (a) caption: "retain-support (red)" should be "retain-support (gray)" ?
Questions for authors
Does the proposed method also work on other backbones? Please provide empirical results.
Clarification: How is motion fidelity measured? What is Dist?