- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
The paper presents VideoEditor-MoE, a mixture-of-experts (MoE) approach to video editing. Motivated by the difficulty current video editing models have with complex editing instructions, the authors propose an MoE-based scaling solution that expands a 5B base model to up to 56B total parameters, with 8B activated per token. Rather than applying experts only to the MLP layers, as is common, they extend the MoE design to the attention layers as well. Their analysis shows that all experts remain active during inference. Empirically, the method outperforms several existing video editing methods under VLM-as-a-judge evaluation, and the authors support their architectural choices with MoE ablations.
Critical strengths
-
Under the authors' VLM-as-a-judge evaluation protocol, the method shows meaningful quantitative gains over both the base model and the architectural ablations (Tab. 1).
-
The expert analysis is a nice addition, offering some insight into the internal behavior of the experts and the routing mechanism.
Critical weaknesses
-
Motivation -- The authors do not provide sufficient evidence that current state-of-the-art video editing models or frameworks perform poorly on more complex editing instructions.
-
Evaluation -- In my view, this is the most critical weakness of the paper. The main comparative evaluation (Tab. 1) compares the proposed approach against only three existing models, one of which is the base model being scaled, and relies exclusively on a custom VLM-as-a-judge evaluation pipeline. Moreover, the method is fundamentally a model-scaling approach, reaching up to 56B parameters, so comparing it against a much smaller base architecture is not entirely fair. The latency, FLOPs, and memory requirements of the approach are also not reported. Specifically, the paper lacks:
- A more comprehensive comparison to existing video editing models and frameworks, including both supervised and training-free methods.
- A latency, FLOPs, and memory comparison against these and existing baselines.
- Evaluation on standard video editing metrics, such as CLIP scores for text alignment, frame-wise CLIP/DINO similarity for temporal consistency, and FVD for video quality.
- An iso-parameter, iso-memory, or iso-FLOPs comparison against alternative scaling strategies, such as dense expansion of the base model or added depth or width. This is needed to justify that the proposed approach is the right way to scale up video editing models.
- Evaluation on established video editing benchmarks, such as TGVE, EditVerseBench, and OpenVE-Bench.
Questions for authors
Please address the motivation and evaluation concerns detailed above. In addition:
The expert analysis shows that routing is more sensitive to content and noise level than to editing categories. This seems to be in tension with the motivation stated in the Introduction: "complex editing also requires the exchange of semantic information across regions and frames to coordinate multiple modifications. This motivates extending expert capacity to attention, allowing MoE semantic representations to participate in global token interactions and support coherent editing across space and time." If the experts do not specialize by editing semantics, what evidence supports the claim that attention-level experts help coordinate complex edits? Could you clarify how the routing findings are consistent with this motivation?