- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes a unified multimodal video editing paradigm, a pipeline for constructing training data, and a benchmark. The paper is easy to follow, and the results appear good.
Critical strengths
A viable, unified multimodal framework is proposed for the popular field of multimodal video editing. Judging by the results on display, the model is good. The paper is easy to understand.
Critical weaknesses
The proposed module lacks in-depth research; it looks like just make the system work but not satisfactory.
Some critical issues are not solved, for example:
- Facial appearance changes when the motion transfer.
These issues will detract from practical utility.
Questions for authors
- It seems that R2-Rope offers only limited improvement to model performance; why was the number of reserved slots set to 8?
- Is there any open-source code or benchmark available?
2 comments
Response to Reviewer sef3 (2/2)
Q1. Does R²-RoPE offer only limited improvement, and why eight slots?
The improvement is not limited, and it grows with the number of references:
Table R11. Sequential indexing vs. R²-RoPE: Overall (↑) and leakage rate (↓) at K = 1, 3, and 5, mean of the three judges (Table 5; per judge in Appendix Table 15).
| K=1 | K=3 | K=5 | ||||
|---|---|---|---|---|---|---|
| Indexing | Overall ↑ | Leak ↓ | Overall ↑ | Leak ↓ | Overall ↑ | Leak ↓ |
| Sequential | 1.74 | 0.07 | 2.14 | 0.48 | 0.99 | 0.84 |
| R²-RoPE | 2.95 | 0.06 | 2.72 | 0.23 | 1.92 | 0.44 |
R²-RoPE outperforms sequential indexing in both RA and Overall at every K from 1 to 5 (Table 5). Its advantage is clearest in leakage: beyond the two references seen in training, sequential indexing leaks in 48% of the judgments at K = 3 and 84% at K = 5, against 23% and 44% for R²-RoPE. Even at K = 5, the Overall score of R²-RoPE (1.92) remains above that of sequential indexing with a single reference (1.74).
Eight slots is a practical choice rather than a limit of the design (Appendix B.4). It is already above the practical ceiling of current research: reference-guided video editing in the community involves at most a few references per edit (Table R0), and no currently available data provide eight references for one editing sample. R²-RoPE itself places no constraint on the number, so more slots can simply be reserved once such data become available.
Q2. Open-source code and benchmark
We will release the full OmniXRef-Bench and the VLM evaluation protocol, including the judge prompts and scoring code, upon company approval. In the meantime, the updated supplementary material includes visualizations of a subset of 10 benchmark cases, two for each number of references from one to five, and their results.
We hope these revisions address the reviewer's concerns.
Response to Reviewer sef3 (1/2)
We thank the reviewer for finding the framework viable and unified and the paper easy to follow. We address each point below. Tables R0–R5 are in the General Response, and Table and section numbers refer to the revised PDF.
W. Depth of the study of the proposed modules
We respectfully disagree that the modules lack in-depth study. Each design choice is ablated with per-category results under three judges (Table 4 and Appendix Table 14), and each one proves necessary. R²-RoPE replaces sequential asset indexing with reserved reference slots, resolving the conflict in which the same positional index denotes the output in some samples and a reference in others; a sweep from one to five references shows that its benefit grows with the number of references (Table 5 and Appendix Table 15; see Q1). Mix-Patchify uses task-dependent patch sizes as a spatial prior; removing it lowers the Overall score from 2.95 to 1.99 (Table 4) and raises the per-step latency with four references by 3.7× (Appendix Figure 8). The three-stage curriculum, from single-reference adaptation to two-reference composition to high-resolution fine-tuning, lowers the score to 1.83 when replaced by training on the full data at 480P. Finally, our dropout strategy drops only the instruction for classifier-free guidance, which keeps the guidance focused on the requested attribute; dropping the whole reference bank instead lowers the score and raises the leakage rate from 5–8% to 19–23% (Sec. 5.4).
Beyond these ablations, the revision comprehensively extends the evaluation (G2, Table R1): a new multi-reference split with 35 samples at K = 2–5, three frontier VLM judges with three passes each, geometric camera metrics, confidence intervals and significance tests on the average and per category, sensitivity to 8 score aggregation strategies, agreement with human raters, and our recipe applied to the MiniMax-H3 backbone. It also analyzes responsiveness to references, robustness to reference order, and inference cost (Sec. 5.5 and Appendix E).
W. Facial appearance changes in motion transfer
This occurs only in very few cases, which we already reported in the Limitations for transparency (Appendix F, Appendix Figure 9). In these cases, the model transfers the reference's facial expression together with its body pose, since both belong to the motion that the reference demonstrates. Overall, OmniXRef handles Motion robustly: it is the category where its advantage is largest, with an Overall score of 3.68 / 3.86 / 3.60 against 0.92 / 1.33 / 0.90 for Seedance 2.5 under Gemini / Claude / GPT (Appendix Table 12). Separating finer factors within an attribute, such as facial expression from body pose, is a direction we plan to pursue in the future.