- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper proposes ReVEDiT, which formulates instruction-based video editing as hierarchical Bayesian inference over a latent editing program. The method has two components. The first is Bayesian Granularity Routing, which treats the depth at which native textual and visual tokens enter the DiT as a latent variable, so that shallow blocks use only the MLLM-derived editing tokens to form the editing intent and deeper blocks additionally receive the native tokens for grounding. At inference, the split layer is fixed to the mode of the aggregate posterior over the training set. The second is Bayesian Latent Attention Reasoning. During training, a reference branch that shares parameters with the editing branch and is conditioned on the ground-truth edited video is introduced. The attention of the two branches is treated as noisy observations of the same ideal attention, and the resulting posterior is distilled into the editing branch in attention-score space. The reference branch is discarded at inference. The model is built on Wan2.2-TI2V-5B and Qwen2.5-VL-3B and evaluated on OpenVE-Bench and EditVerseBench with two MLLM judges. The paper reports the best overall results among open-source methods, together with ablations, attention analysis, and a user study.
Critical strengths
The theoretical framework is complete. It seems that the authors have solid mathematical skills.
Critical weaknesses
- What confuses me most is that the authors build such a complex theoretical framework, yet the final improvement is very small. Appendix Table 4, Table 5, and F.6 strongly suggest that ReVEDiT is further trained from Kiwi-Edit stage-2, and the two share the same backbone, query tokens, and training data sources, but the paper never clearly states where the model is initialized from. Compared with Kiwi-Edit, ReVEDiT is only 0.7 to 1.5 points higher on a 100-point scale. Table 2 confuses me even more: with both modules removed, the "vanilla DiT editor" scores only 71.71, which is more than 4 points lower than the original baseline Kiwi-Edit (75.89). In addition, "w/o granularity routing" sets Ls = 34. By Eq. 9 and Eq. 14, this removes the native tokens from the conditioning of every layer and also makes the set of distillation layers empty, so it does not test the case criticized in the Intro, where every block receives the same conditioning. Why does such a complex theoretical framework bring only such a small gain? I do not see a convincing explanation.
- The Bayesian framework looks intimidating, but it largely collapses in the end. The authors spend a lot of space deriving the ELBO, then set the coefficients of all prior-matching terms to 0, take the modes of the editing primitives and the routing, and fix the split layer to a constant at inference. What is actually optimized is only Eq. 15, namely a plain flow matching loss plus a KL loss on the attention. The so-called input-adaptive routing is just a hyperparameter at inference, and Table 2(b) is simply a sweep over it. After reading the paper, I still cannot tell what actually works, or what this theoretical derivation contributes to the actual method.
- There are many inconsistencies throughout the paper. Sec. 5 states that the routing split is Ls = 17, while Table 2 and Appendix F.1 both state 15. Sec. 5 also gives "λ_align = 0.75 with InfoNCE temperature τ = 0.07", but the method section contains no such loss. "RAAA" and "GRTC", which appear in Fig. 3 and Table 4, are never defined in the main text. More seriously, both the abstract and Sec. 5.1 claim that ReVEDiT achieves the best overall performance on both benchmarks under both judges, but in the OpenVE-Bench / Gemini-3.1-Pro block of Table 1, Lucy-Edit (64.77) is clearly higher than ReVEDiT (62.48), and yet 62.48 is marked in bold. These issues make it hard for me to tell which version the authors actually trained and evaluated, and overall this paper feels totally undone to me.
- The benchmark setting is inconsistent with both the original paper and Kiwi-Edit. OpenVE-Bench originally uses a 1-to-5 scale with 8 categories, and Kiwi-Edit also reports its results on the 1-to-5 scale. This paper instead switches to a 1-to-100 scale, uses two new judges, and reports only 4 categories. More importantly, the authors claim that their rubric follows the OpenVE-3M protocol, but the original OpenVE paper specifies that Instruction Compliance upper-bounds the other two axes, while this paper requires the three axes to be scored independently, which directly changes the meaning of the Overall score. As a result, the ranking also changes: in the results that Kiwi-Edit reports under the original protocol, Kiwi-Edit (2.98) is clearly ahead of Lucy-Edit (2.22), whereas in this paper Lucy-Edit even surpasses both Kiwi-Edit and ReVEDiT. In addition, the paper does not compare with strong baselines such as UniVideo and ReCo, which were compared in the Kiwi-Edit paper.
Questions for authors
see the Weaknesses.