- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
DUAL addresses instruction-only video editing by changing how an MLLM's representations condition a diffusion transformer. A Target-State Path aggregates mid-to-late MLLM features and introduces plan tokens into DiT self-attention. A Relational-Constraint Path combines final-layer queries with native text tokens through a gated residual refiner for cross-attention. The model reaches 4.26 on OpenVEBench and ties the best displayed IVEBench overall score at 0.67. Path-removal and layer-selection ablations support the design, while the reported 5B renderer has comparable latency to Kiwi-Edit.
Critical strengths
-
The distinction between visual target-state information and relational guidance leads to an implementable change in the renderer, rather than only a conceptual description. OpenVEBench drops from 4.26 to 3.44 without the Target-State Path and to 3.40 without the Relational-Constraint Path; using only native text yields 3.23. These sizeable differences make the complementary value of the two paths the strongest argument for acceptance.
-
The system requires only a source video and instruction, avoiding manual spatial controls. Relative to the 5B Kiwi-Edit baseline, OpenVEBench improves from 3.88 to 4.26, including Local Add from 3.31 to 4.43. Reported latency is 157 versus 168 seconds. This supports a meaningful quality improvement at a comparable renderer scale and inference cost.
Critical weaknesses
-
The path-removal controls change both the conditioning information and its processing capacity. They do not fully isolate whether the gain comes from routing distinct semantic roles, using richer multilayer features, or adding connector capacity. A matched single-path connector consuming the same features would strengthen the central interpretation. Nevertheless, the existing ablations are sufficient to establish that the proposed interface is useful.
-
IVEBench instruction compliance is 0.37, below Ditto's 0.49, and the 0.67 overall score is a tie. The results therefore support strong overall editing performance more clearly than a general resolution of object/attribute-binding errors. This limits the breadth of the claim, but does not outweigh the OpenVEBench and controlled-ablation evidence.
Questions for authors
-
Under identical data, training, feature layers, and approximately matched connector capacity, how does a single-path MLLM connector compare with DUAL?
-
Do you have a breakdown of wrong-object and attribute-binding errors, or a targeted analysis explaining why IVEBench instruction compliance remains below stronger baselines despite the overall-score tie?
2 comments
Dear Reviewer 9VYN,
Thank you again for your thoughtful review and valuable suggestions. We have carefully addressed your concerns and revised the manuscript accordingly, with changes highlighted in blue. As the discussion deadline approaches, we would sincerely appreciate it if you could revisit our responses and let us know whether any concerns remain. We would be happy to provide further clarification.
Thank you for your time and consideration.
Best regards,
The Authors
Response to Reviewer 9VYN
We sincerely thank the reviewer for their constructive comments and insightful suggestions, which have been invaluable in improving our manuscript. We are also grateful for their recognition of the strengths of our work. The revisions have been incorporated in the revised manuscript marked in blue. Please kindly find point-to-point responses below.
Thank you for this suggestion. We have added the matched Single Cross ablation to Table 3, clarified its routing configuration in Table 4, and discussed the comparison in Section 5.3.
Matched single-path comparison:
Single Cross uses the same MLLM layers (20/24/28/32 and final), 350.60M connector parameters, training data, training procedure, and evaluation settings as DUAL. The difference lies in the conditioning design: DUAL separates detail and semantic conditioning through two specialized paths, whereas Single Cross combines both into a unified cross-attention pathway. As shown in Table R1, DUAL improves Overall by 0.71 and scores higher in all eight editing categories, isolating the value of distinct attention-routing paths under matched features and connector capacity.
Table R1. Single Cross Ablation Results
We appreciate this observation and agree with the reviewer’s assessment. We have narrowed the claim in Section 6 and added a targeted analysis of IVEBench Instruction Compliance in Appendix A.3.
Targeted analysis of IVEBench Instruction Compliance:
Yes. We provide a targeted analysis of why IVEBench instruction compliance remains below stronger baselines despite the overall-score tie.
Spatiotemporal Challenges: IVEBench includes more complex spatiotemporal edits, including subject motion and viewpoint changes. [1] These tasks involve substantial changes to spatiotemporal structure while requiring preservation of source content and temporal consistency, creating a trade-off between edit magnitude and consistency.
IC Scoring: IVEBench’s Instruction Compliance (IC) combines semantic consistency, instruction satisfaction, and quantity accuracy; Instruction Satisfaction carries a higher weight and therefore has a greater influence on the IC score. [1]
Performance and Future Work: On IVEBench, DUAL achieves higher Video Quality (0.84) and Video Fidelity (0.79) than Ditto [2] and Bernini [3], while maintaining competitive overall editing performance. Future work will explore training data targeting complex spatiotemporal changes to further improve instruction following on these tasks.
Reference:
[1] IVEBench: Modern Benchmark Suite for Instruction-Guided Video Editing Assessment. ICLR, 2026.
[2] Scaling Instruction-Based Video Editing with a High-Quality Synthetic Dataset. CVPR, 2026.
[3] Bernini: Latent Semantic Planning for Video Diffusion. arXiv:2605.22344, 2026.