- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper presents ReasonAVEdit, an instruction-guided joint audio-visual editing framework that predicts explicit visual and acoustic intermediate representations alongside the edited outputs. A single-frame visual anchor localizes the target, while a target-only acoustic trace represents the sound source and its temporal extent. The Temporal Query Bridge (TQB) transfers acoustic temporal information to video editing. The paper additionally introduces a 200K-sample training dataset and a 1,200-sample benchmark, with evaluation on two external benchmarks.
Critical strengths
Well-motivated problem. Jointly determining where, which source, and when to edit addresses a practical difficulty in instruction-guided audio-visual editing. The proposed representations have clear roles and support editing without user-provided masks or target audio.
Substantial experimental support. The evaluation covers editing fidelity, preservation, synchronization, localization, and efficiency across three benchmarks. Importantly, Table 3 controls the backbone, training data, and optimization, providing useful evidence beyond comparisons with independently trained systems.
Convincing intervention analysis. Appendix D.5 goes beyond conventional component ablations by replacing, shuffling, and modifying the predicted intermediate representations. The corresponding changes in the outputs strengthen the claim that these representations actively influence editing. The spatial, source, and temporal interventions are particularly informative.
Useful representation and efficiency tradeoff. The single-frame visual representation substantially reduces inference cost relative to the dense mask-sequence variant while maintaining competitive output quality. The additional localization diagnostics and discussion of small-object limitations help contextualize this tradeoff.
Critical weaknesses
Positioning relative to prior work. The relationship to VideoCoF should be discussed much more explicitly. VideoCoF already predicts gray-highlighted edit-region representations and jointly denoises reasoning and edited video latents, including compact spatial reasoning configurations. Although Yang et al. (2025) is cited, the manuscript does not adequately explain this close methodological relationship. The additional contributions should therefore be positioned primarily around acoustic reasoning, cross-modal temporal coordination, and their empirical benefits. The reported latency reduction should also remain clearly identified as a comparison against the dense mask-sequence variant.
Ambiguity in temporal evaluation. Appendix C.3 extracts the video edit interval using frame differences within the target subject region. However, Section 3.3 allows appearance changes throughout the clip while restricting synchronized motion changes to the acoustic edit interval. For combined appearance and speech editing, it is unclear how this metric distinguishes intended full-clip appearance changes from unwanted motion outside the speech interval. The applicable task subsets and thresholds should be specified. A direct measurement of unwanted target lip motion during another speaker’s speech would further support the central TQB claim.
Incomplete provenance of the data-generation model. Appendix F states that the mask-based editing model is trained on approximately 120K mask-conditioned editing pairs, but the construction of these initial pairs is insufficiently explained. Since this model subsequently generates the proposed dataset’s edited targets, its initial supervision is an important part of the reproducibility chain. It is also unclear whether the source-video and identity separation checks cover this model’s training data and the external evaluation benchmarks.
Questions for authors
How are the approximately 120K editing pairs used to train the data-generation model obtained, and which overlap checks are applied between this data and the evaluation sets?
How is V-T IoU computed for examples combining full-clip appearance replacement with temporally localized speech editing?
Why is JAVEdit omitted from Table 2 despite being discussed in the related work and using an LTX-2.3 backbone? Please clarify the comparison choice and checkpoint availability at submission time. This is a request for context rather than a standalone reason for rejection.