- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper introduces AV-IRE, a framework for targeted audio-visual subject removal using textual instruction. The goal is to remove a specified subject along with their associated sound while preserving the rest of the scene unchanged. The main idea is to use complementary-target supervision, where the same video is paired with different removal instructions and corresponding outputs. The method is based on LTX-2.5 and introduces a spatial selector and modality-specific routing codes to condition the joint audio-video generator. The paper also introduces a teacher-generated dataset of 54,705 removal pairs, along with AV-SwapTarget, a benchmark designed to evaluate whether a model can correctly switch between removal targets in the same video. On the Natural-2 benchmark, AV-IRE improves blind-rated joint success from 11.7% to 41.7% compared to a task-adapted LTX-2.5 baseline. A follow-up evaluation on new recordings also shows an improvement in bidirectional success from 3.3% to 26.7%.
Critical strengths
- Relevant problem formulation and evaluation.
The paper addresses an interesting problem of instruction=based audio-video editing. Removing one target successfully does not necessarily mean that a model can correctly identify and remove different targets from the same video. I think the proposed evaluation is useful to address this issue, since requiring both removal instructions to succeed provides a stronger measure of selective editing. The complementary-target supervision is also a reasonable way to address this issue during training.
- Promising results and careful experimental validation.
The improvement in joint success on Natural-2 is substantial, going from 11.7% to 41.7%. I also appreciate the effort of the authors in validating their results, using independent raters, preregistered analyses and a separate evaluation on new recordings, providing additional evidence that the model can generalize its target-selection behavior beyond the original evaluation set. Another positive aspect is that the authors discuss negative results and limitations openly, including cases where the proposed method performs worse than the baseline; this makes their results more credible.
Critical weaknesses
- Limited statistical evidence and relatively low absolute performance.
Although the improvements on Natural-2 are encouraging, the primary bidirectional success result does not reach statistical significance (0/30 vs 5/30, p = 0.0625). The fresh evaluation provides stronger evidence, but it is still based on only 30 recordings and a single reviewer. Furthermore, Natural-2 was also used during model development, making the fresh evaluation particularly important for validating the results. Even in this additional evaluation, bidirectional success reaches only 26.7%. Overall, I find the results promising, but the relatively small evaluation sets and low absolute success rates make it difficult to assess how reliable the method would be in more general scenarios.
- Mixed results on acoustic removal and generalization.
While AV-IRE substantially improves joint success on Natural-2, acoustic target removal remains almost unchanged compared with the baseline (61.7% vs 60.0%). The improvements therefore seem to come mainly from better visual editing and preservation of non-target sources. The results on other benchmarks are also less convincing. In particular, AV-IRE performs considerably worse than the task-adapted baseline on InsAVE (63.3% vs 95.9% joint success) and achieves lower acoustic removal on Natural-3. These results raise some concerns about the generalization of the method, especially given that acoustic target removal is an important part of the proposed task.
- Minor weakness: presentation and readability.
Although the motivation is clearly presented, the technical description is quite dense and requires substantial effort to follow. The experimental section could also be more straightforward. In particular, the different evaluation rounds, the distinction between primary and secondary results, and the statistical analyses are not always easy to keep track of. Considering how important the experimental validation is to the paper, I think a more concise and structured presentation of the results would make the contribution easier to assess.
Questions for authors
- The fresh evaluation shows promising improvements, but it is based on only 30 recordings. Do the authors consider this sufficient to draw conclusions about the reliability of the method, especially given the relatively low absolute bidirectional success rate?
- Acoustic target removal on Natural-2 is almost unchanged compared with the baseline, despite the substantial improvement in joint success. Do the authors believe that the main advantage of AV-IRE is better preservation of non-target sources rather than more effective target removal?
- AV-IRE performs considerably worse than the task-adapted baseline on InsAVE and shows weaker acoustic removal on Natural-3. Could the authors explain what they believe causes these differences in performance?
- The paper includes several evaluation rounds and follow-up experiments. Could the authors clarify which results they consider the strongest evidence for the effectiveness of the proposed approach, and how the different evaluations should be interpreted together?
Title: Following up on our response
Thank you again for your detailed review. We know this is a busy time, so we just wanted to check in briefly. Did our response address your concerns? If anything still seems unclear or unconvincing, please let us know. We would really like to hear your thoughts and are happy to discuss further.