- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper investigates whether audio-video synchronization errors accumulate when a joint audio-video generation model is extended to streaming generation using a sliding-window approach. The authors find that naive extension does not lead to significant accumulation of synchronization errors, although it introduces boundary artifacts and other issues. To address these problems, they propose a training-free method to stabilize streaming generation and improve generation quality.
Critical strengths
The authors provide detailed implementation descriptions and release the code.
Critical weaknesses
- The paper reads more like an experimental report than a well-structured research paper. The method section contains excessive implementation details, making it difficult to follow the main idea and understand the key contributions.
- The evaluation is not sufficiently convincing. The experiments mainly focus on a single 2.1B joint audio-video generation model (JavisDiT++). Moreover, several methodological choices rely heavily on the specific architecture and implementation of JavisDiT++, such as the audio-video token rates and alignment mechanisms. Therefore, it remains unclear whether the findings generalize to other joint audio-video generation models.
- The paper does not appear to be fully prepared for submission. For example, Line 468 states, "These interim results do not constitute the completed pre-registered test." This raises concerns about whether the experimental evaluation has been fully completed.
Questions for authors
Can the authors better distinguish the key methodological contributions from model-specific implementation details?