- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
EVA proposes an efficient adaptation framework for joint video–audio generation by selectively controlling cross-modal interaction at three levels. At the sample level, training probabilistically selects audio-to-video, video-to-audio, or bidirectional interaction based on content-dependent assignments, together with directional noise scheduling and gradient routing. At the model level, cross-modal attention is restricted to the later halves of the backbones, with early-layer freezing during initial adaptation. At the token level, learned gates regulate cross-modal feature injection. The authors construct a roughly 7B model from Wan2.2-TI2V-5B and MOVA’s audio generator and train it using a three-stage schedule totaling approximately 1,280 H100 GPU-days. On the 600-prompt Verse-Bench benchmark, EVA achieves the best DeSync and LSE-C scores among the main-table baselines while maintaining competitive modality-specific quality. Validation includes component ablations, training curves, human preference studies, comparisons with the pretrained backbones, and an additional MiniMax-H3 comparison.
Critical strengths
Strong synchronization results supported by complementary evaluations. EVA achieves DeSync of 0.1902, compared with 0.2342 for the next-best main-table baseline, while maintaining competitive video quality and speech accuracy. Human evaluations also report more wins than losses in audio–visual alignment against all six main baselines. Agreement between automatic and perceptual evaluations strengthens the evidence that the model improves cross-modal coordination.
A practical adaptation design with measurable component benefits. The framework combines pretrained generators while largely preserving their modality-specific quality, as examined in Appendix D. The controlled layer-placement comparison reports a reduction from 41 to 27 seconds per iteration, with comparable or better reported quality and synchronization. This is concrete evidence that restricting interaction depth can provide a useful computational benefit.
Critical weaknesses
The approximately 3% figure compares EVA’s nominal GPU-days with those of MOVA, despite differences in model capacity, initialization, data, and potentially hardware and training workloads. EVA also inherits a pretrained MOVA audio branch; Appendix B.5 appropriately excludes backbone pretraining, but the comparison still does not isolate the savings attributable to selective interaction. Figure 7 compares methods at equal optimization steps rather than equal compute, while Table 3 measures a specific 10K-step experiment on H20 GPUs rather than the full H100 training schedule. These experiments support individual benefits, but do not establish the end-to-end cost reduction of the proposed framework relative to dense adaptation from identical backbones. This distinction is central to a paper whose main contribution is training efficiency.
Questions for authors
1.Matched efficiency comparison: Starting from identical pretrained backbones and using the same data and hardware, how does EVA compare with dense bidirectional adaptation in synchronization versus GPU-hours? Can you provide the compute breakdown across all three training stages?
2.Attribution of sample-level gains: Does content-dependent routing outperform content-independent routing with the same overall A2V/V2A/Joint frequencies? How much of the improvement remains when noise scheduling and stop-gradient are controlled separately?
3.Training and inference specification: What distributions generate the paired noise levels in directional training? At inference, are both cross-modal directions always enabled, and do the modalities follow identical noise schedules? Please also specify output duration, resolution, sampling steps, guidance settings, and whether benchmark images are supplied consistently to the compared models.
4.Ablation interpretation and reliability: What checkpoints and trainable components initialize the 10K-step layer and gating ablations? Why are their LSE-C values around 1.3–1.4, substantially below the final model’s 7.8018? Please clarify the evaluation subset and provide uncertainty estimates for the main synchronization comparisons, particularly the relatively small LSE-C margin over NAVA.