- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
Omni-Customizer addresses joint appearance and voice customization for multi-subject audio-video generation, including cases with missing image or audio references. Built on Ovi, it introduces Omni-Context Fusion to enrich text conditioning with multimodal references, Semantic-Anchored Multimodal RoPE to associate references with subject descriptions, and Subject-Aware Reference Routing to constrain direct reference attention through subject scores and predicted coverage budgets. Training combines single to multi-subject adaptation, reference dropout, and subject reindexing.
Critical strengths
The paper addresses a consequential customization setting. Incomplete reference coverage introduces a practical challenge beyond preserving fully specified identities: available faces or voices should not spread to other characters. The distinction between subject association and selective reference access provides a useful formulation of this problem.
The reported evidence supports the usefulness of the complete system. Table 2 includes both incremental additions and removals from the full configuration. The user study also favors the proposed method for joint identity preservation and binding reliability.
Critical weaknesses
Leakage scores can improve simply because required characters or speech are omitted. Appendix C.5 defines character-presence metrics (A-CP and V-CP) to detect this problem, but does not report them. The identity-matching thresholds also lack calibration or sensitivity analysis, and the preference study does not directly validate these automatic measurements. It therefore remains unclear whether lower leakage reflects better identity separation while preserving all required characters and speech.
The progressive-training comparison combines curriculum ordering, reference dropout, and subject reindexing, leaving their individual effects unclear. Architectural comparisons are also limited: OCF lacks a capacity-matched baseline, SA-MRoPE is tested only through removal, and SARR is not compared with simpler routing or masking alternatives. The results support the complete system but do not establish how much its specific mechanisms contribute.
Questions for authors
Please report A-CP and V-CP alongside ILR for the compared methods and Table 2 routing ablations, separately for partial-modality and partial-subject cases. Do the leakage improvements persist when required-character and utterance presence are comparable?
How were the ArcFace and WavLM thresholds chosen, and what evidence shows that they reliably distinguish matching from non matching identities?
What exactly differs between the training configurations with and without “Prog. Train.” in Table 2? Are optimization steps, single-/multi-subject exposure, dropout, and reindexing matched? Can the authors isolate curriculum ordering from the two augmentation strategies?
Are controlled comparisons available against a capacity-matched conditioning module, simple subject-identity embeddings or positional indexing, and simpler supervised reference-routing alternatives? Such evidence would materially clarify the methodological contribution.