- Rating
- 2(+1)
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This work develops VMEval, a multi-dimensional framework for evaluating harmony between videos and music. The system disentangles harmony into six perceptual dimensions. By incorporating pseudo-supervised feature alignment, adaptive weighting strategies and global style modeling, it can output quantitative metrics as well as natural-language explanations. Experimental results reveal better cross-modal retrieval performance and higher consistency with human subjective evaluations.
Critical strengths
This paper targets a meaningful, practically useful task: evaluating video-music harmony, which carries importance for music recommendation and video-to-music generation. The research motivation is solid, and the problem merits further investigation. Moreover, the proposed framework delivers both quantitative scores and interpretable explanations, bringing a valuable viewpoint for fine-grained video-music harmony assessment.
Critical weaknesses
1. Ambiguous technical contributions and design rationale. The introduced framework assembles multiple established techniques: feature decomposition, cross-attention, adaptive weighting, and global style modeling. Still, the manuscript lacks adequate justification for this specific component combination and fails to explicitly verify the unique gains brought by such integration, leaving its primary technical innovations underspecified.
2. Inadequate validation for annotations and interpretability claims. The method depends substantially on pseudo-labels produced via Gemini-2.5-Pro, but the work does not thoroughly examine the trustworthiness and quality of these generated annotations. In addition, the experimental evaluation focuses largely on cross-modal retrieval and aggregate harmony metrics. It lacks direct validation to confirm whether the predicted per-dimension scores and corresponding importance weights match human perceptual perceptions, which undermines empirical support for its fine-grained interpretability claim.
Questions for authors
Q1. What justifications support the six harmony dimensions, and how is their semantic independence validated? These six dimensions are manually predefined. Several categories including emotion, atmosphere and dynamics may share considerable semantic overlap. What evidence backs this decomposition strategy, and how robust is the framework when adopting alternative dimension taxonomies?
Q2. How trustworthy are the pseudo-supervised feature scores and importance weights generated by Gemini-2.5-Pro? While the authors present a high approval rate for annotations, this metric cannot directly prove the correctness of separate scores or weight values. Could the authors supply human assessments at the dimension level, and analyze how noise and biases within pseudo-labels impact final predictions?
Q3. Does this video-music harmony evaluator generalize well to unseen datasets and evaluation scenarios? The evaluation mainly builds on cross-modal retrieval and a limited pool of human subjective ratings. Still, strong retrieval results do not equate to good perceptual harmony: multiple music pieces can fit a single video equally well. How do the authors verify that VMEval learns broadly applicable perceptual compatibility, instead of overfitting to dataset-specific matching patterns?