- Rating
- 3
- Confidence
- 1
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The study proposes LLAU, a multimodal fusion method that organizes asynchronous emotion cues into temporally structured latent units for emotion localization. It also introduces EmoTEL-8 and evaluates the method on this dataset and TSL-300.
Critical strengths
-
This study addresses temporal misalignment while preserving modality-specific cues and local boundary details.
-
A larger-scale dataset is proposed. Extensive experiments across multiple detectors, supported by extensive ablations, provide evidence for the proposed design.
Critical weaknesses
Comparisons with key fusion baselines, including EMOE, are restricted to the authors’ proposed dataset. The evaluation on the public benchmark TSL-300 is limited to some prior methods especially in the video-level supervision category. Why multimodal fusion methods (e.g., [TSL-Net + EMOE]) is not evaluated on TSL-300?
Questions for authors
See weaknesses.
2 comments
Dear Reviewer qQmB,
Thank you again for your helpful suggestion to extend the fusion comparisons on TSL-300. We have now uploaded the revised manuscript with a 10-page main text.
As requested, we have added the corresponding experiment to the revised manuscript. We hope this additional result addresses your suggestion.
We would be very happy to hear your thoughts and discuss any remaining questions. We hope that our responses and revisions strengthen your confidence in our work, and we would greatly appreciate your feedback and support.
Best regards,
The Authors
Fusion Comparisons on TSL-300 under Video-Level and Point-Level Supervision
We thank the reviewer for recognizing and supporting our contributions, and for suggesting a more comprehensive comparison on the public benchmark. In response, we have added TSL-Net + EMOE experiments on TSL-300. To further strengthen the comparison, we also include FINE [1], a multimodal fusion method published at AAAI 2026. Both baselines are compared with LLAU under video-level and point-level supervision. Within each supervision setting, all methods use the same data splits, audio-visual input features, TSL-Net localization framework, and evaluation protocol, allowing a controlled comparison of their fusion mechanisms.
The results are presented below. All metrics are reported as percentages, and bold denotes the best result within each supervision setting.
LLAU achieves the highest average mAP, Recall, and F2 under both supervision settings. Specifically, its average mAP reaches 13.53% and 22.17% under video-level and point-level supervision, respectively, exceeding EMOE by 3.47 and 2.95 percentage points and FINE by 1.93 and 1.63 percentage points. These additional results show that LLAU’s advantages over the compared fusion baselines also extend to the public TSL-300 benchmark, providing further evidence of its effectiveness across datasets and supervision settings. We will include the complete results, experimental settings, and baseline adaptation details in the revised manuscript.
[1] Y. Liu and S. Wang, “FINE: Factorized Multimodal Sentiment Analysis via Mutual INformation Estimation,” AAAI, 2026, pp. 1955–1963.