- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The authors construct a new dataset, ECoT-65K, from multiple existing datasets to train their proposed EmoGPT. They further propose a MoE-based emotion-processing projector and a learnable bias, ESBias. Through ablation and parameter studies, they verify that the emotion-processing projector and the bias improve model performance.
Critical strengths
- Applying MoE to handle information from different modalities is logically sound. Routing-based processing of multimodal content to effectively filter modality information is already a consensus in the field.
- The introduction of CoT effectively improves the interpretability of sentiment analysis results and injects external knowledge from reasoning chains into the model.
Critical weaknesses
- ESBias adds a learnable bias to the attention matrix computation. In my view, this bias could be introduced simply by enabling the linear layer in the W matrix. Therefore, the novelty of this module is debatable. Moreover, the main function of ESBias is to add more learnable parameters to attention computation; the claimed learning of preferences is not supported by any experiment. It is thus unclear whether the gains come from the additional parameters, from some unintended perturbation, or from genuinely learned preference information.
- ECoT-65K is built by further annotating existing datasets, with annotations generated by large models. LLM-generated labels contain hallucinations and errors, while only part of them were manually verified. In sentiment analysis, sentiment labels require careful expert human verification to avoid unfair judgments and incorrect labels. ECoT-65K does not appear to meet this standard.
- The comparison experiments are unfair. Both Qwen-Omni (finetuned) and EmoGPT were fine-tuned on ECoT-65K, while it is unknown whether the other baselines had access to this dataset. Given the superior performance of Qwen-Omni (finetuned), the reported gains may be attributable to the generated CoT content in ECoT-65K.
Questions for authors
- The authors make many claims in the motivation and contribution sections without corresponding experimental verification, e.g., Lines 30–32, 51–53, and 199–203. Subsequent experiments also do not further demonstrate whether the problems raised in the motivation are addressed by existing methods.
- The experiments report no means, variances, or statistical tests such as t-tests. The current results cannot rule out selective reporting.
- The authors should further evaluate the label correctness of ECoT-65K to support further research by the community.