- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper studies why MLLMs underperform when using CoT for Visual Emotion Comprehension, identifying low-quality self-generated affective reasoning as the main bottleneck, which are characterized by four major failure modes. To address this, the authors construct VECBench-Subjective, a multi-label benchmark based on multi-model voting and human verification, and propose EmoCARE, which converts fine-grained reasoning failures into instance-specific affective rubrics used as process-level rewards in GRPO. Experiments on conventional and subjectivity-aware VEC benchmarks show that EmoCARE improves affective reasoning and emotion prediction, achieving state-of-the-art or highly competitive performance across diverse MLLMs.
Critical strengths
1.The study is well-motivated, beginning with a systematic analysis of how intermediate reasoning quality affects visual emotion comprehension. By clearly categorizing the failure modes of self-generated CoT into four distinct error types, the authors provide a solid empirical foundation that naturally justifies the design of their subsequent methodology.
2.The empirical evaluation is extensive and spans a wide range of benchmarks. The proposed model not only achieves strong in-domain performance but also demonstrates impressive OOD generalization, offering a high-quality and practical solution for advancing MLLM-based image-evoked emotion comprehension.
Critical weaknesses
1.The proposed pipeline is computationally expensive and may be difficult to scale. For every sample in the RL stage, multiple large models (up to 38B) and proprietary APIs (GPT-5) are needed offline to generate candidate rubrics, collect failure cases, and match errors, while Qwen3-32B is continuously queried online during GRPO to score reasoning steps. Moreover, this reasoning supervision heavily relies on an automated LLM-as-a-Judge paradigm without any human verification on a sampled subset, which weakens both the reliability of the reward signals and the technical novelty of the framework.
2.A key motivation of this work is the one-to-many subjective nature of human emotions. However, this subjectivity is only considered during evaluation via VECBench-Subjective, whereas the training stage remains strictly single-label. Specifically, the accuracy reward in Eq. (2) still penalizes any prediction that deviates from the single original ground-truth label, even if the predicted emotion is subjectively valid. Failing to incorporate multi-label or subjectivity-aware supervision into the training objective creates a clear disconnect between the motivation and the method.
Questions for authors
1.In the model voting stage of VECBench-Subjective, Qwen3.6-27B is used to generate candidate labels, while the primary backbone (Qwen3-VL-8B) and the online judge (Qwen3-32B) belong to the same Qwen model family. Could this introduce a potential model-family bias that favors Qwen-based models on VECBench-Subjective?
2.On VECBench-Subjective, the Hit Score metric counts a single-label prediction as correct as long as it matches any label in the ground-truth set. However, for samples with multiple valid labels (e.g., labels), the random-guess hit rate increases substantially. Why not directly prompt the model to predict a multi-label set or distribution and evaluate it using set-based metrics such as Macro-F1 or IoU?
3.Since both the offline rubric refinement and online GRPO reward scoring rely entirely on LLMs, could the authors provide a small-scale human verification study to assess the quality of the synthesized rubrics and the agreement between Qwen3-32B's reward scores and human judgments?
4.Apart from the error-mode breakdown in Figure 2(a) and case studies in Appendix D, could you provide a more direct quantitative evaluation of the intermediate reasoning quality itself, such as a small-scale study comparing rubric agreement or human preference on the generated reasoning chains?
5.It would be helpful if the authors could further review the manuscript formatting and ensure that the hyperparameters are reported consistently and clearly. In particular, please fix the citation formatting throughout the text (where \citet is frequently used instead of \citep) and specify the exact values of missing hyperparameters (e.g., in Eq. 5 and in Eq. 7) to ensure full reproducibility.