- Rating
- 3
- Confidence
- 3
- Informativeness
- 3(+1)
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper investigates a "thinking paradox" in multimodal emotion recognition, where fast thinking can outperform slow thinking despite the latter's explicit reasoning process. The authors find that fast thinking tends to achieve higher recall, while slow thinking favors precision. To combine their strengths, the paper proposes MER-R1, a GRPO-based framework with two components: dual-objective disentanglement, which separately normalizes recall and precision advantages, and slow-fast confidence calibration (SFCC), which uses confidence differences between the two thinking modes to guide the final predictions. Experiments on MER-UniBench and MME-Emotion demonstrate improved recognition performance.
Critical strengths
- Interesting motivation and insightful analysis. The paper identifies a meaningful limitation of explicit reasoning in multimodal emotion recognition. The analysis of precision, recall, prediction diversity, and category-level confidence provides a clear motivation for the proposed method. The additional controls for prediction cardinality and reasoning length further strengthen the findings.
- Strong empirical results with useful ablations. MER-R1 improves the MER-UniBench mean from 77.87 to 83.50 on Qwen2.5-Omni and from 78.28 to 82.75 on MiniCPM-o-4.5. It also improves the MME-Emotion CoT score from 45.3 to 51.5. The component ablations and additional F1-based evaluations provide useful evidence for the effectiveness of the overall approach.
Critical weaknesses
- The theoretical claims are somewhat overstated. Appendix A shows that the dual-objective advantage has equal correlations with recall and precision rewards under non-degenerate conditions. However, this does not guarantee that optimizing the combined advantage will improve both objectives or prevent conflicts between them, as suggested by the discussion. The theoretical conclusions should therefore be stated more carefully. Additional analysis of the actual reward correlations during training would also be helpful.
- The specific contribution of SFCC to reversing the slow-fast gap remains unclear. Table 4 shows that adding SFCC improves the F1-based mean from 71.60 to 73.15, supporting its contribution to overall performance. However, the paper does not report separate fast- and slow-thinking results for Ex2 (without SFCC). It is therefore unclear whether SFCC itself reverses the slow-fast gap. Moreover, the gains of slow over fast thinking are relatively small (0.94 and 1.14 points in R-Mean across the two backbones). Reporting the fast-slow comparison for Ex2 and providing uncertainty estimates would make this claim more convincing.
- The confidence calibration mechanism needs further clarification. SFCC computes fast-conditioned confidence using the slow answer's prefixes rather than independently generated fast predictions. Since SFCC operates on emotion words in the slow answer, correct categories predicted only by fast thinking are not directly included in its calibration reward for that rollout. The authors should clarify how SFCC helps recover these missing categories and consider a comparison with a confidence objective that does not use fast-conditioned information. Additionally, the use of first-token probabilities in Eq. (1) and the handling of empty prediction sets in Eq. (11) deserve clarification.
Questions for authors
- Does the equal-correlation property of the dual-objective advantage imply any guarantee about optimization outcomes? Could the authors clarify the scope of the theoretical conclusions?
- Could the authors report fast- and slow-thinking performance for Ex2 and Ex3 separately, ideally with confidence intervals, to establish whether SFCC is responsible for reversing the slow-fast gap?
- How does SFCC encourage the recovery of correct categories omitted from the slow answer? Could the authors compare it with a confidence objective without fast-conditioned information and clarify the implementation details of the confidence calculation?
4 comments
W3&Q3: SFCC Mechanism and Confidence Calculation
1. Recovery of omitted emotions. GRPO samples multiple rollouts per input, allowing responses that recover omitted correct emotions to receive higher recall advantages. Within each rollout, SFCC further calibrates Slow Thinking confidence relative to Fast Thinking, strengthening correct predictions while suppressing incorrect ones. Thus, GRPO can reinforce rollouts that recover omitted emotions, while SFCC further strengthens the confidence of correctly predicted emotions.
This is supported by the retained-hitrate analysis in Appendix D.6 (Fig. 8), where MER-R1 consistently preserves more correct Fast Thinking predictions across all five datasets.
2. Ablation without fast-conditioned confidence. To assess the contribution of Fast Thinking information, we introduce an absolute-confidence calibration variant that replaces the Slow−Fast confidence difference in Eq. (11) with the Slow confidence , keeping the remaining training configuration unchanged. This variant still encourages higher confidence for correct predictions and lower confidence for incorrect predictions, but removes the Fast-conditioned reference.
| Model | Mode | OV-MERD+ | MER23 | MER24 | MELD | IEMOCAP | MOSI | MOSEI | SIMS | SIMSv2 | R-Mean | Mean-F1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Absolute Confidence | Fast | 70.03 | 64.51 | 67.69 | 47.96 | 58.12 | 81.31 | 84.34 | 86.84 | 86.39 | 61.66 | 71.91 |
| Slow | 69.74 | 65.61 | 66.45 | 47.51 | 56.71 | 82.42 | 85.28 | 85.30 | 87.16 | 61.20 (↓0.46) | 71.80 | |
| MER-R1 (SFCC) | Fast | 69.60 | 63.50 | 67.24 | 46.72 | 55.56 | 85.83 | 86.90 | 87.82 | 88.10 | 60.52 | 72.36 |
| Slow | 70.45 | 65.53 | 68.55 | 48.37 | 55.89 | 85.91 | 86.77 | 86.94 | 87.00 | 61.76 (↑1.23) | 72.82 |
R-Mean averages F1 across five emotion-recognition datasets; Mean-F1 averages F1/WAF across all nine datasets.
Absolute-confidence calibration improves Slow Thinking R-Mean over the Baseline (58.11 → 61.20), but Slow Thinking still underperforms Fast Thinking by 0.46 points. In contrast, SFCC achieves a higher Slow Thinking R-Mean (61.76) and reverses the gap to +1.23. These results demonstrate the importance of fast-conditioned confidence for achieving slow–fast synergy, beyond absolute-confidence optimization.
3. Confidence computation details. For each generated emotion word, we compute confidence at its own first-token prediction position, rather than only at the beginning of the answer. Slow and Fast use the same policy, multimodal input, and preceding answer tokens; Fast omits the reasoning trace without independently generating a Fast answer. To compute category-level confidence, we collect the first tokens of all emotion words belonging to that category in the emotion wheel, removing duplicates and tokens shared across different categories. We then sum their predicted probabilities, take the logarithm, and average across applicable emotion wheels. Words without valid mappings are excluded, and empty correct/incorrect sets contribute zero raw calibration reward in Eq. (11).
Revisions: The absolute-confidence ablation is provided in Appendix D.10 (L1150–1170, Table 15). Detailed SFCC implementation is provided in Appendix C.2 (L905–956).
Appreciate the authors detailed responses. I am satisfied with their clarifications.
Thank you for your follow-up and for taking the time to consider our responses. We are glad that our clarifications addressed your concerns. We sincerely appreciate your thoughtful feedback and consideration!
We thank the reviewer for highlighting the insightful analysis and strong empirical results. We appreciate your careful feedback and provide our responses below.
W1&Q1: Scope of Theoretical Analysis
Our theoretical analysis establishes equal correlations between the dual-objective advantage and the recall/precision rewards, supporting more balanced optimization signals. We have revised the relevant statements in the manuscript to clarify the scope of our theoretical conclusions.
To further validate this property empirically, we computed the reward–advantage correlations during training:
Corr(RR,A)=0.8178,Corr(RP,A)=0.8167.The two correlations are nearly identical, which is consistent with our theoretical analysis.
Revisions: The theoretical statements are refined in the Abstract (L18–20), Introduction (L80–85), and Appendix A.2 (L736–744), with empirical reward–advantage correlations added in Appendix A.2.
W2&Q2: SFCC Contribution to the Slow–Fast Gap
We reran inference three times for Ex2 (RD+AD, without SFCC) and Ex3 (MER-R1) from Table 4 and report the averaged results below.
We additionally computed paired bootstrap 95% confidence intervals for the R-Mean gaps.
Without SFCC, Ex2 shows only a small Slow–Fast gap (+0.21), with a confidence interval that includes zero. Adding SFCC increases the gap to +1.23, with a confidence interval entirely above zero.
These results provide further evidence that SFCC is a key contributor to establishing a consistent Slow Thinking advantage and reversing the thinking paradox.
Revisions: Additional Fast/Slow comparisons and bootstrap confidence intervals are provided in Appendix D.8 (L1096–1128, Tables 12–13).