- Rating
- 4(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This manuscript introduces EQ-Agent, an end-to-end framework designed to advance affective AI from passive MER to an active, emotionally intelligent decision loop spanning understand, plan, and response. The main contributions include EQ-MER, a 0.9B parameter perception foundation that connects frozen audiovisual feature extractors with a Qwen3-0.6B language model via a perceptual-to-cognitive bridge employing source-preserving cross-attention and dynamic modality routing, alongside EQ-Dataset, a 30,664-record multitask resource consolidating social reasoning, expert counseling replies, and structured emotional reasoning. To complete the agentic architecture, the paper presents EQ-Agentic, an emotional reasoning engine initialized from EQ-MER and trained through Agentic-SFT and single-reward EQ-Judge Agentic-RL, paired with EQ-Harness, a runtime infrastructure enforcing standardized UPR contracts, prompt-level safety alignment, and streaming edge deployment. The authors evaluate these components on EQ-UniBench, a three-axis evaluation matrix covering perception , video-grounded reasoning , and downstream application including closed-set Judgment and open-ended Response modes. In empirical validation, EQ-MER achieves a SOTA macro score of 82.22 on MER-UniBench with aparameter efficiency of 91.36 points/B, while EQ-Agentic reaches an overall score of 47.25 on EQ-AppBench, outperforming the 8.2B AffectGPT baseline.
Critical strengths
The manuscript is well-structured and written with relative clarity. The progression from passive emotion recognition to active UPR agentic loops is logically motivated and supported by the system architecture (Fig.1), and the P2C bridge design (Fig.2). The experimental protocol, ablation studies, and mathematical definitions are are documented thoroughly across the main text and appendices. The paper offers valuable insights into parameter-efficient multimodal fusion and affective agent alignment. The empirical finding that strong perception alone yields near-zero reasoning on complex multi-step video tasks provides an interesting argument for dedicated agentic UPR fine-tuning. The P2C Bridge solves multimodal alignment and fusion for small LLMs by combining source-preserving cross-attention gating with dynamic modality routing, demonstrating that 0.9B models can surpass 8B+ systems such as Emotion-LLaMAv2 in MER. The paper successfully re-conceptualizes affective AI from passive classification to active, context-aware communication.
Critical weaknesses
EQ-Agentic is omitted from the MME-Emotion reasoning benchmark. Furthermore, its advantage over AffectGPT relies on open-ended Response scores, whereas its closed-set Judgment score drops compared to AffectGPT. This suggests that Agentic-RL optimization may degrade verifiable situational judgment skills. The open-ended response subtests as well as the GRPO reward policy utilize Qwen3.8. Because EQ-Agentic is built upon a Qwen3-0.6B backbone, evaluating Qwen-generated outputs using a Qwen-family judge introduces potential risks of model-family preference bias or alignment overfitting, which could skew the narrow margin over AffectGPT. Too many pre-print references.
Questions for authors
- Why was EQ-Agentic omitted from the MME-Emotion evaluation in Tab.2? Does the UPR agentic post-training improve upon EQ-MER's 0.62 reasoning step score on video-grounded emotional reasoning items?
- Did the single-reward Agentic-RL overfit to open-ended response generation at the expense of closed-set social judgment?Could a multi-reward formulation preserve deterministic judgment accuracy? 3)Have you verified EQ-Agentic's open-ended response scores on EQ-AppBench using non-Qwen judge models such as GPT-4o, Claude 3.5, or Llama-3-70B to ensure the narrow performance lead is robust against intra-family evaluator bias?
3 comments
Given that authors resolved my main technical doubts regarding reasoning transfer and evaluator bias and have addressed all of my technical questions and critical weaknesses, I am raising the score to 4.
Thank you very much for your thoughtful feedback and for taking the time to engage in the discussion. We truly appreciate your careful consideration of our responses and are glad that we were able to address your concerns.
Wishing you all the best in your research and future endeavors!
Response to Reviewer 3gWG: MME-Emotion Results, RL Effects, and Non-Qwen Judges
We thank the reviewer for recognizing the P2C Bridge, parameter-efficient multimodal fusion, and the progression from emotion recognition to emotionally intelligent agents. We have added public-benchmark results for EQ-Agentic and evaluations by two non-Qwen judges.
Q1: Does EQ-Agentic improve on the 0.62 MME-Emotion reasoning score?
The initial version omitted this result because EQ-Agentic's three-part UPR output required interface validation with MME-Emotion's variable-length step-extraction and scoring pipeline. To preserve the benchmark's evaluation definition, we did not include results before validation and auditing were complete. We have now evaluated the same checkpoint used for the paper's main results:
Reasoning improves by 14.99 and CoT by 4.68, with the highest parameter efficiency among all seven evaluated models. MME-Emotion is not used in training, showing that the reasoning gains transfer to a public video-based multimodal benchmark. EQ-Agentic also retains 76.09 on MER-UniBench, slightly above the strongest reproduced baseline, Emotion-LLaMAv2 (75.98, 9.3B), preserving strong perception. Full comparison: response to Reviewer fhyG, W1.
Q2: Does single-reward RL overfit to open-ended responses at the expense of closed-set judgment? Could multiple rewards help?
Assessing RL's effect requires comparing the same model before and after RL; the cross-model gap between EQ-Agentic and AffectGPT cannot itself be attributed to RL. Under the paper's main-table protocol:
Closed-set social judgment is not neglected: Agentic-SFT includes supervision on SocialIQA's correct options, while Agentic-RL's single holistic EQ reward evaluates understanding, planning, and response across the complete UPR trajectory, returning one overall score from 0 to 10. After RL, Judgment declines by only 0.62, with SocialIQA actually improving by 0.27; Response increases by 16.10 and Overall by 7.74. These results show a substantial response gain and a small judgment decline; they alone do not establish overfitting to open-ended responses. Under the non-Qwen judge Gemini, the SFT-to-RL Response gain remains at least 15.53.
We appreciate the suggestion of a multi-reward formulation and will explore it in future work to better balance response quality and judgment accuracy.
Q3: Have non-Qwen judges verified the response scores?
Yes. We froze the same model outputs, kept the rubric and candidate-text processing consistent, and re-scored them with two judges from different model families, Gemini and Grok:
Thus, the Response advantage is observed under both non-Qwen judges, rather than only Qwen. For Judgment, an LLM extracts the chosen option without receiving the question or gold answer, followed by deterministic matching to the gold label. For Response, the judge scores only the final non-empty paragraph after special-token removal, without requiring UPR structural fields.
EQ-Agentic slightly exceeds AffectGPT overall (47.25 vs. 47.09), but we do not present this margin as a statistically significant lead. Our main strength is markedly higher parameter efficiency: the 0.9B model reaches approximately 9× the efficiency of the 8.2B AffectGPT, alongside the same model's SFT-to-RL response gains. Cross-judge evidence supports the Response advantage, not a claim that the overall ranking remains ahead under every judge.
Preprint references. We cite preprints to cover recent relevant work comprehensively and avoid omitting important comparisons. Some appear only as supplementary comparisons in the appendix; the main text's core performance comparisons rely on our reproductions under a unified evaluation protocol. For work we cannot reproduce, we label literature-reported scores separately rather than treating them as our reproduced results. We will also check for and prioritize available peer-reviewed versions.