- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
The paper proposes DAN, an inference-time hierarchical prompting and attention-guiding approach to improve MLLM visual (elicited) emotion recognition. A series of hierarchical prompts (starting with simple positive and negative emotion classification) combines polarity and fine-grained label probabilities into a soft-gated distribution. For uncertain or difficult samples, a second module issues one contrastive prompt per candidate emotion and keeps the visual tokens whose attention differs most across candidates. The model then re-selects the label from the masked image.
Critical strengths
- The method is train-free and is evaluated across multiple MLLM backbones
- The idea of masked images to guide the MLLM is nice and effective (based on the results)
- The MLLMs are evaluated on a few elicited emotion datasets
- Even in the train-free setting, ablations cover the proposed components, and the masked image samples appear reasonable.
Critical weaknesses
- The evaluation of the method is overall weak; only one external method is compared (SEPM), while the paper itself cites several training-free methods. In addition, general training-free token-pruning and visual-cropping methods, or fine-tuned methods (Emotion-LLaMA, AffectGPT, Emo-R3) as upper references, are also missing from the evaluation.
- The method makes up to 5 calls to rather large MLLMs (not including the multiple calls for the contrastive samples). Even though the method is train-free, it is quite computationally costly at inference time and most likely very slow. It is questionable whether that many FLOPs are needed for a simple 25-class classification. It would help to show how the FLOPs per additional accuracy justify the choice of such a method over simpler task-specific classifiers, or fewer targeted calls. For reference, Abstract8 is a ~230-image dataset, one image is +0.44 points in accuracy.
- Another main issue is the limited novelty in the approach. HERC is chained multi-turn prompting, which is pretty established in general VQA tasks. The polarity to fine-grained used is practically a simplified Parrott’s hierarchy. Overall, this element is quite overstated.
- The main argument of the method is that MLLMs struggle with the task; however, in reality, the task is inherently noisy (even humans disagree).
Questions for authors
- How does SFT perform, and do the FLOPs-per-accuracy justify the multiple calls at inference time?
- How does the method compare against other task-specific methods?
- Does CDVP’s attention come only from prompt tokens, or also from the generated contrastive rationale, and is that rationale fed into the final selection? This part was unclear in the paper.
- Zero-shot Emotion6 accuracy is identical (55.21) for Qwen3-VL-4B and 8B. Is this a coincidence or a reporting error?
Dear Reviewers,
We’re now past the halfway point of the ICLR discussion period. Please take a moment to read the authors’ responses carefully and let them know which of your concerns have been addressed and which questions remain open. If anything needs clarification or would benefit from further discussion, please raise it and engage with the authors and fellow reviewers while there’s still time.
Thank you for your time, your thoughtful reviews, and your service to the ICLR community.
Best Regards, AC