- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
The paper proposes CCR, a training-free method that changes the inference of a frozen MLLM for whole-image emotion recognition. Causal attention prevents image tokens from seeing the instruction that comes after them. To work around this, at three decoder depths CCR re-evaluates one block for the image tokens with a mask that lets them see the whole image and a generic instruction. It then reads the visual memory at the next block with both the contextualized and the original query, and adds the difference, scaled by a correction weight, back into the image tokens. On three 7-8B backbones and five dataset settings, CCR beats the strongest baseline (SEPM) by 1.95-3.40 points on average, and ablations cover each component.
Critical strengths
-
CCR gives consistent gains without training. It beats zero-shot in all 15 backbone-setting pairs and SEPM in 14 of 15, without updating any parameters. This makes it easy to reuse across different sets of emotion categories.
-
The ablations test each design choice. Table 2 and Fig. 3 compare CCR with meaningful alternatives: token selection, direct context, restricted feedback sources, other correction forms and open-loop replay. CCR wins in nearly every case.
Critical weaknesses
-
The protocol for choosing hyperparameters is not stated, and there are no significance tests. The paper describes no validation split. Its only sensitivity analyses (number of stages and correction weight, Fig. 3) are run on the evaluation settings, and the layer schedule (about 1/4, 1/2 and 3/4 of depth; exact indices are not reported) is fixed, with no other depths tested. Some test sets are small. The paper does not report split sizes, but all Abstract accuracies are multiples of 1/280, which suggests 280 test images, so one image is about 0.36 points, and no confidence intervals are given. The SEPM numbers for LLaVA and VILA match SEPM's published table, but the Qwen2.5-VL numbers are the authors' own reproduction, which is not described. Together, these make the 2-3 point margin hard to judge.
-
The evidence for the mechanism is thin, and baselines are missing. Variants that remove one ingredient of the claimed mechanism already recover much of the gain over zero-shot. The image-blind variant keeps the differential retrieval and replay but uses instruction states that are not conditioned on the image. It alone recovers about 60% of the gain on LLaVA and VILA and about half on Qwen (LLaVA: zero-shot 34.04, image-blind instruction 39.06, CCR 41.99). So part of the gain may come from an image-independent signal or a generic shift in label predictions, rather than from image-conditioned re-reading. Apart from the Direct-context ablation, the paper does not compare against the future-aware attention of Pei et al. (2025), on which CCR builds, or against simply placing the instruction before the image. Inference cost is described only qualitatively, and only emotion recognition is tested.
Questions for authors
- How were the correction weight, the number of stages and the layer schedule chosen? Please report results with these chosen on a validation split, with bootstrap confidence intervals or paired tests against SEPM.
- Please compare against future-aware attention (Pei et al., 2025), prompting with the instruction before the image, and PAI. Please also report CCR's latency and memory overhead.
- To rule out a shift in label priors, please report per-class accuracy or confusion matrices. Please also add two controls: a correction of the same norm in a random direction, and an irrelevant instruction in place of Q_ctx.
- Your zero-shot and SEPM numbers for LLaVA and VILA match SEPM's published Table 1. Does your zero-shot baseline use SEPM's prompt or CCR's prompt with the added contextual instruction? If the prompts differ, please report zero-shot with CCR's prompt, so that the gain from the prompt is separated from the gain from CCR. How was SEPM reproduced for Qwen2.5-VL?
Dear Reviewers,
We’re now past the halfway point of the ICLR discussion period. Please take a moment to read the authors’ responses carefully and let them know which of your concerns have been addressed and which questions remain open. If anything needs clarification or would benefit from further discussion, please raise it and engage with the authors and fellow reviewers while there’s still time.
Thank you for your time, your thoughtful reviews, and your service to the ICLR community.
Best Regards, AC