- Rating
- 3
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper introduces MiRA (Marginal-induced Attention Redistribution), a framewise attention reweighting framework for video-based facial expression recognition that introduces no additional trainable parameters. Its Exact mode combines frame-level attention mass and intra-frame concentration to construct a prior for redistributing attention across frames.
To improve computational efficiency, the authors introduce FlashLite, which derives framewise modulation from key-energy statistics and incorporates additive logit biases into fused attention computation. The approach is evaluated on DFEW, MAFW, and FERV39k, with additional ablations, comparisons between the two modes, frozen-feature probing, qualitative visualizations, and efficiency measurements.
Critical strengths
Overall, the paper’s strengths lie in its simple architectural design, encouraging empirical results, and practical efficiency. MiRA introduces no additional trainable parameters, while FlashLite achieves comparable recognition performance to Exact with substantially lower runtime and memory usage.
S1. A simple and practically useful design. MiRA derives framewise modulation from existing representations and preserves the overall Transformer architecture without adding trainable parameters. This makes it an appealing approach for adapting video backbones to facial expression recognition.
S2. Encouraging empirical performance. Table 5 reports improvements over the evaluated general video baselines under the stated training conditions, and Table 6 shows competitive results across three facial expression benchmarks. The five-fold comparisons in Table 4 further demonstrate comparable average performance between Exact and FlashLite on DFEW and MAFW.
S3. Substantial efficiency improvements over Exact. For ViT-B finetuning, FlashLite reduces iteration time from 700.8 ms to 169.9 ms and peak memory from 71.4 GB to 10.2 GB relative to Exact, as reported in Table 9. These results support its practical value when explicit attention-map manipulation would otherwise be costly.
Critical weaknesses
The main limitations concern the interpretation of FlashLite’s approximation, the evidence for expression-specific selectivity, and the completeness of several experimental controls. These points do not negate the reported empirical benefits, but addressing them would strengthen the technical explanation and clarify the method’s applicability.
W1. The relationship between Exact and FlashLite could be clarified further. Figure 4 provides useful quantitative comparisons, and Appendix A.2 acknowledges the limitations of key magnitude as a proxy for attention mass. However, FlashLite also changes the prior construction and scaling rule. Controlled comparisons using identical weights and inputs, with components replaced sequentially, would help distinguish the effects of these changes and better characterize the approximation.
W2. Additional evidence would strengthen the expression-specific interpretation. The visualizations in Figures 7–8 are encouraging, but attention mass and concentration may also reflect head motion, occlusion, or salient boundaries. Targeted evaluations would help establish when the proposed statistics favor expression-relevant information. The paper could also distinguish direct framewise redistribution from spatial improvements learned during training: before smoothing and interpolation, uniform scaling within a frame preserves relative attention weights for a fixed query.
W3. Additional controls would improve the completeness of the evaluation. Confidence-only and concentration-only variants would clarify the contribution of each statistic beyond the weighting study in Table 2. Given the sensitivity to the power factor observed on DFEW in Table 8, a fuller description of the validation procedure would also be helpful. Finally, adding vanilla VideoMAE with FlashAttention under matched settings would quantify FlashLite’s incremental overhead, complementing the demonstrated efficiency improvements over Exact.
Questions for authors
Q1. Could the authors clarify whether Figure 4 compares the two modes using identical model weights and ? Frame-ranking correlations or comparisons of the induced attention changes would further help interpret the reported agreement.
Q2. Are confidence-only and concentration-only results available? These would help clarify how the two statistics contribute to the observed gains.
Q3. Could the authors provide additional evidence regarding robustness to head motion, occlusion, or illumination changes, or discuss the situations in which the proposed statistics may be less reliable?
Q4. What is FlashLite’s runtime and memory overhead relative to vanilla VideoMAE using FlashAttention under identical experimental conditions?
Q5. Please clarify the numerical handling of equal frame scores in Equation (5), where the written power-normalization denominator becomes zero, and provide the clipping bounds, interpolation coefficient, EMA momentum, and validation protocol.
Suggestions for Additional Related Work
We encourage the authors to consider related studies such as S2D [1], SSM [2], FineCLIPER [3], and CLAIP-Emo [4]. These works address static-to-dynamic adaptation, knowledge transfer between facial action units and expressions, fine-grained facial modeling, and efficient audiovisual adaptation, respectively. Discussing and comparing the most relevant studies would help position MiRA within the broader literature on dynamic facial expression recognition and clarify its contribution.
References
[1] Chen, Y., et al. From Static to Dynamic: Adapting Landmark-Aware Image Models for Facial Expression Recognition in Videos. IEEE Transactions on Affective Computing, 2025.
[2] Li, J., et al. Bidirectional Learning of Facial Action Units and Expressions via Structured Semantic Mapping across Heterogeneous Datasets. IEEE Transactions on Affective Computing, 2026.
[3] Chen, H., et al. FineCLIPER: Multi-modal Fine-grained CLIP for Dynamic Facial Expression Recognition with AdaptERs. ACM Multimedia, 2024.
[4] Chen, Y., et al. CLAIP-Emo: Parameter-Efficient Adaptation of Language-Supervised Models for In-the-Wild Audiovisual Emotion Recognition. IEEE Signal Processing Letters, 2026.