- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 1
Read review
Paper summary
This paper proposes WorldMER, a micro-expression recognition framework that models the relationship between onset-to-apex activation and apex-to-offset relaxation through bidirectional latent prediction. Two direction-specific predictors estimate the latent representation of each phase from the other. The resulting predictions and transition residuals are integrated with observed motion features through adaptive gating. The method is evaluated on CASME II, SMIC, SAMM, their 3DB Composite benchmark, and CAS(ME)3 under multiple class protocols. The paper reports competitive recognition performance and includes ablations examining bidirectional prediction, transition residuals, and adaptive fusion.
Critical strengths
1.The paper addresses a meaningful aspect of micro-expression recognition by explicitly modeling the relationship between activation and relaxation phases. The bidirectional latent-prediction formulation is motivated by the temporal structure of facial motion.
2.The proposed framework integrates predicted phase representations, transition residuals, and observed motion through adaptive fusion. The experimental design includes several component and prediction-direction ablations, which are useful for examining the proposed architecture.
Critical weaknesses
1.A major concern is the LOSO evaluation protocol. According to Appendix F.2, the model is evaluated on the held-out subject after every epoch, and predictions from the epoch with the highest held-out accuracy are retained for final metric computation. If this procedure was used in the reported experiments, it amounts to test-label-based checkpoint selection. Although the held-out subject is excluded from gradient-based training, its labels would influence model selection, introducing potential optimistic bias into the reported results. Consequently, the main performance claims and affected ablation results cannot be considered reliable estimates of subject-independent generalization without evaluation under a genuinely independent checkpoint-selection protocol. This evaluation concern is the primary reason for my rejection recommendation. I would reconsider my assessment if the authors can establish that held-out labels were not used for model selection, or provide results under an independent checkpoint-selection protocol.
2.The contribution of the cross-phase prediction objective is not fully isolated. Although the ablations examine individual components and Table 5 varies the prediction-loss weight from 0.01 to 1.00, they do not clearly separate the benefit of the auxiliary prediction objective from that of the additional predictor branches. A capacity-matched control that retains both predictors and their inference-time features while setting the prediction-loss weight to zero would help establish whether the explicit prediction objective provides benefits beyond the additional model capacity and recognition supervision. In addition, Equations (6) and (9) appear to use different scaling factors for the bidirectional prediction loss, which should be clarified for reproducibility.
Questions for authors
1.Appendix F.2 states that the epoch with the highest held-out subject ACC is selected within each LOSO fold. Were the ground-truth labels of the held-out subject actually used for checkpoint selection in the reported experiments?
2.Can the authors provide results using a checkpoint-selection procedure based exclusively on training subjects, such as an inner subject-disjoint validation split? Please clarify whether the same selection procedure was used for the CAS(ME)3 results and the ablation studies.
3.Table 5 evaluates prediction-loss weights from 0.01 to 1.00 but does not include a zero-weight control. Could the authors provide a capacity-matched ablation that retains both predictor branches and their inference-time features while removing the explicit prediction loss?
4.Could the authors clarify which loss formulation is implemented in practice, given the apparent scaling difference between Equations (6) and (9)?