- Rating
- 2
- Confidence
- 4
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
This paper proposes SAGE, a facial video-based pain intensity estimation framework combining anatomical action unit (AU) guidance with subject-specific calibration. The method uses a frozen MARLIN video encoder, selects spatial tokens corresponding to six pain-related AUs, and subtracts a subject-specific reference representation computed from unlabeled clips. A lightweight ordinal regression head predicts pain intensity. Experiments on BioVid using leave-one-subject-out evaluation show improvements over a matched PainFormer baseline, achieving a 5-class QWK of 0.399 compared with 0.199. Additional experiments on AI4Pain and a small QST pilot investigate cross-dataset transfer. Ablation studies indicate that subject calibration contributes most of the improvement, while AU-guided token selection provides additional benefits.
Critical strengths
- The paper demonstrates that simple mean-based calibration using unlabeled same-subject clips substantially improves ordinal pain estimation. The improvement is consistent across six frozen encoders, suggesting that the approach is not specific to MARLIN.
- The experiments investigate AU-guided selection, calibration strategies, reference-set size and composition, and backbone sensitivity. The results help identify which components contribute to performance and provide useful insights into subject variability in pain estimation.
Critical weaknesses
- The main components, including anatomical AU-based region selection, subject-level feature normalization, and ordinal regression, are established techniques. The contribution primarily lies in combining these components rather than introducing a fundamentally new learning method.
- The main results rely on BioVid, while the zero-shot evaluation uses a small, unreleased dataset of 12 subjects. Moreover, the strongest BioVid results use nearly all remaining clips from each test subject for calibration. Although smaller reference sets are evaluated, their performance is lower, raising questions about practical deployment and generalization to unseen clinical conditions.
Questions for authors
- The main BioVid results use approximately 100 unlabeled clips per test subject. Could the authors report the complete results using only five reference clips, including confidence intervals, to better demonstrate the practical effectiveness of the proposed calibration?
- How does SAGE compare with standard subject-wise feature centering applied to holistic MARLIN representations under exactly matched training and inference conditions? Can the authors further clarify the contribution of AU-guided selection beyond subject normalization?
- Given that QST-Pilot contains only 12 evaluated subjects and follows a pain stimulation protocol similar to BioVid, how robust are the reported transfer improvements? Can the authors provide uncertainty estimates and subject-level results?