- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This study investigates whether emotion-related outputs in CLIP are supported by facial expressions or contextual cues. Using sparse autoencoder features, feature ablation, and linear probing, the authors analyze joy and sadness representations. The results suggest that some features contribute preferentially to context-based outputs, while emotion information remains accessible across visual sources.
Critical strengths
-
The research question is interesting: distinguishing facial and contextual evidence may help identify scene-based shortcuts underlying emotion predictions.
-
The analysis combines feature ablation with cross-group classification, providing evidence of functional contributions beyond qualitative activation maps.
Critical weaknesses
-
The novelty is limited, and generalizability remains unverified: the analysis covers only a few features, two emotions, one dataset, and one CLIP architecture.
-
The practical value of the findings remains unclear. The paper does not demonstrate how these insights could improve emotion recognition, robustness, bias mitigation, or any other application scenario.
Questions for authors
See the weaknesses.
Thank you for the additional analyses. The nested evaluation addresses my selection-independence concern, and the natural-image prompt tests strengthen the evidence for feature 9960.
The remaining question concerns emotion specificity. As you acknowledge, the scene-cue comparison remains inconclusive. The current evidence therefore supports a context-associated contribution to sadness-related similarity, while its independence from broader scene–text matching remains open. Could you provide the exact definitions and comparison prompts for the emotion and scene-cue margins, together with their numerical effect estimates and confidence intervals, including the inconclusive comparisons?