- Rating
- 3(+1)
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes ROBIN, an open-world emotion recognition framework designed to recognize both known and unseen emotion classes. The authors identify two limitations: unconstrained similarity-based clustering may fail to separate different unseen classes, while single-model prediction mechanisms may be biased toward known classes. In response, ROBIN introduces equiangular prototypes based on the ETF structure to encourage well-separated class representations. It further adopts a progressive prediction strategy that first distinguishes known from unseen classes using an auxiliary binary classifier and then masks class components inconsistent with the predicted category group to perform fine-grained emotion recognition.
Critical strengths
-
Open-world emotion recognition is practically relevant because collecting labeled data for every fine-grained emotion is difficult, particularly for rare or previously unseen classes.
-
The paper highlights the difficulty of separating unseen classes without direct supervision and the potential bias of class predictions toward known classes, providing a reasonable starting point.
-
ROBIN outperforms existing state-of-the-art methods on the evaluated benchmarks, suggesting potential practical value, although the strength of this evidence depends on the experimental comparisons and ablation studies.
Critical weaknesses
-
The paper argues that single-model decision mechanisms are susceptible to biases dominated by known classes and proposes a progressive prediction strategy to address this issue. However, it is unclear why the proposed binary classification and subsequent masking operations are sufficient to mitigate such bias.
-
The paper characterizes the ETF structure as an 'ideal' geometric arrangement for separating emotion classes, but the rationale for its suitability to complex emotion recognition remains unclear. In particular, the ETF constraint imposes equiangular relationships among class prototypes, which may not reflect the semantic similarities or intrinsic structure of different emotions. Moreover, the proposed prototype-based formulation raises questions about how the ETF structure benefits unseen classes that lack labeled supervision. The theoretical discussion in Section 2.2 and the corresponding appendix also appears insufficiently supported by relevant literature. The authors are encouraged to clarify the assumptions underlying Proposition 1, explain why the resulting geometric structure is appropriate for this task.
-
As mentioned by the authors in Line 096, 'we propose a fine-grained emotion recognition task', the motivation for the specific problem formulation and its distinction from existing open-world settings is not sufficiently discussed. Furthermore, the theoretical analysis appears to rely primarily on a single proposition, which does not seem sufficient to substantiate the broader claims concerning representation separation and robust fine-grained recognition.
-
As illustrated in Fig. 2, the framework incorporates multiple loss terms, but the roles of several components, particularly the entropy and contrastive losses, appear to be insufficiently connected to the central methodological motivation. At a high level, the framework seems to reduce to a two-stage procedure: first classify samples as known or unseen, and then perform fine-grained classification within the corresponding group. Most importantly, the ETF alignment component is added without sufficiently demonstrating why it is necessary.
Questions for authors
See Weaknesses
3 comments
# Response to Reviewer F7wi [2/2]
Q5: The motivation for formulating the open-world fine-grained emotion recognition task and its distinction from existing open-world settings are insufficiently discussed.
Thank you for raising this concern. We agree that clarifying the differences from existing studies would better highlight our novelty. Existing open-world emotion recognition methods have two main limitations: (1) they require a large number of high-quality labeled samples; and (2) they typically treat all unseen emotion classes as a single category. However, real-world applications often lack sufficient labeled data and require fine-grained recognition of unseen emotions. For example, user satisfaction surveys require fine-grained classification of emotions expressed in user reviews. To address these limitations, we formulate an open-world emotion recognition task that aims to achieve fine-grained classification across different classes with limited labeled samples and incomplete class coverage. To the best of our knowledge, this is the first study to investigate this problem. Further details are provided in the Introduction and Appendices E.2, E.3, and H.3.
Q6: The theoretical analysis relies primarily on a single proposition, which is insufficient to support the broader claims regarding representation separation and robust fine-grained recognition.
Thank you for raising this important concern. Proposition 1 primarily analyzes the role of the ETF structure in open-world semi-supervised emotion recognition. However, achieving representation separation and fine-grained recognition in open-world settings requires the collaboration of multiple modules: (1) ETF-based equiangular prototypes () anchor class positions and enforce inter-class separation through fixed classifier weights; (2) auxiliary binary classifier () distinguishes known from unseen classes to improve prediction robustness; (3) contrastive learning () and the warm-up strategy initially cluster unseen-class samples and then align these clusters with predefined prototypes; (4) mean prototypes () maintain intra-class compactness; and (5) entropy regularization () encourages diverse prediction distributions to prevent overconfident predictions. We validate the contributions of these modules through ablation studies. We will elaborate on their individual and collaborative roles in the revised manuscript.
Q7: The framework involves multiple loss terms, but the roles of some components, particularly the entropy and contrastive losses, are not sufficiently connected to the core methodological motivation.
Thank you for raising this concern. Please refer to our response to Q6, where we clarify the individual and collaborative roles of these components in achieving representation separation and robust fine-grained recognition.
Follow-up on Rebuttal Responses
Dear Reviewer,
Thank you for taking the time to review our work. We sincerely apologize for any inconvenience this may have caused. As the rebuttal period is coming to an end, we would like to respectfully inquire whether you have had the opportunity to review our responses to your comments. We greatly value your feedback. Please feel free to let us know if you have any further questions. We hope that our clarifications have adequately addressed your concerns, and we look forward to any further feedback you may have.
Best regards,
The authors
Response to Reviewer F7wi [1/2]
We sincerely thank you for the valuable comments and constructive suggestions on our manuscript. We respond to each concern in detail below and clarify the corresponding revisions we have made.
Thank you for raising this question. Due to the lack of supervision for unseen classes, the ETF classifier tends to assign higher probabilities to known classes than to unseen classes. To improve prediction robustness, we introduce an auxiliary binary classifier, independent of the ETF classifier, to distinguish known from unseen classes. When the binary classifier achieves high accuracy (up to 99.22% on SEED-VII), the subsequent masking operation reduces the candidate class space by excluding potentially high-probability but incorrect classes, thereby mitigating biased predictions. Further analysis is provided in Appendix E.1.
Thank you for raising this important concern. We acknowledge that enforcing equiangular relationships between class prototypes may disrupt the semantic similarities among different classes. However, given the open-world setting (limited labeled samples and incomplete class coverage) and the objective (fine-grained emotion recognition), ROBIN prioritizes improving class discriminability, particularly the representation of unseen classes. We will discuss this limitation in the revised manuscript and further clarify ROBIN's design objectives and scope of applicability.
Thank you for raising this important question. We emphasize that ROBIN does not rely solely on the ETF structure to distinguish unseen classes; rather, their discriminative representations are learned through the collaboration of multiple modules. Equiangular prototypes serve as class-position anchors, enforcing inter-class separation through fixed classifier weights. Known classes can be directly aligned with their corresponding prototypes using label indices (0 to K−1). For unseen classes, contrastive learning and a warm-up strategy first enable preliminary clustering (clusters K, K+1, …), followed by aligning these clusters with their corresponding class prototypes. Meanwhile, mean prototypes maintain intra-class representation compactness. Further details are provided in the Introduction and Appendix E.3.
Thank you for your concern regarding the theoretical foundation and applicability of Proposition 1. This proposition shows that fixing classifier weights to a predefined structure can encourage different class representations to cluster around predetermined positions. It is motivated by the well-established neural collapse phenomenon [1, 2], under the assumption that samples from different classes are separable. Neural collapse may emerge naturally when training samples have high-quality labels. However, in open-world emotion recognition, labeled training samples are limited and class coverage is incomplete, making unseen classes difficult to distinguish. Therefore, ROBIN introduces an ETF classifier to provide structural priors through predefined geometric relationships between class prototypes, thereby enhancing inter-class representation separability. Further details are provided in the Introduction and Appendix E.3.
[1] Prevalence of neural collapse during the terminal phase of deep learning training, 2020.
[2] Pca Versus lda, 2001.