- Rating
- 1
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies whether learning a fine-to-coarse emotion mapping can improve probability quality without substantially changing classification accuracy. The framework jointly trains fine- and coarse-grained predictors with a learnable mapping, using consistency and structural regularization. Experiments on GoEmotions report improvements in NLL and ECE, with little change in coarse-grained accuracy.
Critical strengths
-
The paper addresses a useful question: whether learned mappings can improve predictive distributions even when classification accuracy remains largely unchanged.
-
The evaluation includes NLL, Brier score, and ECE alongside accuracy and F1, which is appropriate for assessing probability quality.
Critical weaknesses
-
The method combines familiar components but lacks comparisons with relevant transition models, multi-task baselines, and simpler calibration methods. Its novelty and the source of the gains are therefore difficult to assess.
-
Experiments cover only one dataset, taxonomy, and backbone, leaving the generality of the findings unclear.
-
The handling of multi-label examples needs clarification, particularly how co-occurrence counts are constructed and whether bootstrap sampling accounts for multiple rows from the same utterance.
-
A frozen posterior at evaluation does not establish that the learned relations are stable. Since the mapping and encoders are trained jointly, the mapping may partly compensate for encoder errors.
-
Figure 1 needs better resolution and clearer connections, and the hard-mapping description is unclear. Citation formatting errors, and missing implementation details also weaken the presentation.
Questions for authors
-
How does the method compare with transition models, shared-encoder multi-task baselines, and standard calibration methods under comparable conditions?
-
Do the gains hold on another dataset or taxonomy, or with a different backbone?
-
How are fine-coarse co-occurrences counted for multi-label examples? Does bootstrap sampling operate on original utterances or expanded rows?
-
Do the gains persist when the mapping is learned with the encoders held fixed? How stable is the mapping across encoder checkpoints?