- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 3
- Soundness
- 2
Read review
Paper summary
It presents an empirical study of how Transformer (language) models represent emotional information, examining its accessibility, latent geometry, and evolution across dialogue turns. It compares three representations: State, Continuous, and Dynamic within the framework across four pretrained Transformer encoders and five affective datasets. The analysis combines emotion classification, regression, forecasting, and controllable editing with linear probing, intrinsic dimensionality estimation, manifold analysis, and temporal trajectory measurements. The results suggest that emotional information is somehow linearly accessible, occupies compact and locally structured latent spaces, and exhibits representation-dependent strengths. It also reports complementary information across the three representations and some evidence of temporal organization in dialogue. This study mainly focused on the systematic characterization of these relationships instead of a new emotion-recognition architecture.
Critical strengths
-
It brings together emotional accessibility, latent geometry, and dialogue dynamics within the same framework, comparing three affective representations across four Transformer models and five datasets. This provides a broader understanding of emotion representations beyond conventional task-specific performance comparisons.
-
It examines intrinsic dimensionality, manifold geometry, temporal organization, and complementary information across representations. The space dimensionality checks, capacity-controlled complementarity analysis, and temporal shuffling controls provide useful insights into how emotional information is organized and retained in language-model representations.
Critical weaknesses
-
Several key findings, such as linear decodability, low-dimensional emotional structure, and latent emotion dynamics, have already been investigated in recently published work, particularly the included references Reichman et al. (ICLR 2026) and Saini et al. (EMNLP 2026). Although the unified analysis is valuable, it does not establish what fundamentally new scientific understanding emerges from combining these perspectives. This limits my assessment of its originality and significance.
-
Temporal structure varies considerably across datasets, and the strongest chronological patterns may reflect dialogue conventions or semantic continuity instead of emotion-specific dynamics. Likewise, the task-dependent advantages of State, Continuous, and Dynamic representations may partly reflect their different learning objectives. Such limitations make some broader conclusions less convincing despite the extensive empirical analysis.
Questions for authors
-
Please clarify what genuinely new scientific insights emerge beyond Reichman et al. (ICLR 2026) and Saini et al. (EMNLP 2026)? I am particularly interested in what the joint analysis of State, Continuous, and Dynamic representations establishes that earlier studies did not.
-
The three given representations are learned using different objectives; how do we distinguish their inherent geometric properties from differences induced by task-specific supervision? Does the existing native-space analysis support the same conclusions?
-
Given that temporal patterns vary across datasets, what evidence supports interpreting them as emotion-specific dynamics rather than topic continuity, speaker effects, or general dialogue structure? How far do the existing controls address these alternatives?
-
It would be nice to know whether the capacity-corrected complementarity analysis genuinely establishes distinct emotional information across the three representations, rather than improvements from combining differently trained representations. Could you clarify what existing evidence supports this interpretation?
-
Could you clarify how the proposed geometric findings differ from Yamauchi and Aizawa (ACL 2026) and Choi and Weber (arXiv 2026), particularly regarding low-dimensional affective structure, linear accessibility, and the relationship between geometry and downstream performance?
-
Similarly, Maheswaran and Desarkar (EACL 2026) also investigate common emotional representations across models and datasets. What new scientific insights arise specifically from jointly comparing State, Continuous, and Dynamic representations beyond the findings of this and other cited studies?
-
By considering Hewitt and Liang (EMNLP 2019), could you clarify whether existing probing controls sufficiently distinguish emotional information encoded in the pretrained representations from information learned through supervised probes?
7 comments
Response to Question(Q) 2 and 3
Q2. Inherent vs supervision-induced geometry; does the native-space analysis agree?
We thank the reviewer for highlighting the need to distinguish inherent encoder geometry from changes introduced by supervision. Our original native-space analysis used the fine-tuned encoder and therefore could not establish this distinction. We now include the pretrained encoder as the reference, evaluated on the same utterances using the same code.
The pretrained encoder has a mean ID of 18.6 across the 20 encoder–dataset settings, identical across objectives. The corresponding fine-tuned encoder IDs are 10.0 for State, 14.9 for Continuous, and 15.2 for Dynamic; the projected latent IDs are 6.4, 11.2, and 8.1, respectively. The pretrained baseline is consistent across alternative representations: mean pooling yields 19.0, PCA-128 yields 16.3, and the randomly initialized projector yields 17.4.
These results distinguish the inherited moderate dimensionality of pretrained representations from the objective-dependent compression induced by training. Continuous has higher ID than State in all 20 settings in both the fine-tuned encoder and projected latent spaces, with non-overlapping confidence intervals. Thus, the native-space analysis supports the same ordering, indicating that the projector further accentuates a difference already present in the fine-tuned encoder. IEMOCAP remains an exception: its pretrained representation is already low-dimensional (ID = 7.5), which we now explicitly identify as an inherited property.
Q3. Emotion-specific dynamics, or topic, speaker and dialogue structure? We thank the reviewer for prompting us to examine alternative interpretations of the observed temporal patterns. Our additional analyses indicate that the observed DailyDialog effect primarily reflects dialogue position rather than emotion-specific dynamics. We fitted the drift direction on training dialogues and evaluated it on held-out dialogues.
• Dialogue position: The drift direction predicts turn position on DailyDialog, with within-dialogue Spearman correlations of 0.36–0.47 across all 12 encoder–objective settings. Directions fitted on shuffled dialogues achieve only 0.01–0.08 (p = 0.005), the minimum attainable using 200 random directions).
• Emotion: The association persists when considering neutral utterances alone (rho = 0.34-0.44) and after controlling for emotion and dialogue act (rho = 0.23-0.37). Alignment with the valence axis is weak (|cos| <= 0.16).
• Topic and speaker: Since DailyDialog topic remains constant within each dialogue, the within-dialogue correlations control for topic. Speaker identity is also poorly decoded from the representations: on MELD, six-character classification achieves macro-F1 of 0.196, close to the 0.17 chance level. Moreover, alternating speakers in DailyDialog would produce an alternating rather than monotonic pattern.
• Objective and dataset: The effect is comparable across State, Continuous, and Dynamic (0.40, 0.44, and 0.40, respectively), indicating that it is not specific to the recurrent objective. The analysed Dynamic latents are per-utterance projections, with no recurrent processing at test time. The effect is also weaker on MELD (0.02–0.15) and IEMOCAP (0.07–0.21).
We have consequently revised the interpretation to describe this finding as positional drift and removed emotion-specific temporal claims from the abstract and conclusion.
Response to Question(Q) 4 to 6
Q4. Does RCS* show distinct information, or only gains from combining differently trained models?
We agree with the reviewer's distinction and thank them for identifying this limitation. RCS* controls probe width but does not independently control for the benefits of ensembling. To address this, we introduced a three-seed ensemble baseline: for each objective, we combined three independently trained BERT models using different seeds and evaluated them with the same RCS* procedure on identical test rows. Comparisons use paired, dialogue-clustered 95% confidence intervals.
The results show that combining State, Continuous, and Dynamic does not outperform the best same-objective three-seed ensemble on any dataset. The difference (three-objective ensemble minus best same-objective ensemble) is:
• GoEmotions: −0.060 [−0.092, −0.027]; the best same-objective ensemble is Continuous (+0.056 [0.030, 0.079]).
• MELD: −0.023 [−0.048, 0.005]; the best same-objective ensemble is State (+0.030 [0.007, 0.052]).
• DailyDialog: −0.021 [−0.064, 0.045]; the best same-objective ensemble is State (+0.056 [0.012, 0.094]).
• IEMOCAP: −0.059 [−0.117, −0.003]; the best same-objective ensemble is Dynamic (+0.126 [0.060, 0.197]).
The differences are significantly negative on GoEmotions and IEMOCAP, while the confidence intervals include zero on MELD and DailyDialog. Thus, the original complementarity result does not establish that combining objectives provides distinct emotional information; the observed gains are adequately explained by ensembling. We have corrected this interpretation in Section 4.6 and Appendices B.1 and F.5 and now report RCS* alongside the same-objective ensemble baseline and its recomputed values.
Q5. How do the findings differ from Yamauchi & Aizawa (ACL 2026) and Choi & Weber (arXiv 2026)?
We thank the reviewer for pointing us towards these relevant studies. Both are now discussed in the related work.
• Yamauchi and Aizawa impose circumplex geometry through hyperspherical contrastive learning and report a trade-off between psychologically grounded geometry and task performance. In contrast, we impose no geometric structure but examine what standard supervision objectives induce relative to pretrained representations. Our findings reveal a related trade-off: the most compressed representation is not necessarily the most transferable.
• Choi and Weber show that LLM emotion representations align with valence–arousal structure and are nonlinear but remain well approximated by linear probes. We similarly observe near-linear accessibility (mean tuned-probe gap of +0.006). However, our non-affective controls show comparable near-zero gaps for dialogue acts, speaker identity, and random control labels, suggesting that linear accessibility is not specific to emotion. Although a transferred valence axis is detectable in the full latent space (AUROC 0.71–0.97), its contribution to PC1–2 is no greater than that of a random direction. Thus, two-dimensional visualizations alone do not establish circumplex organization.
• Geometry and performance: Our additional transfer results also show that representational compression does not necessarily predict downstream utility, as discussed above.
Q6. What is new beyond Maheswaran & Desarkar (EACL 2026)?
We are grateful to the reviewer for drawing our attention to this relevant line of work. Maheswaran and Desarkar show that emotion reading directions in later layers of decoder LLMs are prompt dependent and interchangeable across datasets. Our work addresses a complementary question i.e. how different supervision objectives shape the representational spaces in which such directions are embedded. Across five datasets, the objective dependent ID ordering is consistent in all 20 encoder dataset settings. Furthermore, our non-affective controls distinguish compactness induced by categorical supervision from the emotional information accessible under emotion-targeted training. We have incorporated this distinction into the related-work discussion.
Response to Weakness(W) 1 & 2 and Question(Q) 1
We thank the reviewer for the thoughtful and detailed assessment. The questions regarding emotion-specific dynamics, representational complementarity, and the distinction from prior work prompted several additional experiments and a reassessment of our original interpretations. We introduced a three-seed ensemble control, additional tests of dialogue-position effects, and Hewitt and Liang (2019) probing controls. These analyses have helped us distinguish inherited representational properties from those induced by supervision, while narrowing claims that were not sufficiently supported. All corresponding changes have been incorporated into the revised manuscript, with a highlighted version provided in the supplementary material.
W1 / Q1. What is new beyond Reichman et al. (ICLR 2026) and Saini et al. (EMNLP 2026)?
We agree that linear decodability and low-dimensional emotional structure have been established in prior work and no longer present them as novel findings. Reichman et al. characterize a low-dimensional, steerable emotional manifold in LLM hidden states, while Saini et al. study emotional trajectories and controlled transitions. Our contribution is to compare objectives grounded in distinct theories of emotion using the same encoders and shared baselines. This comparison reveals four findings:
Geometry is induced rather than inherited. The pretrained encoder is identical across objectives, with mean ID 18.6 across four encoders and five datasets. Training reduces ID by 40–66%, depending on the objective (State: 6.4; Dynamic: 8.1; Continuous: 11.2), whereas a randomly initialized projector retains an ID of 17.4. Continuous has higher ID than State in all 20 encoder–dataset settings, with non-overlapping confidence intervals.
Compactness is not emotion-specific, but emotional content is. A matched model trained on non-affective dialogue acts achieves comparable compactness (ID 6.6–9.9) to the emotion classifiers (5.2–8.6), whereas Continuous representations remain higher-dimensional (8.1–15.8). However, at comparable ID, emotion-trained representations decode emotion more accurately (macro-F1 0.345 vs. 0.220). Thus, supervision determines much of the geometry, while the prediction target influences the information accessible within it.
Compression does not necessarily imply greater utility. Continuous, the least compressed objective, transfers best to held-out IEMOCAP. Moreover, pretrained BERT [CLS] representations achieve higher IEMOCAP emotion F1 (0.45) than any fine-tuned BERT latent (0.32–0.41).
Dialogue regularity reflects position rather than affect. The observed drift is shared across objectives, persists when considering neutral utterances alone and after controlling for emotion and dialogue act, and shows little alignment with valence. This provides a direct test of whether the observed temporal structure is genuinely affective, which a single-objective analysis cannot establish.
We have revised the Introduction to state these contributions explicitly.
W2. Temporal structure varies; task advantages may reflect the different objectives.
We agree that the original temporal interpretation required further scrutiny. Our additional analyses confirm that the DailyDialog effect primarily reflects discourse position rather than emotional dynamics, and we have revised the corresponding claims accordingly. Regarding task performance, we view its dependence on the training objective as a central aspect of our investigation rather than a confound. The revised experiments directly quantify these differences against a shared pretrained baseline. The matched non-affective model further distinguishes the effects of supervision type from those of the emotional prediction target.