- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
This paper investigates whether audio-capable language models can predict human emotion judgments of infant vocalizations. The authors compare direct GPT-Audio predictions from raw audio, conventional supervised regressors using engineered acoustic features, and feature-based in-context learning with GPT-Audio and GPT-4o-mini. Experiments use 178 synthetic stimuli derived from ten original infant vocalizations, with human ratings across five emotion dimensions. The results show that supervised feature-based methods achieve the highest correlations, while feature-based in-context learning outperforms direct raw-audio prompting.
Critical strengths
None
Critical weaknesses
1. Limited dataset validity and unreliable generalization: The evaluation uses only 178 synthetic stimuli derived from ten original vocalizations, raising serious concerns about dataset diversity and source-specific artifacts. Stimulus-level cross-validation allows transformed recordings sharing the same original sources to appear in both training and test sets, potentially inflating performance without demonstrating generalization to unseen infant vocalizations. Furthermore, the paper does not adequately characterize the source infants or report inter-annotator reliability or a human-rating noise ceiling. Given the small number of independent source recordings and the absence of source-disjoint evaluation, the reported correlations provide insufficient evidence of robust, generalizable emotion prediction.
2. Limited novelty, insufficient motivation, and inadequate experimental comparisons: Although the exact GPT-Audio comparison is new, Cooing, Crying, and Babbling: A Link between Music and Prelinguistic Communication (Byrd et al., 2012) previously investigated acoustic correlates of human emotion judgments using the same dataset, while Do Audio LLMs Really LISTEN, or Just Transcribe? Measuring Lexical vs. Acoustic Emotion Cues Reliance (Chen et al., 2026) already examined acoustic emotion cues in audio-language models. The paper does not introduce a new methodology or demonstrate a sufficiently distinct insight beyond this prior literature, and its central comparison is not controlled: raw-audio and feature-based conditions differ in labeled supervision, output format, and sampling procedures. The evaluation is also restricted to two GPT-based models, with only GPT-Audio tested on raw waveforms, preventing broader conclusions about audio-capable language models. Consequently, the experiments neither isolate why feature-based prompting performs better nor establish a substantial new methodological or generalizable empirical finding. These limitations significantly weaken the paper's motivation, technical contribution, and evidence for its central conclusions.
Questions for authors
Q1. Dataset independence and annotation reliability: How do the authors justify stimulus-level cross-validation when the 178 synthetic stimuli originate from only ten recordings? Could the authors provide source-disjoint evaluation, clarify the number and ages of the original infants, and report inter-annotator reliability or a human-rating noise ceiling?
Q2. Experimental controls: Why were raw-audio and feature-based conditions evaluated with different levels of labeled supervision, output formats, and sampling procedures? Could the authors provide matched comparisons, particularly raw-audio in-context learning with the same number of labeled demonstrations, to establish whether acoustic feature representation is responsible for the observed improvement?
Q3. Novelty and model coverage: What substantial new insight does this study establish beyond Byrd et al. (2012) and Chen et al. (2026)? Given the broader framing around audio-capable language models, why were additional models not evaluated under comparable raw-audio and feature-based conditions?