- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper focuses on the problem of detecting implicit sarcasm in speech. In such cases, the speaker's true attitude may not be consistent with the text content and the phonetic rhythm, and the necessary background information may not be directly presented in the speech. The framework proposed by the authors combines text and acoustic representations, decouples rhythm, integrates enhanced text and rhythm knowledge through retrieval, and employs graph-structured multi-hop conflict reasoning optimized by reinforcement learning. The authors also constructed the AEbSD dataset, which contains 10,834 audio-text samples sorted from audio books, with a relatively balanced category distribution. The experimental report shows the improvement of this method over the baseline on AEbSD, the ablation results of each module, and the evaluation results on IEMOCAP, MELD, and MUStARD++.
Critical strengths
- This paper focuses on the problem of implicit sarcasm detection in speech and accordingly creates the AEbSD dataset for this task, providing 10,834 audio-text samples, which has promoted the research on this task.
- The method proposed in this paper treats acoustic-text interaction, external knowledge, and conflict reasoning as interrelated components, thereby more accurately inferring the implicit sarcastic emotions. This method is compared with multiple baselines, and ablation analyses are conducted for prosodic decoupling, token-level correlation acquisition, RAG module, and reinforced reasoning module. These results preliminarily support the role of the proposed modules.
Critical weaknesses
- This paper reports the general hardware configuration, training duration and inference time on the test set, but no systematic efficiency experiments have been conducted yet. This method involves various components such as frozen LLM, LoRA reinforcement learning strategy, external knowledge retrieval, etc. The computational cost should not be low. Currently, there is a lack of comparison with the baseline in terms of parameter quantity, GPU memory usage, FLOPs, end-to-end latency, throughput, and external LLM/retrieval call costs, and the actual deployment cost remains unclear.
Questions for authors
- Can the authors provide more detailed efficiency experiments, including model parameters, peak memory, FLOPs, single-sample end-to-end delay, throughput, and time overhead of modules such as knowledge retrieval, LLM knowledge generation, and graph construction?
- Can the author provide a concise name for the method?
Thank you for the clarification. However, the authors did not directly answer my questions, and my main concerns still remain largely unresolved.
PDis and CroA experiments are component ablations rather than modality ablations. Removing a prosody-processing or cross-modal-alignment module does not remove the audio modality. The paper still lacks text-only, audio-only, and text+audio comparisons, as well as the requested dataset-level analysis showing whether AEbSD genuinely requires information from both modalities rather than lexical, work-, speaker-, or narrator-specific cues.
Describing PodSarc, MCSD, MuSaG, and AEbSD as coming from different domains does not establish why another dataset is necessary. A systematic comparison of their modalities, context, annotation criteria, sarcasm types, speakers, splits, and scale is still missing. The MUStARD++ experiment is useful, but it does not replace evaluation on, or a concrete explanation for not evaluating on, the three closely related spoken-sarcasm benchmarks raised in the review.
Pointing to citations in the Related Work section does not address the unsupported claims about prior approaches made in the Introduction, nor does the response resolve the organizational and novelty concerns about the task motivation.
The response explains that the selected graph path is exposed to readers and provides a human evaluation of path completeness, conflict validity, and coherence. This partially clarifies the intended interpretability. However, these metrics primarily measure explanation plausibility, not faithfulness to the model's decision. The reported κ measures annotator agreement rather than explanation correctness. Intervention-based evidence, such as path sufficiency/comprehensiveness or removing critical path nodes, would be needed to support the stronger interpretability claim.