- Rating
- 2
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper proposes SCHRONO, a multimodal counseling framework built on a frozen LLaDA diffusion backbone. It introduces a Sensory–Chrono hierarchy, where the Sensory Layer uses visual, acoustic, and textual information for emotion recognition and counseling strategy prediction, while the Chrono Layer uses multimodal features and dialogue context to generate counseling responses. The authors adopt staged training and separate parameter pathways to reduce interference between classification and generation tasks. They also argue that bidirectional attention helps incorporate later disclosures when interpreting earlier multimodal cues in counseling conversations. Experiments on MESC show improved classification performance and higher average LLM-judge scores for generated responses compared with the evaluated baselines.
Critical strengths
- Clearly defined research problem. The authors investigate potential gradient interference between multimodal perception and text generation during joint training, and they provide theoretical analyses of generation gradients and correlations across token-level gradients.
- Strong performance. SCHRONO outperforms the compared baselines on emotion recognition, counseling strategy prediction, and response generation.
- Comprehensive experimental analysis. The authors provide ablation studies on modality contributions, model components, and training strategies, which help clarify the roles and effectiveness of different parts of the proposed framework.
Critical weaknesses
- Unclear boundaries between architectural components. The Introduction distinguishes the shared backbone from the discriminative and generative layers, and Fig. 1 places SigLIP, WavLM, the text encoder, projectors, and feature pooling within the Multimodal Input module. However, Section 3.2 describes these feature extraction and processing operations together with the classification procedures of the Sensory Layer, including the per-frame features used for generation. Section 3.3 then introduces these features as inputs to the Chrono Layer. This makes the responsibilities and boundaries of the different modules insufficiently clear.
- Lack of direct empirical validation of the gradient-interference hypothesis. The authors identify gradient interference between generation and classification objectives on shared parameters as an important motivation for task decoupling. Although theoretical analyses are provided, the paper does not report empirical statistics on the gradients themselves.
- Insufficient justification for why bidirectional attention. The authors motivate bidirectional attention by arguing that early video tokens cannot access subsequent information under causal attention. However, an autoregressive model can integrate the complete available context when generating its final response and reinterpret earlier information. Therefore, the statement in the Abstract (around line 16): “so a late disclosure cannot revise an early reading” is not fully justified if interpreted as a limitation on the model's final contextual understanding rather than on the representations of early tokens.
Questions for authors
- Could the authors provide gradient statistics for the generation and classification objectives under a joint-training setting with shared parameters to directly support the gradient-interference hypothesis? Specifically, are there substantial differences in gradient norms or significant conflicts between gradient directions?
- What specific challenges in multimodal counseling are addressed by adopting the existing bidirectional attention mechanism of LLaDA? Given that SCHRONO inherits LLaDA's bidirectional attention and a counseling-domain adapter from prior work, could the authors further clarify what distinctive capabilities or incremental methodological contributions the proposed multimodal conditioning design provides for Progressive Disclosure scenarios, compared with existing bidirectional diffusion-based counseling models?