- Rating
- 1
- Confidence
- 2
- Informativeness
- 1
- Presentation
- 2
- Soundness
- 1
Read review
Paper summary
MoSE-Counseling is a two-stage pipeline for Chinese counseling benchmarks. Stage 1 extracts a structured client profile with evidence spans. Stage 2 routes among LoRA experts for risk, ethical critique, and response generation, then always runs a coordination expert. A profile-independent screening score can force the risk expert on, and a max-latch keeps a crisis score from decaying across later calm turns. The paper evaluates the system on held-out splits of SOS-HL-1K, PsyQA, and D4, plus a 300-case set it calls Unseen-Crisis.
Critical strengths
Section 4.4 states that every MoSE entry on SOS-HL-1K comes from the standalone screening head, and that changing the profile or the routing thresholds cannot change those labels. Table 4 then measures routing itself: the routed system misses 16.3% of crisis signals against 15.7% when all three experts run, at 336 ms against 462 ms. The professional protocol is also concrete: five licensed counselors, 120 held-out cases per dataset, responses anonymized and shuffled, with ICC(2,k) = 0.83.
Critical weaknesses
Motivation and novelty. The problem is real: counseling models miss crisis signals and cross boundaries. The system is an assembly of existing pieces: evidence-constrained extraction, threshold routing, task-specific LoRA experts, and a max in place of an exponential moving average. The persistence audit shows that a weight of 0.7 retains 0.7^N of a unit signal; that identity is not a result. Closely related Chinese crisis evaluation on SOS-HL-1K and PsyQA, and multi-agent counseling pipelines that already separate profiling from response generation, are absent from the references. A conservative if-then router on known datasets does not meet the novelty bar of a top conference.
Experiments. The number the architecture is not allowed to change is the number used to claim the architecture works. Qwen-MoSE reaches 78.02 against 76.40 for the best fine-tuned baseline. Table 2 then reports risk-class F1 of 68.5 against 63.5 for token-routed MoE-LoRA and calls the 5-point gap evidence for specialized experts and conservative routing. Section 4.4 says those SOS-HL-1K labels are produced by the screening head alone. The comparisons that do include routing are small. Professional scores rise by about 0.16 to 0.20 on a 0–10 scale (8.76 / 8.93 / 9.10 against 8.60 / 8.75 / 8.90), with no significance test. Removing coordination costs 0.08, 0.08, and 0.15. On Unseen-Crisis, routed MoSE has risk-class F1 67.0, while single-LoRA plus Llama Guard has 67.9; the paper compares MoSE with single-LoRA at 65.2 and calls the drop from 68.5 to 67.0 a meaningful domain shift. Unseen-Crisis has no citation. The code supplement states that the manuscript does not record c_min or τ_floor.
Writing. The scope limits are repeated and clear: the router is not a safety guarantee, and the study is not a clinical trial. The same pages define the headline metric as independent of routing and then attribute its gain to routing. That contradiction is the part a reader cannot resolve.
Questions for authors
With the screening head held fixed, which main-text comparison shows that conservative routing changes a safety outcome by more than the 0.6-point miss gap in Table 4, and is that difference significant? Where is Unseen-Crisis released, and why is Llama Guard’s 67.9 risk-class F1 not the comparison on that set? I would need both answers before this was a venue-level contribution.