- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
This paper introduces an approach to learn activation steering adapters for frozen language models to better simulate a diverse set of users. The paper describes this approach, which is based on Gaussian Mixture models. The paper then compares their approach to baseline user simulators introduced in past work on two datasets, focusing on simulator realism.
Critical strengths
The paper addresses an important topic in user simulation: how to represent a diverse set of users, compared to fine-tuned simulators on large datasets of interaction logs, which end up learning a general behavior of the average user. Little work has focused on this angle in the past, and introducing methods to achieve this is an important contribution.
Critical weaknesses
-
Issues with evaluation metrics: I am not sure what the motivation of the introduced Register (log ppl) metric is, I find it a bit problematic that this is being computed with an external model like Mistral. Could you instead just report the PPL metric directly by the simulator models and baselines themselves ? This is much more interpretable and in-line with past work. I also have the same concern about the MAUVE metric and feel it is not the right one to use here. The behavioral statistics measures are interesting, if you could combine them into a single metric of alignment with these metrics, it would be much more interpretable. I highly suggest revisiting this and checking closely related work for more reliable ways to assess simulator realism (which is what the experiments are trying to measure, as far as I understand).
-
There is a mismatch between the model used in the introduced approach (Qwen3.5) and the baseline UserLM-8b, which is based on a much older Llama3 model. Since the llama model is open-source, it would be much more sensible to implement the approach on the same model for a more direct and fair comparison with the baseline. Otherwise, it is unclear whether improvements are due to Qwen3.5 being a more recent and capable model. It would also be helpful to perform fine-tuning to Qwen3.5 in a similar way to how the baseline UserLM-8b model was trained. In general, I felt the experimental results lack some rigor and could be further strengthened with more depth. The approach could also be better clarified with a clearer description and more telling figure than the current Figure 1, which is not very reader-friendly.
Questions for authors
Please see questions above in the weaknesses section regarding evaluation metrics.
2 comments
In this comment, we would like to share the results of your suggested experiment of training MultiUS on the Llama-3-8B backbone (same one as UserLM-8B). We used the same 4,000 conversations, depth and number of epochs, and no re-tuning (121.8 M trainable parameters at this width, imposed by the backbone’s hidden size / embeddings size). We report the checkpoint chosen by our selection rule and, because that one fails our held-out CE constraint, the best checkpoint that passes it.
| first turn, WildChat | all turns, WildChat | first turn, PRISM | all turns, PRISM | |
|---|---|---|---|---|
| MultiUS, Qwen3.5-4B | 0.626 [0.556, 0.707] | 0.518 [0.425, 0.590] | 0.083 [0.050, 0.113] | 0.075 [0.057, 0.096] |
| MultiUS, Llama-3-8B, τ = 0.3 (passes) | 0.605 [0.491, 0.681] | 0.479 [0.418, 0.562] | 0.087 [0.051, 0.125] | 0.077 [0.053, 0.101] |
| MultiUS, Llama-3-8B, τ = 0.6 (selection rule) | 0.624 [0.527, 0.705] | 0.589 [0.522, 0.668] | 0.108 [0.071, 0.159] | 0.094 [0.068, 0.126] |
| UserLM-8b, no intent | 0.066 | 0.044 | 0.012 | 0.011 |
| UserLM-8b + intent + guardrails | 0.764 [0.704, 0.822] | 0.548 [0.459, 0.617] | 0.087 [0.056, 0.124] | 0.066 [0.054, 0.082] |
Every Qwen–Llama difference is within its CI. On UserLM-8b's own backbone, MultiUS shows the same picture as on Qwen: far ahead of UserLM-8b without an intent, behind it with an intent and guardrails on WildChat first turns (−0.159 [−0.293, −0.061] for τ = 0.3), and within the CIs over whole conversations and on PRISM (τ = 0.6 is ahead on PRISM over whole conversations, +0.028 [+0.005, +0.060]). The results are not due to Qwen3.5 being a newer model.
We thank you for your constructive feedback and apologize for the late reply. We thank you in particular for your evaluation metrics suggestions. We actually learned something new about our approaches behavior.
First, we would like to clarify our thinking for our choice of the ΔlogPPL metric scored by Mistral-7B. It measures the average difference in log perplexity, as computed by an external model, between real user utterances and utterances generated by the simulator. We introduced this metric because it directly compares samples generated by each simulator, allowing us to avoid bias introduced by teacher-forcing and to directly measure the quality of outputs. The choice of Mistral, therefore, was made to have a “neutral” model. If we have chosen Qwen, it would naturally assign more probability to its own utterances as opposed to human ones, penalizing MultiUS. And similarly, choosing Llama3-8B would penalize UserLM-8B.
Self-perplexity. As you suggested, we measured how likely each simulator finds real users' messages: the teacher-forced negative log-likelihood of the user turns of real conversations (per byte of user text so that different tokenizers compare) on 1,000 WildChat evaluation conversations and the 8,001 PRISM conversations. MultiUS's is a variational model, so we decided to marginalize its latent variable over 64 prior samples. Values are differences from the frozen Qwen3.5-4B backbone (so that we compare it against a weak simulator, as a floor), next to first-message MAUVE:
We can see that UserLM-8b assigns real user text clearly higher likelihood than MultiUS. We interpret that it covers the distribution of user text better than a bounded perturbation of a frozen 4B model.
How we think it compares to MAUVE and register Self-perplexity measures how well a model covers real users' text when given it, while MAUVE and register measure the text a simulator samples, which is how a simulator is actually used. In our measurements, the metrics rank systems in nearly opposite order. Without an intent, UserLM-8b has the best likelihood on WildChat and a first-message MAUVE of 0.066, most of its first turns running into repetition loops, while LoRA e0 has the best likelihood on PRISM and MAUVE 0.29. Running with an intent, UserLM-8b's two numbers in opposite directions: MAUVE rises elevenfold and its likelihood advantage shrinks. In MultiUS’ side, the steering strength τ shows the same trade-off: at τ = 0.3 it assigns real text higher likelihood than its backbone (−0.025 [−0.031, −0.020] at l₀ = 15, −0.064 [−0.070, −0.058] at l₀ = 7) at the “price” of having a register further from human. Additionally, across all eight grid configurations, self-perplexity follows the order of the held-out CE margin exactly, and the reverse of the register criterion with one exception.
The UserLM-8b setup that matches MultiUS on MAUVE is the one with an intent. Its likelihood lead is large on WildChat (−0.122 vs +0.025) (which is its training corpus), and small on PRISM, which neither model was trained on (−0.002 vs +0.017). The two also tie on first-message MAUVE (0.088 vs 0.083) there. It gets there with a model twice the size, fully fine-tuned, an intent written by a frontier model for every conversation, and sampling guardrails.
Where MultiUS loses likelihood : We admit we were surprised by the overall metrics (MultiUS performing worse than Qwen3.5-4B, while the differences between both models were very obvious when chatting with them), but after looking at length, it revealed our approach predicts short messages well (−0.135 nats/byte under 40 bytes on WildChat, −0.090 on PRISM) and long, well-formed ones very badly. This result is not surprising, as activation steering likely degrades the model’s capabilities beyond the training objective, and we have mostly removed long messages from our training dataset (so predicting well-formed prose, code, etc. gets degraded). Additionally, long messages dominate a per-byte average. MultiUS is better than its backbone in 53% of conversations on both corpora. We have created a “Self-Perplexity of Real User Text” annex with the full tables and analysis.