- Rating
- 1
- Confidence
- 3
- Informativeness
- 2
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
This paper studies whether personalization can be represented by compact activation states rather than user-specific weight updates. It proposes DOPAMINE, which learns one additive residual vector per transformer layer for each user while keeping the backbone frozen. On synthetic style preferences across three model families and seven model/scale settings, DOPAMINE achieves accuracy close to LoRA-r8 with 140–215× fewer per-user parameters. On an Amazon-review rating prediction task, it also obtains comparable accuracy and lower held-out cross-entropy. The paper further reports unsuccessful multiplicative gating and PCA compression experiments, and describes how the per-user vectors can be selected row-wise in a shared batch.
Critical strengths
- The paper proposes a simple and parameter-efficient personalization interface. The main result is interesting: a small additive mode can match the observed performance of much larger LoRA adapters on the tested tasks. The 140–215× reduction in per-user parameters is meaningful for storing a large number of user profiles, even though an end-to-end serving speedup has not been demonstrated.
- The paper evaluates multiple model families and sizes, includes a three-seed comparison on SmolLM2, and tests both controlled styles and Amazon review histories. I also appreciate the negative results for gating and PCA compression, as well as the authors' care in distinguishing observed accuracy, storage savings, and actual serving performance.
Critical weaknesses
- Limited novelty and incomplete comparisons. The proposed intervention is essentially a form of per-user bias-only adaptation, and the paper acknowledges that closely related layer-wise additive interventions already exist (e.g., Sinii et al., 2025). The contribution is therefore primarily empirical, but the comparison focuses heavily on LoRA. Baselines such as BitFit, prompt/prefix tuning, and personalized representation steering would help establish whether this is a particularly effective interface rather than simply a smaller adaptation method. In addition, the fixed 60-step protocol and learning rates do not establish a well-tuned LoRA baseline. This matters especially because LoRA performs worse than the frozen model on the supplementary review-language-modeling task (Appendix B.4).
- The evaluation does not yet convincingly establish broader personalization ability. The synthetic task covers only a few surface-level style rules, and most cross-model results use just 30 users and one seed. For the Amazon rating task, the review text itself may reveal the rating, while per-user majority-rating and shuffled-history controls are missing. It is therefore difficult to tell how much of the improvement comes from learning individual user preferences rather than sentiment cues or label priors. More realistic personalization tasks or stronger user-history controls would substantially strengthen the main claim.
Questions for authors
- Could the authors provide a more carefully tuned LoRA comparison (e.g., learning-rate and training-step sensitivity), and ideally compare with another compact personalization baseline such as bias-only tuning or personalized steering? This would help clarify the strength of the parameter-efficiency result.
- For the Amazon rating task, how does DOPAMINE perform against per-user majority-rating, no-history, and shuffled-user-history controls? These would help establish whether the learned vectors capture user-specific preferences.
- For the PCA compression experiment, what happens if the fully trained modes are directly projected onto the PCA basis, rather than learning the low-dimensional codes from scratch? This would help distinguish a representational limitation from an optimization issue.
6 comments
(2/4)
J1 / JQ1 (continued).
- Tuned LoRA (synthetic; App C). We selected learning rate (1e-4 to 2e-3) and steps (30 to 240) for LoRA-r8, and learning rate (3e-3 to 3e-2) on the same step grid for Dopamine, on 30 validation users. LoRA is insensitive to this grid: 17 of its 20 configurations score 0.941-0.943 on validation, and the submitted default (lr 5e-4, 60 steps) is one of four tied for the best (0.943; the tie-break on validation CE picked lr 1e-4 with 120 steps). On 100 test users x 3 seeds, tuned Dopamine reaches 0.943 and tuned LoRA-r8 0.944, diff -0.001 [-0.002, +0.000]; tuning helped Dopamine (+0.004 [+0.002, +0.006]), not LoRA (-0.001 [-0.002, +0.000]). At the default protocol, 0.939 vs 0.945 (diff -0.006). Both are inside the +-0.02 equivalence margin, at 141x fewer parameters per user.
- Amazon review LM (App B.4). You were right: the submitted LoRA (CE 5.41; 5.394 in our rerun of that protocol) was overfitting with the default 60 steps. With learning rate and steps selected on validation users, LoRA-r8 reaches 2.865 (same learning rate, 15 steps, the edge of the grid) and Dopamine 2.904, both far below the frozen model's 3.506. App B.4 reports the tuned comparison.
J2. Broader personalization ability.
- Real long-form personalization (Sec 6.4, Table 5, App B.3): LongLaMP product reviews with Qwen2.5-1.5B-Instruct, 93 users (we removed 7 whose target appears near-verbatim in the profile; one seed). Dopamine reaches 0.145 ROUGE-L, against 0.108 for the frozen model, 0.130 for BM25 retrieval of four profile items, 0.118 for StyleVector, and 0.129 for both a pooled vector and another user's vector; each of these paired CIs excludes zero. Prompt tuning with Dopamine's parameter count (at Dopamine's learning rate, no sweep) is level with it (0.142, diff +0.003 [-0.004, +0.010]), and per-user LoRA-r8 reaches 0.153 (diff -0.008 [-0.014, -0.001]) with 215x Dopamine's parameters. Asking the frozen model for the user's median review length reaches 0.135 (diff +0.010 [0.001, 0.019]) and a higher METEOR, so part of the gain is output length. Dopamine gains less with Qwen2.5-7B-Instruct, where it beats the frozen model only on ROUGE-L, and BM25 retrieval and StyleVector are level with it on ROUGE-L and lead it on ROUGE-1 (BM25 also on METEOR), and on topic writing, where with the 7B model it falls below the frozen model on ROUGE-1 and METEOR.
- Beyond fixed rules, across scales (Sec 6.5, Table 6, App B.5): in a variant where each user's format and verbosity change with the subject (held-out subjects; 5 backbones, 0.36B-7B, up to 60 users x 2 seeds), methods do not saturate (the reference targets, cut to the 64 generated tokens, score 0.94-0.96), and LoRA-r8 leads at every size, by 0.028 (7B) to 0.088 (0.36B), with the gap narrowing from 0.049 to 0.028 within Qwen2.5 and changing little within Llama-3.2 (0.070 to 0.063), and still by 0.025-0.043 after tuning Dopamine's learning rate on four backbones (LoRA not re-tuned). On SmolLM2, bias tuning, LN-tuning and (IA)3, at their fixed-style learning rates, also lead tuned Dopamine, by 0.036-0.039 (40 user-seeds).
- Seeds and users: the main synthetic comparison (Dopamine, LoRA-r8 and six baselines) uses 100 users x 3 seeds, matched across these methods. We also reran the original task at Qwen2.5-7B and Llama-3.2-3B with 100 users x 2 seeds (App B.1): Dopamine minus LoRA-r8 is +0.0001 and -0.0013, with both methods at the 64-token score of the reference targets (0.955). The other four cross-model cells stay at 30 users x 1 seed (v1, Table 3).
- User-specific preferences rather than generic rule compliance (Sec 6.3, App B.2): another user's vector drops synthetic accuracy from 0.939 to 0.305, the frozen level (own minus other +0.634 [0.607, 0.659]), one vector trained on all 100 users reaches 0.327, and accuracy under a borrowed vector rises with the preference axes the two users share (0.037 with none, 0.714 with four).
(3/4)
JQ2. Amazon controls: majority rating, no history, shuffled history (Sec 6.2, 6.3). Paired over users (SmolLM2 300 users, Qwen2.5-1.5B 150 users), rating accuracy (Table 4 has every row except the in-context one, which is in the supplement's result tables):
| Control | SmolLM2 | Qwen-1.5B |
|---|---|---|
| Dopamine, own history | 0.723 | 0.727 |
| Per-user majority rating | 0.687 | 0.698 |
| Global majority rating (5 stars) | 0.674 | 0.700 |
| No user history: one vector trained on 1,000 other users | 0.738 | 0.583* |
| No user history: one LoRA-r8 trained on 1,000 other users | 0.754 | 0.617* |
| That pooled vector + 60 steps on the user's own history | 0.746 | 0.723* |
| Frozen model, not adapted | 0.539 | 0.223 |
| Frozen model + 8 history reviews in context | 0.704 | 0.704 |
| Shuffled history: Dopamine trained on another user's history | 0.579 | 0.654 |
*Our Qwen pooled models are under-trained (best validation accuracy below the per-user majority rule), so that comparison is inconclusive.
A state carries its owner's ratings: trained on another user's history, it loses 0.143 [0.110, 0.178] accuracy on SmolLM2 and 0.073 [0.027, 0.119] on Qwen-1.5B. Five-star ratings make up 67-70% of the test labels; Dopamine beats each user's own majority rating by +0.035 [0.015, 0.055] accuracy on SmolLM2 and +0.028 [0.001, 0.055] on Qwen, and lowers MAE by 0.133 and 0.138; on Qwen its gain over the global five-star rule, +0.027 [-0.005, +0.059], is not significant. The no-history control you asked for shows that on SmolLM2 general task adaptation suffices for this accuracy: a state trained without the user's history is at least as accurate (pooled vector minus Dopamine +0.016 [-0.006, +0.038]). The best Dopamine state starts from that pooled vector and takes the 60 per-user steps (0.746, +0.024 [0.008, 0.040] over per-user Dopamine). The per-user step adds +0.008 [-0.012, +0.028] on average and +0.041 [0.005, 0.077] for the third of users whose mean rating is farthest from the pool's, the only third where the per-user step helps significantly (App B.2; the trend across thirds is not significant). By our rule (App A.3: own state beats both another user's and a pooled state), the states are user-specific on synthetic styles and LongLaMP product reviews; on Amazon with SmolLM2 they carry the owner's ratings, but a shared state is as accurate on average (Qwen: inconclusive).
JQ3. Direct projection of trained modes onto the PCA basis (Sec 7.3, Table 9). Thank you; this question led us to the cause of the submitted failure. The submitted code model loaded only the basis of the centered modes and never added the across-user mean, which carries 36.6% of the modes' squared norm (the centered span captures 19.7% of it), and it trained the codes with a learning rate of 1e-2.
- Direct projection, no training (100 users, k=64): with the mean added back and a basis fit to the other 99 users, 0.802; with an in-sample basis, 0.927 (full mode 0.936). Without the mean, even the in-sample basis gives 0.447.
- Re-optimized codes, learning rate chosen on validation users (1, i.e. 100x the submitted one), basis fit to other users: in the form mean + basis, 64-dim codes reach 0.926 vs 0.927 for the full mode (codes minus full mode -0.001 [-0.005, +0.003], 60 users); in the submitted form, 0.806.
So the submitted result reflected the missing mean and the step size, not a lack of low-dimensional structure: a user can be stored as 64 trained numbers over a mean and basis fit to other users. The submission's 96%-of-variance figure for the 64-dim basis was computed after removing that mean, which the submitted codes could not represent.
(1/4)
Thank you for a precise and fair review. You were right that the Amazon review-LM LoRA was untuned and that the Amazon controls were missing; both are answered below with measured results, and section, table and appendix numbers refer to the uploaded PDF. Synthetic accuracies use a corrected scorer (v2; Sec 5.1, App A.2), which is why they are higher than in the submission; the last paragraph of (4/4) notes why other numbers differ.
Protocol: quality comparisons are paired on the same users; each trained compact baseline in Table 1 takes its learning rate from a sweep on validation users; the tuned synthetic and Amazon comparisons select learning rate and steps of both Dopamine and LoRA-r8 on validation users, and other per-user Dopamine and LoRA runs keep the submitted protocol (60 steps; lr 1e-2 and 5e-4) unless stated; equivalence means that the 90% CI of the paired difference lies inside +-0.02, a margin fixed before any new run; brackets are 95% paired bootstrap CIs over users, and diff is Dopamine minus the other method.
J1 / JQ1. Novelty, baselines and a tuned LoRA. We agree the operator itself is not new and that the contribution is empirical, but the closest works do not test what we test. Sinii et al. (2025) train the same per-layer vectors with reinforcement learning, one set per task, to elicit reasoning; BitFit tunes the bias terms of an encoder per task. Neither uses the vectors as a per-user state, compares them with per-user LoRA, or batches users. Used per user, the state shows four things: learning it is what matters (on the same 100 users, a gradient-trained vector per layer 0.936, a contrastive vector of the same shape 0.456, StyleVector 0.368, frozen 0.336; Sec 6.1); it matches per-user LoRA-r8 on stable preferences at 141x fewer parameters; users become points in a shared space, so 64 trained numbers per user over a mean and basis fit to other users match the full 30,720-number state (0.926 vs 0.927, 60 users, synthetic styles; Sec 7.3); and 64 distinct users decode in one batch at 0.96-0.97 of frozen throughput, against 0.63-0.69 for per-row LoRA-r8 (Sec 8). The baselines you asked for are in Table 1. On fixed styles, at about 30K parameters, training the state on the user's text matters more than its form; Amazon ratings separate the forms.