acceptodds
Under review as a conference paper at ICLR 2027

Preference-Aware Rubric Learning for Personalized Evaluation

Abstract

As Large Language Models (LLMs) evolve from general-purpose assistants to user-centric agents, personalization has become central to aligning model behavior with individual preferences, making the evaluation of personalized alignment a critical bottleneck. Existing evaluation methods—ranging from automatic metrics to LLM-as-a-judge approaches—fail to capture subjective, user-specific preferences embedded in long-term interaction histories. We identify three essential principles for reliable and effective personalized evaluation: Representativeness, User-Consistency, and Discriminativeness. To address these principles, we introduce Personalized Evaluation as Learning, a paradigm that formulates personalized evaluation as a learning problem rather than a static judgment. Under this paradigm, we propose PARL (Preference-Aware Rubric Learning), a framework that learns to induce preference-aware evaluation rubrics directly from raw user histories and performs a self-validation mechanism to ensure consistency with the user’s preferences. PARL integrates rubric induction with a discriminative reinforcement learning objective that contrasts user-authored responses against competitive personalized model outputs, enabling the learned rubrics to capture precise, user-specific decision boundaries. Experiments on real-world personalized text generation tasks show that PARL consistently induces high-fidelity rubrics that reliably identify user-aligned responses and generalize across users and tasks, while capturing stable stylistic preferences and fine-grained evaluative patterns. To ensure reproducibility, our code is available at https://anonymous.4open.science/r/PARL-1909.

Primary area:
generative models
Keywords:
LLM Personalization, Evaluation

Reviews

Among:
Shape:
1234this paper, Top 49%
Figure 1. Mean review rating of the reviewed papers at ICLR 2027. This paper averages 2.33 over 3 reviews, above 51% of the others.
Reviewer_RcftOpenReview ↗
Rating
2
Confidence
3
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper proposes PARL, a framework for the evaluation of personalized LLM outputs that learns preference-aware evaluation rubrics from user histories. Using an LLM as a rubric generator, PARL combines rubric induction and rubric consistency validation with a discriminative reinforcement learning objective to capture user-specific preferences and improve the discriminative power of the generated rubrics. Experiments show that PARL-generated rubrics better differentiate user-authored ground-truth responses from personalized baseline outputs, demonstrating that the learned rubric generator effectively captures user-specific preferences.

Critical strengths
  1. This paper addresses an important problem. Evaluating personalized LLM outputs using user-specific rubrics is well-motivated.

  2. Framing user-specific rubric formulation as a learnable generation problem is well-motivated. The methodology, including rubric induction, consistency validation, and RL, is well-structured.

  3. The improvement in user coverage, from around 49-87% for the baseline methods to 99-100% for PARL, is substantial and demonstrates the overall effectiveness of PARL. The ablation studies further demonstrate the effectiveness of the key components of PARL, and the experiments on out-of-domain category also demonstrates that PARL generalizes across datasets.

Critical weaknesses
  1. In this paper, the operational definition of personalized alignment is whether user-authored ground-truth responses have a higher accuracy than baseline responses under the generated rubrics. While this definition is a reasonable and practical proxy, there is no independent validation showing that it is indeed consistent with real human preferences. For example, is it possible that a human user would rank an SFT+GRPO response on par with their own response, given that preferences can be subjective and multi-dimensional? To demonstrate that PARL truly captures user preferences, a user study comparing the rankings of responses induced by PARL-generated rubrics with human rankings would provide a stronger validation beyond the current accuracy metrics alone.

  2. The rubric generator is trained only using Qwen3-8B, and the zero-shot generators used as baselines are almost all from the Qwen family (except GPT-4o-mini in Table 7). It is thus unclear whether the PARL pipeline generalizes to other model families or scales, and how its discriminative power varies with model backbone choice.

Questions for authors

Please refer to weaknesses.

2 comments

Dear Reviewer,

We sincerely appreciate your invaluable comments on our work. We have carefully considered all your concerns and have provided detailed responses below.


R1: User study

Thank you for this important suggestion. To directly validate whether PARL's rubric-based judgments align with real human preferences, we conducted a human evaluation on the Amazon Review Generation task. We recruited 5 human evaluators and sampled 20 different test cases for every evaluator. For each case, evaluators were provided with (i) the target item to be reviewed, (ii) the target user's historical profile (past reviews), and (iii) two anonymized and randomly ordered candidate responses (the SFT+GRPO output and the user's actual ground-truth review), without access to their sources, PARL's rubrics, or PARL's scores. Evaluators were asked to judge which response better reflects the target user's preferences and writing style, or indicate a tie if they are on par. We then compared these human judgments against the judgments produced by PARL-A.

Across the 100 cases, human evaluators preferred the user-authored ground-truth response in 90 cases (90%), preferred the SFT+GRPO response in 3 cases (3%), and indicated a tie in 7 cases (7%). Meanwhile, PARL-A preferred the user-authored response in 73 cases (73%), preferred the SFT+GRPO response in 6 cases (6%), and indicated a tie in 21 cases (21%). On decisive (non-tie) judgments, human evaluators selected the ground-truth response in 96.8% of cases (90/93), and PARL-A similarly selected the ground-truth response in 92.4% of cases (73/79). These results suggest that, in the human study, user-authored responses remain clearly distinguishable from SFT+GRPO-generated outputs, and that PARL aligns well with human preferences in direction whenever it makes a decisive judgment.

R2: Generalization to a different rubric generator backbone

Thank you for raising this concern. To explore whether the PARL pipeline generalizes to other model families or scales, we trained an additional PARL-A rubric generator initialized from Gemma-2-9B-it on the Amazon Review dataset and evaluated it using the same protocol. In addition, we also performed paired t-tests to examine whether GT responses achieve significantly higher user-level accuracy than competitive baselines across five runs.

Text sourceUser-level accuracy
Ground truth (GT)0.9156* ±\pm 0.0009
NON0.3362 ±\pm 0.0015
RAG0.3944 ±\pm 0.0015
NON-THINK0.3537 ±\pm 0.0009
RAG-THINK0.4861 ±\pm 0.0016
SFT0.7901 ±\pm 0.0006
GRPO0.8686 ±\pm 0.0022
SFT+GRPO0.8921 ±\pm 0.0010

The Gemma-based generator achieves 99.51% user coverage and a Max-Diff of 2.35 percentage points, measured between GT and the strongest generation baseline, SFT+GRPO. GT scored significantly higher than all competitive baselines in paired t-tests across the five runs; all comparisons remained significant. These results provide evidence that PARL's ability to distinguish authentic user texts from generated outputs extends beyond the Qwen generator family.

We additionally evaluated Gemini-3.8-Flash, DeepSeek-v4.1-Flash, and GPT-6-luna using the same generation prompts, candidate-generation procedure, historical consistency filter, and Qwen3-235B judge as our existing prompting baseline.

Text sourceGemini-3.8-FlashDeepSeek-v4.1-FlashGPT-6-luna
GT0.87590.90190.8913
NON0.52190.45460.4814
RAG0.59690.52260.5699
NON-THINK0.49210.44730.5039
RAG-THINK0.60510.54060.6424
SFT0.82780.83630.7932
GRPO0.86870.91500.9262
SFT+GRPO0.86720.91360.9129
Max-Diff+0.0072-0.0131-0.0348

Full-target user coverage is 92.73%, 91.84%, and 97.28%, respectively. Gemini achieves a small positive Max-Diff, whereas DeepSeek and GPT score GRPO and SFT+GRPO above GT. Thus, stronger prompting-only backbones do not consistently produce more discriminative rubrics under this protocol.

Together, these experiments broaden our backbone evaluation and support the applicability of RL-based rubric learning beyond Qwen3-8B. We will include these results in the revision.

AuthorsOpenReview ↗

Follow-up on Our Response and Revision

Dear Reviewer,

Thank you again for your time and thoughtful feedback. We have provided detailed responses to address your concerns and added the following experiments and clarifications, with the revised manuscript highlighted in blue:

  • User study: An additional human preference study on 100 Amazon Review cases (Appendix H).
  • Generalization beyond the Qwen family: An additional PARL-A rubric generator initialized from Gemma-2-9B-it and trained on Amazon Review, evaluated using the same protocol. We report user coverage, Max-Diff, and results from five runs with paired significance tests (Appendix G.6, Table 8).
  • Stronger prompting baselines: Gemini-3.8-Flash, DeepSeek-v4.1-Flash, and GPT-6-luna, evaluated with the same historical consistency filter and judge (Appendix G.7, Table 9).

As the discussion deadline approaches, we would greatly appreciate any further feedback and welcome continued discussion.

Best regards,

The Authors

Reviewer_AqRvOpenReview ↗
Rating
3
Confidence
3
Informativeness
2
Presentation
2
Soundness
2
Read review
Paper summary

The paper reframes personalized evaluation as a learning problem. PARL trains a rubric generator that reads a user's past writing and produces a small set of explicit, binary rubrics describing that user's preferences. A rubric is kept only if it is consistent with the user's history. The generator is then refined with GRPO using a reward that separates the user's real held-out text from strong personalized generation baselines. On Amazon reviews, Reddit posts and news headlines, the learned rubrics consistently score the user's own text above model outputs and cover about 99% of users, compared with 49–87% for zero-shot rubric induction. This is a timely contribution: personalization research lacks good evaluation tools, and an interpretable, per-user rubric is useful for benchmarking personalized generation.

Critical strengths

The method design is well motivated by its own ablations. The PARL-0 control shows that optimizing for fidelity alone collapses to permissive rubrics that pass everything, which justifies the contrastive reward. The learned generator also produces compact rubric sets (about 4–5 per user) with much higher user coverage than zero-shot prompting.

Critical weaknesses

The evidence that the rubrics capture personal preference, rather than general differences between human-written and model-written text, could be stronger. The current validation is that a user's text scores above model outputs, which a general human-vs-model signal would also produce. Some of the example rubrics in Fig 5 (e.g. contractions, informal run-on sentences) look like such general cues.

Two additions would make the claim much more convincing. 1, a cross-user test: do user A's rubrics prefer A's held-out text over other users' real text from the same domain? 2, even a small study comparing PARL scores with human or user preference judgments.

Questions for authors

When a user's rubrics are applied to other users' real text from the same domain, do they still prefer the target user's own held-out text, and by how much compared with the margin over model outputs? This can help show directly how much of the signal is user-specific.

2 comments

Dear Reviewer,

We sincerely thank you for your encouraging comments on our work. We value the opportunity to address the weaknesses and questions you kindly raised and to further enhance the quality of our work.


R1: Cross-user test

To assess whether the induced rubrics capture user-specific preferences rather than general human writing patterns, we conduct a cross-user evaluation on Amazon Review dataset. For each user, we randomly assign rubrics induced for other users to evaluate their authentic responses.

Rubric settingPARL-A pass ratePARL-B pass rate
Target user's own rubrics0.93100.9300
Randomly sampled other-user rubrics0.29900.2230
Decrease0.63200.7070

In this context, lower accuracy signifies higher user specificity, confirming that our framework successfully generates user-specific, preference-aware rubrics meticulously tailored to the target individual.

R2: User study

To examine how well PARL's rubric-based judgments align with human preferences, we conducted a human evaluation on the Amazon Review Generation task. We recruited 5 human evaluators and sampled 20 different test cases for each evaluator (100 cases in total). For each case, evaluators were provided with (i) the target item to be reviewed, (ii) the target user's historical profile (past reviews), and (iii) two anonymized and randomly ordered candidate responses (the SFT+GRPO output and the user's actual ground-truth review), without access to their sources, PARL's rubrics, or PARL's scores. Evaluators were asked to judge which response better reflects the target user's preferences and writing style, or indicate a tie if they are on par, and we compared their judgments against those produced by PARL-A.

Across the 100 cases, human evaluators preferred the user-authored ground-truth response in 90 cases (90%), preferred the SFT+GRPO response in 3 cases (3%), and indicated a tie in 7 cases (7%). Meanwhile, PARL-A preferred the user-authored response in 73 cases (73%), preferred the SFT+GRPO response in 6 cases (6%), and indicated a tie in 21 cases (21%). On decisive (non-tie) judgments, human evaluators selected the ground-truth response in 96.8% of cases (90/93), and PARL-A similarly selected the ground-truth response in 92.4% of cases (73/79). These results suggest that, in the human study, user-authored responses remain clearly distinguishable from SFT+GRPO-generated outputs, and that PARL aligns well with human preferences in direction whenever it makes a decisive judgment.

AuthorsOpenReview ↗

Follow-up on Our Response and Revision

Dear Reviewer,

Thank you again for your time and thoughtful feedback. We have provided detailed responses to address your concerns and added the following experiments and clarifications, with revisions highlighted in blue in the manuscript:

  • Cross-user evaluation: An additional experiment applying other users’ rubrics to authentic target-user responses on Amazon Review (Section 5.4.3, Figure 4).
  • User study: An additional human preference study on 100 Amazon Review cases (Appendix H).

We welcome further discussion and appreciate your continued feedback.

Best regards,

The Authors

Reviewer_PY76OpenReview ↗
Rating
2
Confidence
2
Informativeness
2
Presentation
3
Soundness
2
Read review
Paper summary

This paper introduces a new method for evaluating response personalization for LLM generated text. The authors mention that current personalization evaluation approaches, including automatic metrics (like ROUGE), human annotators, and standard LLM judges, do not capture user-specific preferences and may not be interpretable. The paper proposes 3 dimensions / principles for personalization evaluation: Representativeness, User-Consistency, and Discriminativeness. In order to address gaps in the current evaluation methodology along these dimensions, the paper introduces PARL, a framework that learns to generate user-specific evaluation rubrics from a user’s history. The paper itself primarily focuses on writing style preferences. A rubric generator first proposes candidate rubrics from a sample of the user’s past writing and keeps only those satisfied by all of these samples. The rubrics generator is then trained with reinforcement learning using a reward that favors rubrics under which the user’s own written text scores higher than outputs from different personalized generation methods. The final response score is based on the fraction of rubrics that passed. In order to evaluate the effectiveness of these rubrics, the paper compares scores on the user text to scores on 7 different personalized generation methods. Experiments using Qwen3-8B for rubric generation on Amazon reviews, Reddit posts, and news headlines tasks show that the learned rubrics give the user’s own text the highest pass rate compared with the model-generated texts and can produce valid rubrics for unseen users in an unseen Amazon category. The primary finding of the paper is that training a rubric generator to separate a user’s own writing from model outputs produces more discriminative and more broadly applicable rubrics than prompting the same model family directly.

Critical strengths

Overall, the paper tackles an important problem that is still quite challenging and under-explored: how do we most effectively measure generated text personalization in a scalable fashion? They propose an interpretable rubric-based approach and a clear set of design principles. Key strengths include:

  1. The rubric formulation is interpretable and practical. Each rubric is a single, checkable criterion, which makes the evaluation easier to interpret than an overall score from a reward model or a holistic LLM judge approach. The three principles are well-motivated and give a useful framework for thinking about what personalized evaluation should cover.
  2. By training the rubrics generator using the method proposed in the paper, the paper shows that the rubrics from the trained model are more usable and discriminative than those from prompting models (Qwen3-8B and Qwen3-235B) alone, producing valid rubrics for 99% or more of users instead of only 49-87% of users.
  3. The PARL-0 baseline is a useful one to motivate the need for the discriminative margin objective, as it shows poor discriminative behavior across the different generation approaches and user text.
Critical weaknesses
  1. The evaluation metric of the rubrics quality seems limited. The results really only show that the user’s own text scores highest as compared to generated text and does not use rubrics to evaluate any kind of annotated preference pairs. It would be useful to show agreement with human or user preference judgments. Additionally, a comparison with previous personalized evaluation approaches, such as ExPerT (reference-based) or the reference-free, rubric-based PREF, would be informative.
  2. The paper claims that prompting LLMs only underperforms. But this seems to be inadequately tested. The main content reports on prompted metrics from Qwen3-235B-A22B and the appendix considers some other models like GPT-4o mini It is unclear why state-of-the-art closed models (e.g. GPT-5 or Claude Sonnet/Opus models) or more recent open-weight models (e.g. Qwen3.5) are not used. It may be that more powerful models are able to better generate rubrics in a prompting-only setting. Consider using a frontier model with the same consistency filter as well as a contrastive prompting baseline that shows the model the user’s texts alongside a few AI-generated outputs and asks for rubrics that discriminate between them. This would show whether the RL training itself is needed.
  3. While the paper seems to target personalization evaluation more broadly, the three tasks evaluated on seem to focus mostly on user writing style as opposed to more broad personalization preferences. Evaluating on preference data (e.g. chosen and rejected responses) would better match the paper’s framing.
  4. The paper claims the rubrics generalize across users and tasks, but transfer to new tasks is never tested, since a separate rubric generator is trained for each task. Generalization to new users is also only tested in a single experiment on an unseen Amazon category, as the train and test splits of the main experiments contain the same users.
Questions for authors
  1. Clarification: Since the rubrics are trained to separate the user’s own text from AI outputs, they may capture human vs. AI writing style rather than this user’s preferences. How often do another user’s authentic texts pass a given user’s rubrics?
  2. Clarification: For the benchmarks reported in the paper, why were only certain tasks reported, e.g. only topic writing from LongLaMP, news headlines from LaMP, and two Amazon categories (Movies_and_TV and Books)?
3 comments
AuthorsOpenReview ↗

Response to Reviewer PY76 (1/2)

Dear Reviewer,

Thank you for the detailed and constructive feedback! We value the opportunity to address the weaknesses and questions you kindly raised and to further enhance the quality of our work.


R1: Comparison with existing methods (W1)

Thank you for this point. PARL differs from prior approaches in three main aspects:

  • Reference-free evaluation: Unlike ExPerT [1], PARL does not require a reference response at evaluation time.
  • Reusable criteria: Whereas ExPerT and PREF [2] derive evaluation criteria for specific inputs, PARL aims to generate user-specific rubrics reusable across generation instances.
  • Learned rubric generation: Rather than relying solely on prompting or aspect extraction, PARL uses reinforcement learning to learn preference-aware rubric generation.

We will include more details in the revision.

R2: User study (W1, W3)

Thank you for this suggestion. To examine how well PARL's rubric-based judgments align with human preferences, we conducted a human evaluation on the Amazon Review Generation task. We recruited 5 human evaluators and sampled 20 different test cases for each evaluator (100 cases in total). For each case, evaluators were provided with (i) the target item to be reviewed, (ii) the target user's historical profile (past reviews), and (iii) two anonymized and randomly ordered candidate responses (the SFT+GRPO output and the user's actual ground-truth review), without access to their sources, PARL's rubrics, or PARL's scores. Evaluators were asked to judge which response better reflects the target user's preferences and writing style, or indicate a tie if they are on par, and we compared their judgments against those produced by PARL-A.

Across the 100 cases, human evaluators preferred the user-authored ground-truth response in 90 cases (90%), preferred the SFT+GRPO response in 3 cases (3%), and indicated a tie in 7 cases (7%). Meanwhile, PARL-A preferred the user-authored response in 73 cases (73%), preferred the SFT+GRPO response in 6 cases (6%), and indicated a tie in 21 cases (21%). On decisive (non-tie) judgments, human evaluators selected the ground-truth response in 96.8% of cases (90/93), and PARL-A similarly selected the ground-truth response in 92.4% of cases (73/79). These results suggest that, in the human study, user-authored responses remain clearly distinguishable from AI-generated outputs, and that PARL aligns well with human preferences in direction whenever it makes a decisive judgment.

R3: Stronger prompting baselines (W2)

Thank you for raising this point. To address this, we added Gemini-3.8-Flash, DeepSeek-v4.1-Flash, and GPT-6-Luna as prompting-only rubric generators on Amazon Review. All three use the same generation prompts, candidate-generation procedure, historical consistency filter, and Qwen3-235B judge as our existing prompting baseline.

Text sourceGemini-3.8-FlashDeepSeek-v4.1-FlashGPT-6-Luna
GT0.87590.90190.8913
NON0.52190.45460.4814
RAG0.59690.52260.5699
NON-THINK0.49210.44730.5039
RAG-THINK0.60510.54060.6424
SFT0.82780.83630.7932
GRPO0.86870.91500.9262
SFT+GRPO0.86720.91360.9129
Max-Diff+0.0072-0.0131-0.0348

Max-Diff is measured between GT and the strongest generation baseline. Full-target user coverage is 92.73%, 91.84%, and 97.28%, respectively. These additional experiments show that prompting with consistency filtering can distinguish GT from several generation baselines, but its discriminative capacity from the strongest baselines remains limited: Gemini achieves a small positive Max-Diff, while both DeepSeek and GPT assign higher scores to GRPO and SFT+GRPO than to GT. Thus, using stronger prompting models does not automatically yield discriminative rubrics for personalized evaluation. These results support the value of our RL-based design for learning more discriminative rubrics in personalized evaluation.

AuthorsOpenReview ↗

Response to Reviewer PY76 (2/2)

R4: Generalization to new tasks (W4)

Thank you for highlighting this. Our existing CDs_and_Vinyl experiment evaluates generalization to an unseen Amazon category. To further assess cross-task generalization, we additionally applied the Amazon-trained PARL-A generator to Topic Writing without target-task training, using the target-task prompt and user history.

Text sourceAmazon   ⟹  \implies Topic Writing
GT0.8587
NON0.1049
RAG0.2937
NON-THINK0.1330
RAG-THINK0.3284
SFT0.7303
GRPO0.6101
SFT+GRPO0.8393
Max-Diff+0.0194

These results extend our evidence from category-level generalization to a cross-task transfer setting, providing further support for the generalization capabilities of our method.

R5: Cross-user test (Q1)

Thank you for raising this concern. We conducted a cross-user evaluation on Amazon Review dataset using authentic human-authored responses. For each user, we randomly assign rubrics induced for other users to evaluate their authentic responses. Under these mismatched rubrics, the resulting pass rates of PARL-A and PARL-B drop to 29.9% and 22.3%, compared with 93.1% and 93.0% under the users' own rubrics. These correspond to decreases of 63.2 and 70.7 percentage points, respectively. These results suggest that PARL-generated rubrics capture characteristics of the target user's preferences, rather than merely reflecting generic differences between human-AI writing styles.

R6: Benchmark clarification (Q2)

Thank you for pointing this out. We selected three representative personalized text generation tasks to evaluate PARL. Amazon review generation has been widely studied in prior personalization work [3,4,5] and is also included in LongLaMP [6], making it our primary evaluation task. Following DPL's data-split configuration [3], we use Movies_and_TV and Books for the main experiments and reserve CDs_and_Vinyl for evaluating cross-category generalization. To further examine PARL's applicability across different generation settings, we additionally select news headline generation from LaMP and Reddit topic writing from LongLaMP, covering both short-form and long-form generation.

We agree that evaluating the remaining LaMP and LongLaMP tasks would strengthen the paper and provide a more comprehensive assessment. However, we are unable to complete these additional experiments within the rebuttal period. We will clarify the scope of the current evaluation and make every effort to include results on additional tasks in the revision.

[1] ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generation. 2025 ACL.

[2] PREF: Reference-Free Evaluation of Personalised Text Generation in LLMs. arxiv.

[3] Measuring What Makes You Unique: Difference-Aware User Modeling for Enhancing LLM Personalization. 2025 ACL.

[4] NextQuill: Causal Preference Modeling for Enhancing LLM Personalization. 2026 ICLR.

[5] CoPersona: Collaborative Persona Graphs for Robust LLM Personalization. 2026 KDD.

[6] LongLaMP: A Benchmark for Personalized Long-form Text Generation. arxiv.

AuthorsOpenReview ↗

Follow-up on Our Response and Revision

Dear Reviewer,

Thank you for your thoughtful feedback. We have provided detailed responses and added the following experiments and clarifications (highlighted in blue color):

  • User study: An additional human preference study on 100 Amazon Review cases (Appendix H).
  • Comparison with prior methods: An expanded methodological comparison with ExPerT, PREF, and other personalized evaluation approaches (Appendix B, Table 3).
  • Stronger prompting baselines: Gemini-3.8-Flash, DeepSeek-v4.1-Flash, and GPT-6-luna, evaluated with the same historical consistency filter and judge (Appendix G.7, Table 9).
  • Cross-task generalization: An additional Amazon-to-Topic transfer experiment without target-task training (not yet included; will be added later).
  • User specificity: Cross-user evaluation using other users' rubrics to assess authentic target-user responses (Section 5.4.3, Figure 4).

As the discussion deadline approaches, we would greatly appreciate your further feedback. Thank you again for your time and engagement, which have helped us improve the quality of our paper. We welcome further discussion.

Best regards,

The Authors

Comments on the paper

1 comment
AuthorsOpenReview ↗

Overall Response and Summary of Revisions

Dear Area Chair and Reviewers,

We sincerely thank the reviewers for their thoughtful evaluations and constructive suggestions. In this paper, we propose PARL (Preference-Aware Rubric Learning), a framework that formulates personalized evaluation as a learning problem and learns explicit, user-specific evaluation rubrics from historical context. As highlighted by the reviewers, our work addresses an important and under-explored problem in LLM personalization (PY76, AqRv, Rcft), provides an interpretable and practical evaluation framework (PY76, AqRv), and presents a well-motivated methodology supported by ablation studies (PY76, AqRv, Rcft). We appreciate the reviewers' feedback and summarize our additional experiments and revisions to address the remaining concerns below:


Human study (PY76, AqRv, Rcft).

We conducted a human study, demonstrating that user-authored responses remain clearly distinguishable from AI-generated outputs, and that PARL consistently aligns with human preferences whenever it yields a decisive judgment (Appendix H).

A non-Qwen backbone (Rcft).

We trained PARL-A with Gemma-2-9B-it, achieving 99.51% user coverage and a positive Max-Diff of 0.0235, extending our evaluation beyond the Qwen family (Appendix G.6).

Stronger prompting baselines (PY76, Rcft).

We additionally evaluated Gemini-3.8-Flash, DeepSeek-v4.1-Flash, and GPT-6-luna with the same consistency filter. Their Max-Diff values are +0.0072, -0.0131, and -0.0348, showing that stronger prompting alone does not consistently yield discriminative rubrics (Appendix G.7).

Cross-user evaluation (PY76, AqRv).

We added a cross-user test in which PARL-A/B pass rates decrease from 0.931/0.930 under users' own rubrics to 0.299/0.223 under other users' rubrics, providing additional evidence of user specificity (Section 5.4.3).

Cross-task transfer (PY76).

We applied the Amazon-trained PARL-A generator to Topic Writing without target-task training, obtaining a positive Max-Diff of 0.0194. This additional rebuttal experiment extends the original unseen-category evaluation.

Comparison with prior work (PY76).

We added a structured methodological comparison with ExPerT, PREF, and other personalized evaluators, clarifying reference requirements, rubric reusability, and learned generation (Appendix B).

Benchmark scope (PY76).

We clarified the task-selection rationale and the distinction between cross-category and cross-task generalization.


We respectfully believe that our revision addresses all reviewers' concerns and provide further evidence for PARL as a novel and practical approach to personalized evaluation. As the discussion deadline approaches, we have not yet received feedback on our rebuttal. We would greatly appreciate the reviewers' feedback and welcome further discussion. Thank you again for your time and insightful suggestions, which have helped us improve the manuscript. We hope you will consider our revision favorably.

From OpenReview, CC BY 4.0. Authors as signed there; shown unedited.

Related papers

Loading the map…

Discussion (0)

Sign in to comment.