- Rating
- 3
- Confidence
- 3
- Informativeness
- 3
- Presentation
- 3
- Soundness
- 3
Read review
Paper summary
This paper proposes UNO, a framework for improving LLM response quality using user interaction logs collected from real-world LLM systems. Specifically, UNO extracts feedback from user logs, converts it into rules and preference pairs, and performs clustering based on queries and rules. It then measures the cognitive gap of each cluster and either directly trains an Expert LoRA or trains a Critic LoRA that generates feedback to improve responses, which are then utilized through routing. Through experiments, this paper demonstrates that UNO outperforms existing RAG, memory-based methods, and training-based baselines.
Critical strengths
- Addressing an important problem: The problem addressed in this paper is highly important for the development of LLMs, and this work provides a valuable milestone toward solving it.
- Reasonable design choices supported by experimental results: The design choices that constitute the proposed method are reasonable and clearly presented. Furthermore, the effectiveness of each component is well demonstrated through experimental results, including Table 1.
- Addressing various concerns through extensive experiments: Efficiency issues, applicability to real-world data, and effectiveness in online settings are important aspects that need to be addressed given the characteristics of the proposed method. This paper effectively demonstrates the effectiveness of the proposed method in these aspects through extensive experiments, providing comprehensive evidence of its advantages.
Critical weaknesses
- Concerns about generalization to diverse tasks: I have concerns regarding whether the proposed method can generalize to diverse tasks, particularly regarding its hyperparameters and its reliance on embedding-based clustering.
- Threshold hyperparameter: In the proposed method, the number and granularity of clusters are determined by the distance threshold, which directly affects performance. Although MemoryBench and WildFB cover relatively diverse domains and tasks, I am concerned about whether the proposed method would require hyperparameter tuning whenever it is applied to new settings as it becomes more widely used.
- Concerns about environments involving multiple tasks: In realistic LLM systems, diverse and more tasks and user feedback coexist within a single environment, where many, different items may be densely distributed in the embedding space. Therefore, I am concerned about whether the proposed method can still operate effectively in such settings.
- Furthermore, since the current experiments involve relatively few clusters (2–4 per task), I believe additional experiments are needed to verify whether clustering and routing can still work effectively when more diverse logs are mixed together and the number of clusters increases.
Questions for authors
After reviewing the Appendix and code, it appears that the experiments on MemoryBench performed clustering and routing separately for each task group (e.g., Short-Long, etc.). Could you provide results when clustering and routing are performed jointly across all task groups?
3 comments
Thanks for your response and good work
All of my concerns have been addressed (especially regarding the joint UNO), and I believe this work is important and well-conducted. Therefore, I would like to maintain my recommendation to “accept” this work. To avoid any misunderstanding, I would like to clarify that my decision to maintain my recommendation without raising the score does not mean that the authors’ rebuttal failed to address my concerns; rather, it reflects my continued support for the acceptance of this work.
Thank you for your continued support of our work
Thank you for taking the time to read our response, and we are glad that our rebuttal and the joint UNO experiment have addressed all of your concerns. Your suggestion has meaningfully strengthened our paper, and we truly appreciate your positive assessment and continued support of our work.
Response to Reviewer 2Don
Thank you for the careful review and thoughtful questions. We address your questions below and have updated the manuscript accordingly.
1. Hyperparameter generalization
Thank you for raising this question. All experiments in our paper share the same default hyperparameters without any per-setting tuning. Specifically, key hyperparameters such as the clustering distance threshold, the outlier routing threshold, the cognitive gap threshold τ∗, and the verifier win-rate threshold γ (App. C.3) are kept identical across both base models, all four task groups, the joint experiment below, and WildFB, despite its very different distribution. We now state this explicitly in Sec. 4.3.
Tuning is unnecessary for two reasons. First, the key hyperparameters lie in wide stable ranges (Figs. 9 to 11). For example, the distance threshold has a clear plateau, and performance drops only at the extremes (a threshold of 2 with too few samples per cluster, or no clustering at all). Second, the two-stage filtering turns most hyperparameter errors into extra cost rather than lower quality. Noisy clusters that pass the gap filter are still blocked by the verifier, and poorly trained small clusters are absorbed by the Reflective Path, which is why full UNO is more robust than UNO-Single in Fig. 11.
2. Joint clustering over all task groups (and Question)
Following your suggestion, we merged the training logs of all four task groups and ran clustering, training, and routing jointly with Qwen3-8B and the same default hyperparameters. The per-task runs produce 2 to 4 clusters each (12 in total, Table 5), and the joint run automatically produces 11 clusters with the same threshold, without any manual adjustment.
Joint UNO outperforms Base and all baselines in Table 1 on every task group, raising the four-group average from 66.89 to 68.15 (and from 65.69 to 65.92 for UNO-Single). This suggests positive transfer from feedback patterns shared across tasks, and it confirms that clustering and routing generalize to a more diverse mixed setting without retuning. For much larger scales, App. E discusses two-stage clustering (coarse ANN clustering followed by fine hierarchical clustering) and multi-LoRA serving with vLLM. The results are added to App. L (Table 20).
Thank you again for the helpful suggestions, and we are glad to discuss any further questions.