- Rating
- 1
- Confidence
- 3
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 2
Read review
Paper summary
The paper studies persona diversification through two axis, selecting personas from an existing pool and generating new ones. It introduces four algorithms based on different diversity objectives, with theoretical guarantees for some of them, and evaluates whether diversified persona sets improve the diversity and creativity of LLM-generated responses using automatic metrics and LLM-as-judge.
Critical strengths
The main strength of the paper is its systematic formulation of persona diversification, organizing the problem along two axes and proposing four corresponding methods. The theoretical guarantees for the selection and sampling algorithms provide a useful foundation for the proposed framework, although these guarantees are limited to persona-space objectives.
Critical weaknesses
1. Writing, organization, and clarity
The manuscript frequently reads like AI-generated text that has not been sufficiently reviewed or polished. There are recognizable patterns of AI-assisted writing, including excessive jargon, unnecessarily complicated phrasing, and abrupt transitions between concepts without adequate explanation. While the use of AI writing tools is not inherently problematic, submitting text without careful revision is concerning, particularly in an academic paper where clarity, precision, and coherent argumentation are essential.
Beyond these stylistic issues, the paper lacks a clear narrative and hierarchy of information.
For example, the abstract reports numerous individual percentage improvements, making it read more like a conclusion than a concise summary of the problem, approach, and main findings.
The introduction does not adequately explain the proposed framework. While the general idea of exploring the relationship between persona diversity and response diversity is understandable, the actual approach remains vague. In lines 073–079, four methods are introduced without sufficient intuition about what each method does or how they differ. Furthermore, one of the framework's main axes, "space-filling coverage versus frontier-seeking separation," is not clearly explained in the text, forcing readers to rely on Figure 1. However, Figure 1 itself is not sufficiently informative, as the formulas are presented without adequate explanation of their notation or meaning.
Similarly, the paragraph beginning at line 080 suddenly introduces the concept of the "structural geometry of persona sets" without adequately explaining what it means in this context. This issue recurs throughout the paper, as technical terms and concepts are frequently introduced without sufficient motivation or explanation, making the narrative unnecessarily difficult to follow.
The mathematical presentation could also be improved. Equations (2)–(4) describe standard distance measures, such as cosine distance, and could largely be moved to the appendix. Including these basic definitions in the main text adds clutter without providing much insight, while more important parts of the framework remain underexplained. Conversely, Equations (5)–(6) and the accompanying discussion in lines 162–170 are introduced rather abruptly, without clearly explaining their purpose or how they connect to the subsequent algorithms.
2. Motivation and justification of the methods
The modeling choices and algorithms in Section 3 would benefit from stronger motivation and more intuitive explanations. Although the paper provides formal definitions, theoretical guarantees, and references to established techniques, it is not always clear why these particular formulations were chosen or what intuition supports them.
Many of these optimization and sampling techniques have connections to established problems in the literature. Making those connections more explicit, particularly in the main text, and explaining the intuition behind each modeling choice would help readers understand the methodology and distinguish its contributions from existing approaches.
As currently presented, the section emphasizes mathematical formalism and theoretical guarantees without sufficiently developing the reasoning behind the proposed design choices.
3. Concerns about the evaluation methodology
The evaluation methodology raises significant concerns. Previous work has shown that LLM-as-a-judge and automated creativity metrics are not always reliable [1], and that LLM-based creativity judgments can exhibit weak agreement with human evaluations, particularly for subjective and holistic aspects of creativity [2,4]. Furthermore, average cosine similarity alone is insufficient to establish output homogeneity [3].
Although the paper employs multiple evaluation metrics, it does not directly evaluate whether human judges perceive the outputs of the proposed methods as more creative or diverse. Given the known limitations of automated evaluation, the absence of such human evaluation makes it difficult to determine whether the reported improvements correspond to meaningful gains in creativity. This substantially weakens the empirical evidence supporting the paper's main claims.
4. Limited evidence of benefits beyond simple prompt variation
As discussed in [3], relatively simple changes in prompt wording and specificity can substantially increase measured response diversity. Therefore, observing greater diversity after introducing different persona instructions is not particularly surprising on its own. This raises questions about how much of the reported improvement reflects the proposed diversification framework rather than the more general effect of prompt variation.
Although the paper compares against random personas and creativity-enhanced prompting, the results do not sufficiently establish the practical advantage of the proposed approach over simpler prompt-diversification strategies, especially given its additional complexity. Stronger comparisons against inexpensive prompt-variation baselines would help clarify the contribution.
References
[1] https://aclanthology.org/2026.eacl-long.297/
[2] https://arxiv.org/abs/2608.30754
Questions for authors
None