W1: Fundamental mismatch between the claimed Personalization problem and implemented Query-Focused MDS (Primary Blocker)
The central concern is that the authors position their contribution as personalized MDS, whereas the actual problem formulation addresses conventional query-focused MDS. The work considers the user query or intent itself as the personalization interface. However, conditioning content selection solely on a query does not establish adaptation to the subjective information needs of different users. The proposed ranking depends on the source documents and the query, without considering user-specific context, preferences, or individual information needs beyond the given query.
I feel this distinction is particularly important and decision-critical because the relevance and importance of information can be inherently subjective and user-dependent, even when users express identical queries.
For example, consider two users reading the same collection of news articles about an earthquake and asking exactly the same question: "Summarize the economic impact of the earthquake."
- Alice, a local small-business owner, may prioritize business closures, financial assistance, reopening costs, and local employment consequences.
- Bob, a supply-chain analyst, may prioritize manufacturing disruptions, transportation bottlenecks, production losses, and broader economic consequences.
Although the documents and queries are identical, their subjective information priorities can differ substantially. Under the proposed formulation, both users receive the same topic ranking because their individual contexts are not represented. This makes it unclear what exactly is being personalized beyond explicit query conditioning.
The experimental design also reinforces this concern. The authors evaluate generic and query-focused summarization using synthetically generated intents, where the metrics focus on coverage, diversity, and answerability. These are appropriate measurements for QF-MDS, but they do not establish whether the framework can address different subjective information priorities across users. Therefore, neither the problem formulation nor the experimental results convincingly justify the claimed personalization contribution.
W2: Limited methodological novelty and lack of sufficiently new empirical insights for QF-MDS (Decision-critical)
Even if the work is considered purely as a QF-MDS contribution, I find the methodological novelty and empirical insights are not sufficiently convincing.
The overall approach of extracting atomic facts, selecting relevant and diverse information, and providing selected evidence to an LLM has already been explored in "Principled Content Selection to Generate Diverse and Personalized Multi-Document Summaries" (Padmakumar et al., ACL 2025). Similarly, the idea of balancing information importance and diversity through reinforced random walks was introduced in "DivRank: The Interplay of Prestige and Diversity in Information Networks" (Mei et al., KDD 2010), which also considered summarization applications.
The proposed differentiable recurrent DivRank, combined with learned neural priors and hierarchical document-topic interactions, is an interesting architectural modification. However, I am not very convinced that this integration brings a sufficiently distinct methodological advancement over these established ideas. The experiments do not include a direct comparison with conventional DivRank-based content selection in the same setup. This makes it difficult to understand how much improvement actually comes from the proposed differentiable recurrent formulation, rather than the already established relevance-diversity ranking principles.
The empirical findings also largely follow observations which have been established earlier: explicit content selection improves multi-document coverage, while jointly considering relevance and diversity helps selecting more informative and non-redundant content. Although the reported results show improvements over the considered baselines, including held-out and zero-shot evaluations, I do not find a substantially new insight about the QF-MDS problem emerging from these results.
Therefore, beyond the fundamental personalization concern, the independent contribution to QF-MDS also appears insufficiently differentiated from prior research, both in its methodology and empirical findings. This makes the overall significance of the proposed work difficult to justify for acceptance.
Invitation for Further Discussion on Key Concerns
Dear Authors,
I would be interested to hear your perspective on the main concerns raised in my review, particularly regarding the personalization formulation and the independent methodological contribution. Since the discussion period is approaching its end, I thought an earlier response, if possible, would allow me to have a more meaningful exchange rather than only a last-minute assessment.
I remain open to reconsidering my evaluation based on your clarifications and supporting evidence.