- Rating
- 3
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 2
- Soundness
- 2
Read review
Paper summary
This paper presents MemSlides, a hierarchical memory framework for personalized slide generation and multi-turn local revision. It separates persistent user profiles, session-level working memory, and reusable tool experience. A Plan–Act–Guard editing pipeline uses explicit edit scopes, local snapshots, and coverage checks to complete revisions while preserving non-target content. The evaluation includes persona alignment, general presentation quality, human preference ratings, and controlled comparisons of memory organization and localized editing.
Critical strengths
- The paper addresses persistent personalization and reliable local editing, both of which are important for interactive presentation authoring.
- Distinguishing user preferences, session constraints, and tool experience provides a sensible organization for managing information across tasks and revision turns.
- Explicit scope control, snapshot-bound patches, and coverage checks provide a practical mechanism for reducing unintended changes.
- The paper combines model-based judgments, human ratings, and controlled memory comparisons, providing evidence from several perspectives.
Critical weaknesses
- The profiles include predefined persona information, so it is unclear how much improvement comes from learning user preferences. A comparison without this extra information would help.
- Some results are inconsistent. Table 9’s Overall scores do not always match the stated averaging rule, and the GLM-5 quality claim in Appendix A.5 conflicts with Table 2. These should be clarified and corrected.
Questions for authors
How does performance change when profiles contain only interaction-derived preferences, without seeded completion?
How many distinct decks were included in the human study, which decks did each participant evaluate, and was condition order randomized?
2 comments
Follow-up on Our Rebuttal
Dear Reviewer,
Thank you again for your valuable feedback and thoughtful evaluation of our work.
In our rebuttal, we added a comparison showing that interaction-derived preferences alone improve Preference Score from 3.00 to 7.83 without predefined persona information. We also clarified the Overall scoring procedure in Table 9, corrected the GLM-5 quality statement in Appendix A.5, and explained the human-study deck assignment and randomized presentation order.
We would like to follow up to ask whether our rebuttal and additional experiments have adequately addressed your concerns. If any questions remain, we would be happy to provide further clarification.
If you feel that your concerns have been resolved, we would greatly appreciate it if you could consider raising your score accordingly.
Thank you for your time and consideration.
Best regards,
The Authors
Acknowledgment
We thank the reviewer for recognizing the importance of persistent personalization and reliable local editing, our memory organization and revision mechanism, and the evaluation from several perspectives.
Weaknesses
W1 & Q1 Comparison using only interaction-derived preferences
Thank you for suggesting this comparison. Without predefined persona information, interaction-derived preferences yield a 4.83-point improvement in preference following, from 3.00 to 7.83 on a 0–8 scale.
We evaluate 6 cases, 1 per simulated user, under 3 conditions: No profile, only preferences retained from 3 prior interaction rounds, and the same interaction-derived profile processed with seeded completion. Each case uses the same new task and material across conditions; the current request does not repeat the preferences. We have added this comparison to Appendix A.18 (Table 21).
Table 1. Preference following across profile conditions. Preference Score is the mean total across 4 interaction-derived preference ratings (0–2 each; 0–8 total), using the median of 3 blind GPT-5 judgments per preference. Full Match reports how many of the 6 cases satisfy all 4 preferences.
No profile vs. only interaction-derived preferences: The 4.83-point gain and increase in Full Match from 0/6 to 5/6 show that profiles containing preferences expressed in prior interactions effectively guide new tasks. The improvement does not rely on extra predefined persona information.
Only interaction-derived preferences vs. interaction-derived preferences + seeded completion: Preference Score is lower with seeded completion (6.83 vs. 7.83). This may reflect changes in how the interaction-derived preferences are prioritized when combined with additional persona information. The rubric evaluates only the 4 interaction-derived preferences, so additional persona characteristics receive no separate credit. Both profile conditions outperform No profile (3.00), further supporting the role of interaction-derived preferences in guiding new tasks.
W2 Scoring definition in Table 9 and wording correction in Appendix A.5
Thank you for pointing out the unclear caption in Table 9 and the incorrect description in Appendix A.5.
Questions
Q2 Human-study decks, assignment, and condition order
The study included 9 distinct pre-generated decks. For each of 3 preference profiles, MemSlides, Mem0, and No profile each generated 1 deck.
Each of the 25 participants evaluated the 3 decks for the profile matching their preference-questionnaire responses. They rated each deck according to their own preferences on Direct, Content, Organization, and Visual using a 1–5 satisfaction scale, yielding 75 deck ratings.
Yes, condition order was automatically randomized by the questionnaire platform. Decks were presented under anonymous labels.