- Rating
- 1
- Confidence
- 4
- Informativeness
- 1
- Presentation
- 1
- Soundness
- 1
Read review
Paper summary
The paper studies unwanted memory exposure in LLM-based clinical agents. The paper introduces TRACE, a verifier-guided framework for evolving, reusable probing strategies.
Critical strengths
None
Critical weaknesses
- The broader motivation of memory exposure in clinical agents seems artificial and unclear. If information retained from the earlier interaction for the same patient shows up later, why is this a dangerous privacy risk? Why can't the memory just be reset for every interaction if privacy is the priority? As stated now in the introduction, it's unclear and not compelling.
- The connection between the memory exposure and the research questions doesn't make sense. Why do you study probing strategies instead of auditing the conversational traces directly for memory exposure? Why can't stronger agentic LLMs like GPT-6 Astra directly audit the agents traces and conversational history to assess this?
Questions for authors
- Can you clarify the motivation for studying memory exposure in clinical agents?
- Can you use newer LLMs with stronger agentic capabilities (GPT-6 Astra, Claude Opus 5.5, Qwen3.8)?