- Rating
- 2
- Confidence
- 2
- Informativeness
- 2
- Presentation
- 1(−1)
- Soundness
- 2
Read review
Paper summary
The paper proposes a DP framework that eliminates per-query privacy expenditure by privately selecting a fixed set of public passages during an offline preparation stage. It combines answer completeness and private-evidence support into a bounded fidelity score, then applies bidirectional multiplicative-weight updates to prioritize informative passages and underrepresented queries. The authors establish pure DP guarantees and conditional answer-support bounds.
Critical strengths
- The offline synopsis construction decouples privacy expenditure from query volume, addressing a limitation of query-time DP mechanisms in long-lived RAG systems. Selecting intact public passages also preserves source provenance while avoiding direct exposure of protected retrieval content.
- The paper establishes pure DP guarantees for the sampled synopsis, including the effects of data-dependent reweighting, and extends these guarantees to adaptive query transcripts and document-level adjacency. The analysis also explicitly distinguishes estimated evidence support from semantic correctness, making the theoretical assumptions relatively transparent.
- Experiments on healthcare and finance datasets demonstrate improved long-horizon accuracy over several DP-RAG baselines, with reduced empirical extraction leakage.
Critical weaknesses
- The framework combines offline DP release, multiplicative-weight updates, and evidence-support estimation. The paper does not adequately isolate the contribution of bidirectional reweighting, private-evidence guidance, and the proposed fidelity score. Comparisons against uniform sampling alone are insufficient to establish the necessity of the individual components, particularly given the existing related work on private synopsis construction.
- SynopsisRAG releases only one public passage per category, making retrieval capacity limited. Its effectiveness depends on public passages covering information present in the protected corpus and on evaluation queries aligning with predefined categories. Consequently, the method could not recover private-only knowledge and may struggle with heterogeneous, compositional, or multi-document questions. The evaluation does not examine open-domain routing or systematically quantify performance when relevant information is absent from the public corpus.
- Although the paper proves bounds on low-support risk, its answer-validity guarantee includes an unmeasured semantic-error term, meaning it does not directly establish answer correctness. Moreover, the privacy calibration constrains selection concentration. This raises questions about how much meaningful private-evidence-driven selection is possible under strong privacy constraints. The experiments do not adequately characterize this relationship or report uncertainty across independently sampled synopses.
Questions for authors
How to address the concerns mentioned in the Weaknesses section.